centos 7 firewall d routing IB to eth network with multihomed server

Add the following to /etc/sysctl.conf: net.ipv4.ip_forward = 1
Apply the sysctl settings: sysctl -p

Add direct rules to firewalld. Add the --permanent option to keep these rules across restarts.
firewall-cmd --zone=public --add-masquerade --permanent
firewall-cmd --direct --add-rule ipv4 nat POSTROUTING 0 -o ens1.801 -j MASQUERADE
firewall-cmd --direct --add-rule ipv4 filter FORWARD 0 -i ib0:3 -o ens1.801 -j ACCEPT
firewall-cmd --direct --add-rule ipv4 filter FORWARD 0 -i ens1.801 -o  ib0:3 -m state --state RELATED,ESTABLISHED -j ACCEPT



credits goes to:
https://www.centos.org/forums/viewtopic.php?t=53819

Lustre 2.10.x dkms usage

get the src for the lustre-client-dkms package from the:

https://build.hpdd.intel.com/job/lustre-b2_10/arch=x86_64,build_type=client,distro=el7,ib_stack=inkernel/

1) rpmbuild --rebuild --without servers lustre-client-dkms-2.10.2_RC1-1.el7.src.rpm
2) yum install /root/pmbuild/RPMS/noarch/lustre-client-dkms-2.10.2_RC1-1.el7.centos.noarch.rpm
It will rebuild the modules for the active kernel with the following commands:
 

/bin/bash /sbin/dkms build -m lustre-client -v 2.10.2_RC1 -k 3.10.0-693.5.2.el7.x86_64

PS troubleshooting
if dkms  status shows something like this:

 dkms status
lustre-client, 2.10.2_RC1, 3.10.0-693.5.2.el7.x86_64, x86_64: installed (original_module exists) (WARNING! Diff between built and installed module!) (WARNING! Diff between built and installed module!) (WARNING! Diff between built and installed module!) (WARNING! Diff between built and installed module!)

1) dkms --force remove  -m  lustre-client -v 2.10.2_RC1 -k 3.10.0-693.5.2.el7.x86_64
2) rm -fr  /lib/modules/3.10.0-693.5.2.el7.x86_64/extra/lustre
3) find and remove manually the module leftovers: find /lib/modules/| grep lustre
4) dkms --force install -m  lustre-client -v 2.10.2_RC1 -k 3.10.0-693.5.2.el7.x86_64

Deleting the funny 192.168.122.xxx network from CentOS 7.4

In order to stop unnecessary interface on the VM:
 
yum install -y libvirt-client
systemctl start  libvirtd 
virsh net-destroy default
systemctl stop  libvirtd 
systemctl disable  libvirtd 


 

NVME intel performance on CentOS7.3

[root@c1701 ~]# hdparm -tT   --direct /dev/nvme0n1



/dev/nvme0n1:

 Timing O_DIRECT cached reads:   2512 MB in  2.00 seconds = 1255.72 MB/sec

 Timing O_DIRECT disk reads: 3604 MB in  3.00 seconds = 1200.83 MB/sec

[root@c1701 ~]# hdparm -tT   --direct /dev/nvme0n1



/dev/nvme0n1:

 Timing O_DIRECT cached reads:   2398 MB in  2.00 seconds = 1198.11 MB/sec

 Timing O_DIRECT disk reads: 3720 MB in  3.00 seconds = 1239.86 MB/sec

[root@c1701 ~]#