Important Note: The definitive source for Lustre documentation is the Lustre Operations Manual available at https://wiki.hpdd.intel.com/display/PUB/Documentation.
These documents are copied from internal SSEC working documentation that may be useful for some, but be we provide no guarantee of accuraccy, correctness, or safety. Use at your own risk.
These notes are for hosts bridgng between networks, such as infinband to ethernet. Significant portions of the notes have been removed as they are specific to SSEC procedures.
options lnet 'ip2nets="o2ib0 172.16.*.*; tcp0 220.127.116.11/22"'
options lnet ip2nets="tcp0 128.104.*.*; o2ib0 172.16.*.*" forwarding=enabled
Need to have lustre client installed
options lnet networks="tcp" routes="o2ib0 18.104.22.168@tcp0"
service --add lustre service --add lnet chkconfig lustre on chkconfig lnet on reboot
After the reboot, you can create mount points and add lustre mounts. Here is an example of adding fjord to /etc/fstab.
172.16.24.5@o2ib:/fjord /fjord lustre defaults,_netdev,user_xattr 0 0
options lnet ip2nets="o2ib0 172.16.*.*" routes="tcp0 172.16.24.13@o2ib0 172.16.24.[220-229]@o2ib0"
where 172.16.24.13 is your router. multiple can be speicifed, and you can use the syntax:
Where N is a number.
options lnet ip2nets="o2ib0 172.16.*.*" routes="tcp0 172.16.24.13@o2ib0"
lfs df -h
And see if every OST is active and available.
It may take a few minutes for the mount points to work properly after you get everything else up, because it needs to determine which OSTs are up and sane, and it needs to determine which routers are active.