Personally I’d suggest setting up lnet router between tcp and lustre network instead of using mellanox ib 2 ethernet gateway. It may be even easier if you have ethernet on lustre oss/mds servers but you haven’t configured lnet for tcp?
As far as I know this gateway works as arp proxy, which can lead you to really interesting and uncommon scenarios. This will increase the time needed to find the solution when incident happens ☺ Cheers, Marcin From: lustre-discuss [mailto:[email protected]] On Behalf Of Kevin M. Hildebrand Sent: Monday, August 01, 2016 1:06 PM To: [email protected] Subject: EXT SENDER-[lustre-discuss] Mounting Lustre over IB-to-Ethernet gateway Our Lustre filesystem is currently set up to use the o2ib interface only- all of the servers have options lnet networks=o2ib0(ib0) We've just added a Mellanox IB-to-Ethernet gateway and would like to be able to have clients on the Ethernet side also mount Lustre. The gateway extends the same layer-2 IP range that's being used for IPoIB out to the Ethernet clients How should I go about doing this? Since the clients don't have IB, it doesn't appear that I can use o2ib0 to mount. Do I need to add another lnet network on the servers? Something like options lnet networks=o2ib0(ib0),tcp0(ib0)? Can I have both protocols on the same interface? And if I do have to add another lnet network, is there any way to do so without restarting the servers? Thanks, Kevin -- Kevin Hildebrand University of Maryland, College Park Division of IT **************************************************************************************** Note: If the reader of this message is not the intended recipient, or an employee or agent responsible for delivering this message to the intended recipient, you are hereby notified that any dissemination, distribution or copying of this communication is strictly prohibited. If you have received this communication in error, please notify us immediately by replying to the message and deleting it from your computer. Thank you. ****************************************************************************************
_______________________________________________ lustre-discuss mailing list [email protected] http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
