At the moment, the Lustre servers only have a low-bandwidth (1G) management network that would be insufficient for running Lustre. The IB gateway theoretically gives me 40G Ethernet connections to my clients which also have 40G Ethernet ports. I could potentially set up a Lustre router, but would like to use the hardware I already have in place, if possible.
Thanks, Kevin On Mon, Aug 1, 2016 at 7:58 AM, Stolarek, Marcin <[email protected] > wrote: > Personally I’d suggest setting up lnet router between tcp and lustre > network instead of using mellanox ib 2 ethernet gateway. It may be even > easier if you have ethernet on lustre oss/mds servers but you haven’t > configured lnet for tcp? > > > > As far as I know this gateway works as arp proxy, which can lead you to > really interesting and uncommon scenarios. This will increase the time > needed to find the solution when incident happens J > > > > Cheers, > > Marcin > > > > *From:* lustre-discuss [mailto:[email protected]] *On > Behalf Of *Kevin M. Hildebrand > *Sent:* Monday, August 01, 2016 1:06 PM > *To:* [email protected] > *Subject:* EXT SENDER-[lustre-discuss] Mounting Lustre over > IB-to-Ethernet gateway > > > > Our Lustre filesystem is currently set up to use the o2ib interface only- > all of the servers have > options lnet networks=o2ib0(ib0) > > We've just added a Mellanox IB-to-Ethernet gateway and would like to be > able to have clients on the Ethernet side also mount Lustre. The gateway > extends the same layer-2 IP range that's being used for IPoIB out to the > Ethernet clients > > How should I go about doing this? Since the clients don't have IB, it > doesn't appear that I can use o2ib0 to mount. Do I need to add another > lnet network on the servers? Something like > options lnet networks=o2ib0(ib0),tcp0(ib0)? Can I have both protocols on > the same interface? > > And if I do have to add another lnet network, is there any way to do so > without restarting the servers? > > > > Thanks, > > Kevin > > > -- > > Kevin Hildebrand > > University of Maryland, College Park > > Division of IT > > > **************************************************************************************** > Note: If the reader of this message is not the intended recipient, or an > employee or agent responsible for delivering this message to the intended > recipient, you are hereby notified that any dissemination, distribution or > copying of this communication is strictly prohibited. If you have received > this communication in error, please notify us immediately by replying to > the message and deleting it from your computer. Thank you. > **************************************************************************************** > >
_______________________________________________ lustre-discuss mailing list [email protected] http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
