Re: [lustre-discuss] IPoIB best practises

2022-01-16 Thread Åke Sandgren
On 1/17/22 2:36 AM, Angelos Ching via lustre-discuss wrote: > Hi Eli, > > Yes & no; part of my info is a bit rusty because I carried them from > version around 2.10. MR is now turned on by default. > > But you'll need to have an IP setup on each IPoIB interface, and for all > ib0 & all ib1

Re: [lustre-discuss] IPoIB best practises

2022-01-16 Thread Angelos Ching via lustre-discuss
Hi Eli, Yes & no; part of my info is a bit rusty because I carried them from version around 2.10. MR is now turned on by default. But you'll need to have an IP setup on each IPoIB interface, and for all ib0 & all ib1 interface, they should be in different subnet. Eg: all ib0 on

Re: [lustre-discuss] IPoIB best practises

2022-01-16 Thread E.S. Rosenberg
Hi Angelos, Thanks for the answer! According to the lecture Lauz just sent multirail is on by default no? So I don't need to set IPs on each interface (using interfaces/netplan/network scripts) just a single NID at the lnet level? Thanks again, Eli On Sun, Jan 16, 2022 at 5:20 PM Angelos Ching

Re: [lustre-discuss] IPoIB best practises

2022-01-16 Thread Angelos Ching via lustre-discuss
Hi Eli, I think you can leave out the IP so long as you specific the interface, but IIRC you can't setup multirail via modprobe, you should setup Lnet using lnetctl Best regards, Angelos (Sent from mobile, please pardon me for typos and cursoriness.) > 16/1/2022 21:38、E.S. Rosenberg のメール: >

Re: [lustre-discuss] IPoIB best practises

2022-01-16 Thread E.S. Rosenberg
Hey Lauz, Thanks for the reply! Indeed it sounds like multirail is what I am referring to (my wrong memory of multirail was a failover technique allowing connection of both TCP and IPoIB or multiple IPoIB between nodes at the same time), but I am still left with a question. In the modprobe

Re: [lustre-discuss] IPoIB best practises

2022-01-16 Thread Laurence Horrocks-Barlow via lustre-discuss
The limit of IPoIB is active/backup when using traditional bonding, however I believe you are wanting to multirail your IB. This is achieved buy using multiple LNet's (assuming it uses the same fabric), you should be able to configure for active/active.

[lustre-discuss] IPoIB best practises

2022-01-16 Thread E.S. Rosenberg
Hey everyone, This is probably off-topic but I can't find any documents on the subject and since Lustre uses IPoIB I suspect others here have dealt with this question. If I have a node connected with multiple IB links should each connected IB port have it's own IP address or is there a way