Hello,
I'm using xCAT-2.15 initial release to provision stateless nodes which
all have one Ethernet nic and one Infiniband nic.
I want to use the IPoIB ULP (Mellanox OFED packages/yum install method),
thus to configure an ip address on both nics.
Note : I don't want to route the ipoib network.
When using nics table + confignetwork (-s) to do so, results vary
depending on the following setups in the nics table
1/
#node,nicips,nichostnamesuffixes,nichostnameprefixes,nictypes,niccustomscripts,nicnetworks,nicaliases,nicextraparams,nicdevices,nicsadapter,comments,disable
"compute","ib0!|maestro-(\d+)$|172.16.($1/250-$1/250/2-2).($1%250+2)|","ib0!-ib0",,"ib0!Infiniband",,"ib0!maestro_ipoib",,"ib0!DEFROUTE=no",,,,
-> ip on ib0 ok, routes ok
2/ same setup but network defined inside nics table itself
#node,nicips,nichostnamesuffixes,nichostnameprefixes,nictypes,niccustomscripts,nicnetworks,nicaliases,nicextraparams,nicdevices,nicsadapter,comments,disable
"compute","ib0!|maestro-(\d+)$|172.16.($1/250-$1/250/2-2).($1%250+2)|","ib0!-ib0",,"ib0!Infiniband",,"ib0!172_16_0_0-255_255_248_0",,"ib0!DEFROUTE=no",,,,
-> no ip gets configured on ib0 : why (network seems identical to the
one defined in networks table (see 3/) to me ?
3/ same setup but without forcing no default route :
-> ip on ib0 ok, BOGUS routes table (2 default routes, same gateway,
different nics) :
Kernel IP routing table
Destination Gateway Genmask Flags MSS Window irtt
Iface
0.0.0.0 192.168.144.1 0.0.0.0 UG 0 0 0
enp33s0f0
0.0.0.0 192.168.144.1 0.0.0.0 UG 0 0 0
ib0
172.16.0.0 0.0.0.0 255.255.248.0 U 0 0 0
ib0
192.168.144.0 0.0.0.0 255.255.240.0 U 0 0 0
enp33s0f0
192.168.144.1 0.0.0.0 255.255.255.255 UH 0 0 0 ib0
-> where does this come from ?
Here's, for every of the above tests my related setup :
- networks
#netname,net,mask,mgtifname,gateway,dhcpserver,tftpserver,nameservers,ntpservers,logservers,dynamicrange,staticrange,staticrangeincrement,nodehostname,ddnsdomain,vlanid,domain,mtu,comments,disable
"maestro_net","192.168.144.0","255.255.240.0","eth0","192.168.144.1",,"<xcatmaster>",,,,"192.168.144.2-192.168.147.254",,,,,,"maestro.pasteur.fr","1500",,
"maestro_ipoib","172.16.0.0","255.255.248.0",,,,,,,,,,,,,,,"1500",,
- site
"domain","maestro.pasteur.fr",,
A side, more general and different, question about nics is : what's the
use of nics.networks attribute relative to domain, as in my experience,
domain is always found by matching the ipaddress against networks table
or site.domain is used ?
Thanks for your help
--
Thomas HUMMEL
_______________________________________________
xCAT-user mailing list
xCAT-user@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/xcat-user
