Hello, Actually, I don't quite remember why our discovery network is not part of the admin network. I see 2 possible reasons : 1/ I moved from CSM to xCAT and I believe CSM did not let you choose the discovery network and I came with that habit. And from that habit I knew that I needed to have an alias on eth0 on the management server to reach the discovery network when it differs from the admin network. 2/ There was one customer where we had no free address in the admin network to give a range of discover addresses.
There is an advantage in using a different set of addresses, you quickly see that the node is in discovery because the address is so different : - ) So now I don't understand why this is the first install where it does not work, but I guess it is our first install with genesis, may be before that getdestiny was using the xcat master variable which happens to be in the admin network or some other way that did not need a gateway. Best regards, Antoine Tabary 17 Avenue De L'europe Certified HPC I/T Specialist Bois Colombes Cedex, 92275 6520AA France ITS e-mail: [email protected] From: Bruce M Potter <[email protected]> To: xCAT Users Mailing list <[email protected]> Date: 14/09/2012 15:48 Subject: Re: [xcat-user] discovery is not completed. and imm never set Antoine, Glad you figured this out and thx for sharing it with the mailing list. Out of curiosity, what is the reason for having a discovery network that is different from the admin network? Bruce Potter STSM, Linux & AIX Cluster Development, IBM, Poughkeepsie, NY Email: [email protected] Phone: external: 845-433-7073, internal: TL 293-7073 Antoine Tabary ---09/14/2012 09:08:46 AM---Hello, Thank you for that information. We were not aware of that table but xCAT From: Antoine Tabary <[email protected]> To: xCAT Users Mailing list <[email protected]>, Date: 09/14/2012 09:08 AM Subject: Re: [xcat-user] discovery is not completed. and imm never set Hello, Thank you for that information. We were not aware of that table but xCAT does things automatically when you load the 1350 cluster default entries, because there is an ipmi entry in that table which causes all nodes member of group ipmi to inherit the proper value for chain. We eventually found out the root cause of our problem. We use a discovery network that differs from the admin network and found out that when you do so, you need to enter a gateway address in xCAT table networks if you want chain to work. Now that we added it and ran again "makedhcp -n" everything works fine. The gateway address being in that case the xCAT management server address in the admin network. More details =========== When an unknow node is powered on, dhcpd on the xCAT administration server hands it a temporary address in the range of the discovery network and a genesys system image is loaded. Once the node is booted it does discovery, finds out which node it is, xCAT enters the MAC address in xCAT table mac, updates dhcpd.leases to point to the permanent address of that node. Then the node asks the dhcp server for its permanent address and changes to it. Then in /bin/doxcat it calls getdestiny to know what to do next, it retrieves the xCAT server address on /proc/cmdline, and the address it retrieves there is on the discovery network, but because the node now has an address in the admin network it cannot reach that address unless a gateway is provided. In order to provide the gateway, we entered it in the xCAT table networks on the line of the admin network and reran makedhcp -n. The gateway address being in that case the xCAT management server address in the admin network. So, for bmcsetup to automaticaly follow discovery when the discovery network differs from the admin network you need : * chain to be set to runcmd=bmcsetup,standby * a gateway entry in the xCAT table networks for the admin network line Best regards, Antoine Tabary 17 Avenue De L'europe Certified HPC I/T Specialist Bois Colombes Cedex, 92275 6520AA France ITS e-mail: [email protected] From: Xiao Peng Wang <[email protected]> To: xCAT Users Mailing list <[email protected]> Cc: xCAT Users Mailing list <[email protected]> Date: 06/09/2012 19:41 Subject: Re: [xcat-user] discovery is not completed. and imm never set What did you set in the chain table? Genesis will try to go through tasks in the chain attribute of the node and run one by one. So need to set the bmcsetup in the chain. chdef <node> chain=runcmd=bmcsetup Thanks Best Regards ---------------------------------------------------------------------- Wang Xiaopeng (???) IBM China System Technology Laboratory Tel: 86-10-82453455 Email: [email protected] Address: 28,ZhongGuanCun Software Park,No.8 Dong Bei Wang West Road, Haidian District Beijing P.R.China 100193 Patrick Jaeger ---2012/08/31 21:51:20---Hello , we would use the automatic discovery of nodes in Cluster 1350 From: Patrick Jaeger <[email protected]> To: xCAT Users Mailing list <[email protected]>, Date: 2012/08/31 21:51 Subject: [xcat-user] discovery is not completed. and imm never set Hello , we would use the automatic discovery of nodes in Cluster 1350 OS : RHEL 6.2 server xcat version : 2.7.3 the node port on the switch is declared in the table switche and is good ... when we Power ON ( with the button ) the node , the discovery process begin ... after a couple of minutes ... the table mac is filled with the Good adress ... the good admin adress is set on the eth0 ( i can ping the node !!!) but the process enter in a loop and the IUP adress of the IMM is never set ... if i ssh the node is it always in GENESYS mode i use a workarround to bypass this problem : on the Xcat Server i run the command : nodeset MY_NODE runcmd=bmcsetup and i reboot the node ( reboot -f on the node for example ) ... after this reboot the imm is set correctly ... WHY the aotomatic process is not completed ? . thanks for your help ... Bonne réception / Bests Regards Patrick Jaeger 17 Avenue De L'europe HPC I/T Specialist Bois Colombes Cedex, 92275 ECIS 6520AA France ITS Phone: +33-1-5875-2455 Mobile: +33-6.7192.2077 e-mail: [email protected] Sauf indication contraire ci-dessus:/ Unless stated otherwise above: Compagnie IBM France Siège Social : 17 avenue de l'Europe, 92275 Bois-Colombes Cedex RCS Nanterre 552 118 465 Forme Sociale : S.A.S. Capital Social : 645.605.931,30 ? SIREN/SIRET : 552 118 465 03644 - Code NAF 6202A ------------------------------------------------------------------------------ Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ _______________________________________________ xCAT-user mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/xcat-user ------------------------------------------------------------------------------ Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ _______________________________________________ xCAT-user mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/xcat-user Sauf indication contraire ci-dessus:/ Unless stated otherwise above: Compagnie IBM France Siège Social : 17 avenue de l'Europe, 92275 Bois-Colombes Cedex RCS Nanterre 552 118 465 Forme Sociale : S.A.S. Capital Social : 645.605.931,30 ? SIREN/SIRET : 552 118 465 03644 - Code NAF 6202A ------------------------------------------------------------------------------ Got visibility? Most devs has no idea what their production app looks like. Find out how fast your code is with AppDynamics Lite. http://ad.doubleclick.net/clk;262219671;13503038;y? http://info.appdynamics.com/FreeJavaPerformanceDownload.html _______________________________________________ xCAT-user mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/xcat-user ------------------------------------------------------------------------------ Got visibility? Most devs has no idea what their production app looks like. Find out how fast your code is with AppDynamics Lite. http://ad.doubleclick.net/clk;262219671;13503038;y? http://info.appdynamics.com/FreeJavaPerformanceDownload.html _______________________________________________ xCAT-user mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/xcat-user Sauf indication contraire ci-dessus:/ Unless stated otherwise above: Compagnie IBM France Siège Social : 17 avenue de l'Europe, 92275 Bois-Colombes Cedex RCS Nanterre 552 118 465 Forme Sociale : S.A.S. Capital Social : 645.605.931,30 ? SIREN/SIRET : 552 118 465 03644 - Code NAF 6202A
<<image/gif>>
<<image/gif>>
<<image/gif>>
<<image/gif>>
<<image/gif>>
<<image/gif>>
<<image/gif>>
<<image/gif>>
<<image/gif>>
<<image/gif>>
<<image/gif>>
<<image/gif>>
<<image/gif>>
<<image/gif>>
<<image/gif>>
<<image/gif>>
<<image/gif>>
<<image/gif>>
<<image/gif>>
------------------------------------------------------------------------------ Got visibility? Most devs has no idea what their production app looks like. Find out how fast your code is with AppDynamics Lite. http://ad.doubleclick.net/clk;262219671;13503038;y? http://info.appdynamics.com/FreeJavaPerformanceDownload.html
_______________________________________________ xCAT-user mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/xcat-user
