Antoine, Glad you figured this out and thx for sharing it with the mailing list. Out of curiosity, what is the reason for having a discovery network that is different from the admin network?
Bruce Potter STSM, Linux & AIX Cluster Development, IBM, Poughkeepsie, NY Email: [email protected] Phone: external: 845-433-7073, internal: TL 293-7073 From: Antoine Tabary <[email protected]> To: xCAT Users Mailing list <[email protected]>, Date: 09/14/2012 09:08 AM Subject: Re: [xcat-user] discovery is not completed. and imm never set Hello, Thank you for that information. We were not aware of that table but xCAT does things automatically when you load the 1350 cluster default entries, because there is an ipmi entry in that table which causes all nodes member of group ipmi to inherit the proper value for chain. We eventually found out the root cause of our problem. We use a discovery network that differs from the admin network and found out that when you do so, you need to enter a gateway address in xCAT table networks if you want chain to work. Now that we added it and ran again "makedhcp -n" everything works fine. The gateway address being in that case the xCAT management server address in the admin network. More details =========== When an unknow node is powered on, dhcpd on the xCAT administration server hands it a temporary address in the range of the discovery network and a genesys system image is loaded. Once the node is booted it does discovery, finds out which node it is, xCAT enters the MAC address in xCAT table mac, updates dhcpd.leases to point to the permanent address of that node. Then the node asks the dhcp server for its permanent address and changes to it. Then in /bin/doxcat it calls getdestiny to know what to do next, it retrieves the xCAT server address on /proc/cmdline, and the address it retrieves there is on the discovery network, but because the node now has an address in the admin network it cannot reach that address unless a gateway is provided. In order to provide the gateway, we entered it in the xCAT table networks on the line of the admin network and reran makedhcp -n. The gateway address being in that case the xCAT management server address in the admin network. So, for bmcsetup to automaticaly follow discovery when the discovery network differs from the admin network you need : * chain to be set to runcmd=bmcsetup,standby * a gateway entry in the xCAT table networks for the admin network line Best regards, Antoine 17 Avenue De Tabary L'europe Certified Bois Colombes HPC I/T Cedex, 92275 Specialist 6520AA France ITS e-mail: [email protected] From: Xiao Peng Wang <[email protected]> To: xCAT Users Mailing list <[email protected]> Cc: xCAT Users Mailing list <[email protected]> Date: 06/09/2012 19:41 Subject: Re: [xcat-user] discovery is not completed. and imm never set What did you set in the chain table? Genesis will try to go through tasks in the chain attribute of the node and run one by one. So need to set the bmcsetup in the chain. chdef <node> chain=runcmd=bmcsetup Thanks Best Regards ---------------------------------------------------------------------- Wang Xiaopeng (王晓朋) IBM China System Technology Laboratory Tel: 86-10-82453455 Email: [email protected] Address: 28,ZhongGuanCun Software Park,No.8 Dong Bei Wang West Road, Haidian District Beijing P.R.China 100193 Inactive hide details for Patrick Jaeger ---2012/08/31 21:51:20---Hello , we would use the automatic discovery of nodes in CluPatrick Jaeger ---2012/08/31 21:51:20---Hello , we would use the automatic discovery of nodes in Cluster 1350 From: Patrick Jaeger <[email protected]> To: xCAT Users Mailing list <[email protected]>, Date: 2012/08/31 21:51 Subject: [xcat-user] discovery is not completed. and imm never set Hello , we would use the automatic discovery of nodes in Cluster 1350 OS : RHEL 6.2 server xcat version : 2.7.3 the node port on the switch is declared in the table switche and is good ... when we Power ON ( with the button ) the node , the discovery process begin ... after a couple of minutes ... the table mac is filled with the Good adress ... the good admin adress is set on the eth0 ( i can ping the node !!!) but the process enter in a loop and the IUP adress of the IMM is never set ... if i ssh the node is it always in GENESYS mode i use a workarround to bypass this problem : on the Xcat Server i run the command : nodeset MY_NODE runcmd=bmcsetup and i reboot the node ( reboot -f on the node for example ) ... after this reboot the imm is set correctly ... WHY the aotomatic process is not completed ? . thanks for your help ... Bonne réception / Bests Regards Patrick 17 Avenue De Jaeger L'europe HPC I/T Bois Colombes Specialist Cedex, 92275 ECIS France 6520AA ITS Phone: +33-1-5875-2455 Mobile: +33-6.7192.2077 e-mail: [email protected] Sauf indication contraire ci-dessus:/ Unless stated otherwise above: Compagnie IBM France Siège Social : 17 avenue de l'Europe, 92275 Bois-Colombes Cedex RCS Nanterre 552 118 465 Forme Sociale : S.A.S. Capital Social : 645.605.931,30 € SIREN/SIRET : 552 118 465 03644 - Code NAF 6202A ------------------------------------------------------------------------------ Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ _______________________________________________ xCAT-user mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/xcat-user ------------------------------------------------------------------------------ Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ _______________________________________________ xCAT-user mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/xcat-user Sauf indication contraire ci-dessus:/ Unless stated otherwise above: Compagnie IBM France Siège Social : 17 avenue de l'Europe, 92275 Bois-Colombes Cedex RCS Nanterre 552 118 465 Forme Sociale : S.A.S. Capital Social : 645.605.931,30 € SIREN/SIRET : 552 118 465 03644 - Code NAF 6202A ------------------------------------------------------------------------------ Got visibility? Most devs has no idea what their production app looks like. Find out how fast your code is with AppDynamics Lite. http://ad.doubleclick.net/clk;262219671;13503038;y? http://info.appdynamics.com/FreeJavaPerformanceDownload.html _______________________________________________ xCAT-user mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/xcat-user
<<inline: graycol.gif>>
<<inline: ecblank.gif>>
<<inline: 3E797162.gif>>
------------------------------------------------------------------------------ Got visibility? Most devs has no idea what their production app looks like. Find out how fast your code is with AppDynamics Lite. http://ad.doubleclick.net/clk;262219671;13503038;y? http://info.appdynamics.com/FreeJavaPerformanceDownload.html
_______________________________________________ xCAT-user mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/xcat-user
