Whoops, I meant to write "Jarrod" not "Jarros". I went a little Koine Greek on your name there. Sorry about that. :-)
On Wed, Jan 22, 2014 at 10:22 AM, Josh Nielsen <jniel...@hudsonalpha.org>wrote: > Jarros, I know you haven't been following the whole thread but Jonathan's > problem (which this discussion originated from) is that somehow his > installation is still using the /tftpboot/pxelinux.cfg/ files despite > being up to date with genesis. I saw a response on the list from you to > someone else about a similar problem in November 2013: > > http://sourceforge.net/mailarchive/message.php?msg_id=31683484 > http://sourceforge.net/mailarchive/message.php?msg_id=31686689 > > Although I am not experiencing the same problem I too would be interested > in the solution. It has always been challenging for me to understand the > xCAT PXE deployment process, which is why I have 5-10 pages of self-written > documentation and debugging info in a Google Doc about it. He posted his > dhcpd.conf > in his latest email. Any thoughts? > > -Josh > > > On Wed, Jan 22, 2014 at 10:11 AM, Jarrod B Johnson <jbjoh...@us.ibm.com>wrote: > >> 1) If running 2.8, go ahead and delete nbroot-core. genesis is far more >> maintainable and easier to muck with on the end point (e.g. having full >> fledged glibc) >> 2) The greatest common denominator remains switch based. It's the only >> frequently instrumented topology cue that is pretty universal. For bladed >> solutions there is potential for the chassis manager to be a good topology >> cue. I am curious what goes awry with switch based discovery. Without a >> topology cue, then the choices are sequential discovery (which I frankly >> haven't used myself) or using/scripting nodediscoverls/nodediscoverdef. I >> personally think the latter is actually better and can be trivially made >> into a 'sequential' discovery using straightforward scripting.. >> >> 3) Tom Alandt is the best person to discuss what can/can't be done by IBM >> mfg. On the other hand, we *could* take some measures to make you >> impervious to the conflict. The 'lsslp --flexdiscover' for its respective >> bits is impervious to IP conflict issues and will automatically fix it. >> It's not a huge stretch to make that pan out for rackmount systems (though >> currently it's hard to pull off without *some* topology cue). >> [image: Inactive hide details for David D Johnson ---01/22/2014 08:11:53 >> AM---I've been lurking on this discussion, and just checked to]David D >> Johnson ---01/22/2014 08:11:53 AM---I've been lurking on this discussion, >> and just checked to see what we've got -- nbroot or genesis -- >> >> From: David D Johnson <david_john...@brown.edu> >> To: xCAT Users Mailing list <xcat-user@lists.sourceforge.net> >> Date: 01/22/2014 08:11 AM >> Subject: Re: [xcat-user] Frustrating time with sequential node discovery >> ------------------------------ >> >> >> >> I've been lurking on this discussion, and just checked to see what we've >> got -- nbroot or genesis -- and we have both of them. >> >> I had given up on node discovery years ago, we originally used the switch >> port numbers and forwarding tables to assign node names. Now I use ASU to >> collect the macs, and populate the mac table with a bit of grep and awk. >> But last week we powered on a rack of 20 non-ibm nodes, and I was wishing >> we had something easier since ASU didn't work for them. >> >> So I have two questions -- >> 1) Can I safely delete the xCAT-nbroot-core* RPMS ? >> 2) What is the current best practice method? What about for non-ibm >> hardware? >> >> No, three questions >> 3) How do you get IBM manufacturing to use a specific different 172.29.X >> for each rack they build for you? >> We've had three racks arrive in different months all with 172.29.101 >> addresses for the IMM, and I have to spend 5-10 minutes reprogramming each >> one. I can't put them on the same network until the conflicts are gone. >> >> What's hard for me is that we get new nodes only a couple times a year, >> and I forget everything in between. >> >> Thanks, >> -- ddj >> >> On Jan 22, 2014, at 7:12 AM, Lissa Valletta >> <*lis...@us.ibm.com*<lis...@us.ibm.com>> >> wrote: >> >> >> xCAT-nbroot-core* was replaced by xCAT-genesis-* in xCAT 2.8. >> >> Lissa K. Valletta >> 8-3/B10 >> Poughkeepsie, NY 12601 >> (tie 293) 433-3102 >> >> >> >> <graycol.gif>Xiao Peng Wang ---01/22/2014 02:58:13 AM---Why do you >> say that you need nbk.x86_64? Is this file listed in the >> </tftpboot/xcat/xnba/nets/>? >> >> From: Xiao Peng Wang <*w...@cn.ibm.com* <w...@cn.ibm.com>> >> To: xCAT Users Mailing list >> <*xcat-user@lists.sourceforge.net*<xcat-user@lists.sourceforge.net>>, >> >> Cc: xCAT Users Mailing list >> <*xcat-user@lists.sourceforge.net*<xcat-user@lists.sourceforge.net> >> > >> Date: 01/22/2014 02:58 AM >> Subject: Re: [xcat-user] Frustrating time with sequential node >> discovery >> >> ------------------------------ >> >> >> >> Why do you say that you need nbk.x86_64? Is this file listed in the >> </tftpboot/xcat/xnba/nets/>? >> >> With the latest xCAT build, it needs >> /tftpboot/xcat/genesis.kernel.x86_64 instead of nbk.* >> >> Thanks >> Best Regards >> ---------------------------------------------------------------------- >> Wang Xiaopeng (王晓朋) >> IBM China System Technology Laboratory >> Tel: 86-10-82453455 >> Email: *w...@cn.ibm.com* <w...@cn.ibm.com> >> Address: 28,ZhongGuanCun Software Park,No.8 Dong Bei Wang West Road, >> Haidian District Beijing P.R.China 100193 >> >> <graycol.gif>Jonathan Mills ---2014/01/22 14:10:32---It would seem to >> me that what I am missing is the whole of the xCAT-nbroot >> infrastructure...because >> >> From: Jonathan Mills <*jonmi...@renci.org* <jonmi...@renci.org>> >> To: xCAT Users Mailing list >> <*xcat-user@lists.sourceforge.net*<xcat-user@lists.sourceforge.net>>, >> >> Date: 2014/01/22 14:10 >> Subject: Re: [xcat-user] Frustrating time with sequential node >> discovery >> ------------------------------ >> >> >> >> It would seem to me that what I am missing is the whole of the >> xCAT-nbroot infrastructure...because it isn't part of xcat-core, nor >> xcat-dep. So I didn't grab it. But it just so happens...you need it. >> >> The file >> >> /tftpboot/xcat/nbk.x86_64 >> >> is provided by the RPM xCAT-nbkernel-x86_64. Which is missing from >> my >> yum repo mirrior, and from my hosts. >> >> >> Anything else I'm missing? Hopefully if I grab correct copies of >> xCAT-nbkernel and xCAT-nbroot (or xCAT-nbroot2?) then node discovery >> will actually work. >> >> On 1/22/14, 12:08 AM, Xiao Peng Wang wrote: >> > Both Josh and Russell are correct. >> > >> > xNBA is a customized pxe and genesis is a xCAT customized diskless >> linux >> > system to run discovery and other tasks like 'bmcsetup'. It does not >> > need the /tftpboot/pxelinux.cfg/.* to load the genesis. >> > >> > For discovery, if a node is not defined in xCAT, the dhcp >> configuration >> > in the /etc/dhcp/dhcpd.conf or /etc/dhcpd.conf is used to reply the >> dhcp >> > request from not-discovered node. >> > >> > In your dhcpd.conf, it should have the following part for your >> > deployment network. If not, run 'makedhcp -n' to recreate your >> dhcpd.conf. >> > if option user-class-identifier = "xNBA" and option >> > client-architecture = 00:00 { #x86, xCAT Network Boot Agent >> > always-broadcast on; >> > filename = " >> >> *http://10.1.0.207/tftpboot/xcat/xnba/nets/10.1.0.0_16*<http://10.1.0.207/tftpboot/xcat/xnba/nets/10.1.0.0_16> >> "; >> > } else if option user-class-identifier = "xNBA" and option >> > client-architecture = 00:09 { #x86, xCAT Network Boot Agent >> > filename = >> > >> "*http://10.1.0.207/tftpboot/xcat/xnba/nets/10.1.0.0_16.uefi*<http://10.1.0.207/tftpboot/xcat/xnba/nets/10.1.0.0_16.uefi> >> "; >> > } else if option client-architecture = 00:00 { #x86 >> > filename "xcat/xnba.kpxe"; >> > } else if option vendor-class-identifier = "Etherboot-5.4" { >> #x86 >> > filename "xcat/xnba.kpxe"; >> > } else if option client-architecture = 00:07 { #x86_64 uefi >> > filename "xcat/xnba.efi"; >> > } else if option client-architecture = 00:09 { #x86_64 uefi >> > alternative id >> > filename "xcat/xnba.efi"; >> > } >> > >> > During the boot process of a not-discovered node, dhcpd will tell >> the >> > node to load xcat/xnba.kpxe first and then the configuration file >> > http://<xcat mn>/tftpboot/xcat/xnba/nets/10.1.0.0_16. Then the xnba >> will >> > load the genesis. >> > >> > Take a look of the syslog to see whether the xnba was downloaded >> > successfully from tftp server. And look into the httpd log to see >> > whether the genesis has been downloaded successfully. >> > >> > >> > Thanks >> > Best Regards >> > >> ---------------------------------------------------------------------- >> > Wang Xiaopeng (王晓朋) >> > IBM China System Technology Laboratory >> > Tel: 86-10-82453455 >> > Email: *w...@cn.ibm.com* <w...@cn.ibm.com> >> > Address: 28,ZhongGuanCun Software Park,No.8 Dong Bei Wang West Road, >> > Haidian District Beijing P.R.China 100193 >> > >> > Inactive hide details for Josh Nielsen ---2014/01/22 05:56:00---Ah, >> I >> > see what you are saying now. Well, I hope the thread I stJosh >> Nielsen >> > ---2014/01/22 05:56:00---Ah, I see what you are saying now. Well, I >> hope >> > the thread I stumbled on that Jarrod replied to help >> > >> > From: Josh Nielsen <*jniel...@hudsonalpha.org*<jniel...@hudsonalpha.org> >> > >> > To: xCAT Users Mailing list >> <*xcat-user@lists.sourceforge.net*<xcat-user@lists.sourceforge.net> >> >, >> > Date: 2014/01/22 05:56 >> > Subject: Re: [xcat-user] Frustrating time with sequential node >> discovery >> > >> > >> ------------------------------------------------------------------------ >> > >> > >> > >> > Ah, I see what you are saying now. Well, I hope the thread I >> stumbled >> > on that Jarrod replied to helps figure out why his configuration is >> > looking to the outdated (according to what Jarrod said) >> configuration >> > files in /tftpboot/pxelinux.cfg/. Looks like it is either >> > /etc/dhcpd.conf or /var/lib/dhcpd/dhcpd.leases related in that case. >> > >> > On Tue, Jan 21, 2014 at 3:51 PM, Russell Jones >> > <*russell-l...@jonesmail.me* <russell-l...@jonesmail.me>> wrote: >> > > It *should* work with xNBA and Genesis - xNBA is the PXE image >> that >> > > loads Genesis. :-) >> > > >> > > Genesis is the utility image that handles shell commands, >> runimages, etc. >> > > >> > > Don't confuse NBFS with xNBA - NBFS is deprecated via Genesis. >> xNBA is >> > > the gpxe image that loads Genesis or your normal OS image >> depending on >> > > what you sent via nodeset. Genesis would not be able to load >> without >> > > xNBA (or standard PXE), and neither would any netboot images. >> > > >> > > On 1/21/2014 3:33 PM, Josh Nielsen wrote: >> > >> my case it still works with >> > >> both xnba and genesis because of the nature of PXE >> chainloading. It >> > >> probably adds deployment time, but it actually works in such a >> mixed >> > >> configuration. >> > >> >> > >> -Josh >> > > >> > > >> > > >> > >> >> ------------------------------------------------------------------------------ >> > > CenturyLink Cloud: The Leader in Enterprise Cloud Services. >> > > Learn Why More Businesses Are Choosing CenturyLink Cloud For >> > > Critical Workloads, Development Environments & Everything In >> Between. >> > > Get a Quote or Start a Free Trial Today. >> > > >> > >> >> *http://pubads.g.doubleclick.net/gampad/clk?id=119420431&iu=/4140/ostg.clktrk*<http://pubads.g.doubleclick.net/gampad/clk?id=119420431&iu=/4140/ostg.clktrk> >> > > _______________________________________________ >> > > xCAT-user mailing list >> > > *xCAT-user@lists.sourceforge.net*<xCAT-user@lists.sourceforge.net> >> > > >> *https://lists.sourceforge.net/lists/listinfo/xcat-user*<https://lists.sourceforge.net/lists/listinfo/xcat-user> >> > >> > >> >> ------------------------------------------------------------------------------ >> > CenturyLink Cloud: The Leader in Enterprise Cloud Services. >> > Learn Why More Businesses Are Choosing CenturyLink Cloud For >> > Critical Workloads, Development Environments & Everything In >> Between. >> > Get a Quote or Start a Free Trial Today. >> > >> >> *http://pubads.g.doubleclick.net/gampad/clk?id=119420431&iu=/4140/ostg.clktrk*<http://pubads.g.doubleclick.net/gampad/clk?id=119420431&iu=/4140/ostg.clktrk> >> > _______________________________________________ >> > xCAT-user mailing list >> > *xCAT-user@lists.sourceforge.net* <xCAT-user@lists.sourceforge.net> >> > >> *https://lists.sourceforge.net/lists/listinfo/xcat-user*<https://lists.sourceforge.net/lists/listinfo/xcat-user> >> > >> > >> >> -- >> Jonathan Mills >> Systems Administrator >> Renaissance Computing Institute >> UNC-Chapel Hill >> >> >> >> ------------------------------------------------------------------------------ >> CenturyLink Cloud: The Leader in Enterprise Cloud Services. >> Learn Why More Businesses Are Choosing CenturyLink Cloud For >> Critical Workloads, Development Environments & Everything In Between. >> Get a Quote or Start a Free Trial Today. >> >> >> *http://pubads.g.doubleclick.net/gampad/clk?id=119420431&iu=/4140/ostg.clktrk*<http://pubads.g.doubleclick.net/gampad/clk?id=119420431&iu=/4140/ostg.clktrk> >> _______________________________________________ >> xCAT-user mailing list >> *xCAT-user@lists.sourceforge.net* <xCAT-user@lists.sourceforge.net> >> *https://lists.sourceforge.net/lists/listinfo/xcat-user*<https://lists.sourceforge.net/lists/listinfo/xcat-user> >> >> >> ------------------------------------------------------------------------------ >> CenturyLink Cloud: The Leader in Enterprise Cloud Services. >> Learn Why More Businesses Are Choosing CenturyLink Cloud For >> Critical Workloads, Development Environments & Everything In Between. >> Get a Quote or Start a Free Trial Today. >> >> >> *http://pubads.g.doubleclick.net/gampad/clk?id=119420431&iu=/4140/ostg.clktrk*<http://pubads.g.doubleclick.net/gampad/clk?id=119420431&iu=/4140/ostg.clktrk> >> _______________________________________________ >> xCAT-user mailing list >> *xCAT-user@lists.sourceforge.net* <xCAT-user@lists.sourceforge.net> >> *https://lists.sourceforge.net/lists/listinfo/xcat-user*<https://lists.sourceforge.net/lists/listinfo/xcat-user> >> >> >> >> ------------------------------------------------------------------------------ >> CenturyLink Cloud: The Leader in Enterprise Cloud Services. >> Learn Why More Businesses Are Choosing CenturyLink Cloud For >> Critical Workloads, Development Environments & Everything In Between. >> Get a Quote or Start a Free Trial Today. >> >> >> *http://pubads.g.doubleclick.net/gampad/clk?id=119420431&iu=/4140/ostg.clktrk_______________________________________________*<http://pubads.g.doubleclick.net/gampad/clk?id=119420431&iu=/4140/ostg.clktrk_______________________________________________> >> xCAT-user mailing list >> xCAT-user@lists.sourceforge.net >> https://lists.sourceforge.net/lists/listinfo/xcat-user >> >> >> >> ------------------------------------------------------------------------------ >> CenturyLink Cloud: The Leader in Enterprise Cloud Services. >> Learn Why More Businesses Are Choosing CenturyLink Cloud For >> Critical Workloads, Development Environments & Everything In Between. >> Get a Quote or Start a Free Trial Today. >> >> http://pubads.g.doubleclick.net/gampad/clk?id=119420431&iu=/4140/ostg.clktrk >> _______________________________________________ >> xCAT-user mailing list >> xCAT-user@lists.sourceforge.net >> https://lists.sourceforge.net/lists/listinfo/xcat-user >> >> >> >> ------------------------------------------------------------------------------ >> CenturyLink Cloud: The Leader in Enterprise Cloud Services. >> Learn Why More Businesses Are Choosing CenturyLink Cloud For >> Critical Workloads, Development Environments & Everything In Between. >> Get a Quote or Start a Free Trial Today. >> >> http://pubads.g.doubleclick.net/gampad/clk?id=119420431&iu=/4140/ostg.clktrk >> _______________________________________________ >> xCAT-user mailing list >> xCAT-user@lists.sourceforge.net >> https://lists.sourceforge.net/lists/listinfo/xcat-user >> >> >
<<graycol.gif>>
------------------------------------------------------------------------------ CenturyLink Cloud: The Leader in Enterprise Cloud Services. Learn Why More Businesses Are Choosing CenturyLink Cloud For Critical Workloads, Development Environments & Everything In Between. Get a Quote or Start a Free Trial Today. http://pubads.g.doubleclick.net/gampad/clk?id=119420431&iu=/4140/ostg.clktrk
_______________________________________________ xCAT-user mailing list xCAT-user@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/xcat-user
