Answering your Item 3: For IBM nodes we use the following to determine the address for the IMM 172.29.1xx.y xx = rack number (rack A1, node 1 = 172.29.101.1 which follows the node ip we would assign 172.20.101.1 y=node number in the rack, with the first node being in the lower U location, if rack is two wide then it would be lower left side going up then lower right side going up
Since your racks came at different timesthey were seen as different orders
and we will always start at the first rack and go contiguous from there.
We assign the bmc to a group, for example 84bmcperrack (see hosts tab)
#node,ip,hostnames,otherinterfaces,comments,disable
"84bmcperrack","|\D+(\d+).*$|172.29.(101+(($1-1)/84)).(($1-1)%84+1)|",,,,
"idataplex-bmc","|\D+(\d+).*$|172.29.(101+(($1-1)/84)).(($1-1)%84+1)|",,,,
"40bmcperrack","|\D+(\d+).*$|172.29.(101+(($1-1)/40)).(($1-1)%40+1)|",,,,
"41bmcperrack","|\D+(\d+).*$|172.29.(101+(($1-1)/41)).(($1-1)%41+1)|",,,,
"42bmcperrack","|\D+(\d+).*$|172.29.(101+(($1-1)/42)).(($1-1)%42+1)|",,,,
"20bmcperrack","|\D+(\d+).*$|172.29.(101+(($1-1)/20)).(($1-1)%20+1)|",,,,
"21bmcperrack","|\D+(\d+).*$|172.29.(101+(($1-1)/21)).(($1-1)%21+1)|",,,,
You can set up your scheme when you bring up the cluster and this will all
get done during the discovery/bmcsetup.
Regards,
Tom
Thomas Alandt
WW Test Engineer Complex Solutions
IBM-ISC
Phone:919-543-7581 (t/l 441-7581
From: David D Johnson <david_john...@brown.edu>
To: xCAT Users Mailing list <xcat-user@lists.sourceforge.net>,
Date: 01/22/2014 08:11 AM
Subject: Re: [xcat-user] Frustrating time with sequential node discovery
I've been lurking on this discussion, and just checked to see what we've
got -- nbroot or genesis -- and we have both of them.
I had given up on node discovery years ago, we originally used the switch
port numbers and forwarding tables to assign node names. Now I use ASU to
collect the macs, and populate the mac table with a bit of grep and awk.
But last week we powered on a rack of 20 non-ibm nodes, and I was wishing
we had something easier since ASU didn't work for them.
So I have two questions --
1) Can I safely delete the xCAT-nbroot-core* RPMS ?
2) What is the current best practice method? What about for non-ibm
hardware?
No, three questions
3) How do you get IBM manufacturing to use a specific different 172.29.X
for each rack they build for you?
We've had three racks arrive in different months all with 172.29.101
addresses for the IMM, and I have to spend 5-10 minutes reprogramming each
one. I can't put them on the same network until the conflicts are gone.
What's hard for me is that we get new nodes only a couple times a year, and
I forget everything in between.
Thanks,
-- ddj
On Jan 22, 2014, at 7:12 AM, Lissa Valletta <lis...@us.ibm.com> wrote:
xCAT-nbroot-core* was replaced by xCAT-genesis-* in xCAT 2.8.
Lissa K. Valletta
8-3/B10
Poughkeepsie, NY 12601
(tie 293) 433-3102
<graycol.gif>Xiao Peng Wang ---01/22/2014 02:58:13 AM---Why do you
say that you need nbk.x86_64? Is this file listed in the
</tftpboot/xcat/xnba/nets/>?
From: Xiao Peng Wang <w...@cn.ibm.com>
To: xCAT Users Mailing list <xcat-user@lists.sourceforge.net>,
Cc: xCAT Users Mailing list <xcat-user@lists.sourceforge.net>
Date: 01/22/2014 02:58 AM
Subject: Re: [xcat-user] Frustrating time with sequential node
discovery
Why do you say that you need nbk.x86_64? Is this file listed in the
</tftpboot/xcat/xnba/nets/>?
With the latest xCAT build, it
needs /tftpboot/xcat/genesis.kernel.x86_64 instead of nbk.*
Thanks
Best Regards
----------------------------------------------------------------------
Wang Xiaopeng (王晓朋)
IBM China System Technology Laboratory
Tel: 86-10-82453455
Email: w...@cn.ibm.com
Address: 28,ZhongGuanCun Software Park,No.8 Dong Bei Wang West Road,
Haidian District Beijing P.R.China 100193
<graycol.gif>Jonathan Mills ---2014/01/22 14:10:32---It would seem to
me that what I am missing is the whole of the xCAT-nbroot
infrastructure...because
From: Jonathan Mills <jonmi...@renci.org>
To: xCAT Users Mailing list <xcat-user@lists.sourceforge.net>,
Date: 2014/01/22 14:10
Subject: Re: [xcat-user] Frustrating time with sequential node
discovery
It would seem to me that what I am missing is the whole of the
xCAT-nbroot infrastructure...because it isn't part of xcat-core, nor
xcat-dep. So I didn't grab it. But it just so happens...you need
it.
The file
/tftpboot/xcat/nbk.x86_64
is provided by the RPM xCAT-nbkernel-x86_64. Which is missing from
my
yum repo mirrior, and from my hosts.
Anything else I'm missing? Hopefully if I grab correct copies of
xCAT-nbkernel and xCAT-nbroot (or xCAT-nbroot2?) then node discovery
will actually work.
On 1/22/14, 12:08 AM, Xiao Peng Wang wrote:
> Both Josh and Russell are correct.
>
> xNBA is a customized pxe and genesis is a xCAT customized diskless
linux
> system to run discovery and other tasks like 'bmcsetup'. It does
not
> need the /tftpboot/pxelinux.cfg/.* to load the genesis.
>
> For discovery, if a node is not defined in xCAT, the dhcp
configuration
> in the /etc/dhcp/dhcpd.conf or /etc/dhcpd.conf is used to reply the
dhcp
> request from not-discovered node.
>
> In your dhcpd.conf, it should have the following part for your
> deployment network. If not, run 'makedhcp -n' to recreate your
dhcpd.conf.
> if option user-class-identifier = "xNBA" and option
> client-architecture = 00:00 { #x86, xCAT Network Boot Agent
> always-broadcast on;
> filename = "
http://10.1.0.207/tftpboot/xcat/xnba/nets/10.1.0.0_16";;
> } else if option user-class-identifier = "xNBA" and option
> client-architecture = 00:09 { #x86, xCAT Network Boot Agent
> filename =
> "http://10.1.0.207/tftpboot/xcat/xnba/nets/10.1.0.0_16.uefi";;
> } else if option client-architecture = 00:00 { #x86
> filename "xcat/xnba.kpxe";
> } else if option vendor-class-identifier =
"Etherboot-5.4" { #x86
> filename "xcat/xnba.kpxe";
> } else if option client-architecture = 00:07 { #x86_64 uefi
> filename "xcat/xnba.efi";
> } else if option client-architecture = 00:09 { #x86_64 uefi
> alternative id
> filename "xcat/xnba.efi";
> }
>
> During the boot process of a not-discovered node, dhcpd will tell
the
> node to load xcat/xnba.kpxe first and then the configuration file
> http://<xcat mn>/tftpboot/xcat/xnba/nets/10.1.0.0_16. Then the xnba
will
> load the genesis.
>
> Take a look of the syslog to see whether the xnba was downloaded
> successfully from tftp server. And look into the httpd log to see
> whether the genesis has been downloaded successfully.
>
>
> Thanks
> Best Regards
>
----------------------------------------------------------------------
> Wang Xiaopeng (王晓朋)
> IBM China System Technology Laboratory
> Tel: 86-10-82453455
> Email: w...@cn.ibm.com
> Address: 28,ZhongGuanCun Software Park,No.8 Dong Bei Wang West
Road,
> Haidian District Beijing P.R.China 100193
>
> Inactive hide details for Josh Nielsen ---2014/01/22 05:56:00---Ah,
I
> see what you are saying now. Well, I hope the thread I stJosh
Nielsen
> ---2014/01/22 05:56:00---Ah, I see what you are saying now. Well, I
hope
> the thread I stumbled on that Jarrod replied to help
>
> From: Josh Nielsen <jniel...@hudsonalpha.org>
> To: xCAT Users Mailing list <xcat-user@lists.sourceforge.net>,
> Date: 2014/01/22 05:56
> Subject: Re: [xcat-user] Frustrating time with sequential node
discovery
>
>
------------------------------------------------------------------------
>
>
>
> Ah, I see what you are saying now. Well, I hope the thread I
stumbled
> on that Jarrod replied to helps figure out why his configuration is
> looking to the outdated (according to what Jarrod said)
configuration
> files in /tftpboot/pxelinux.cfg/. Looks like it is either
> /etc/dhcpd.conf or /var/lib/dhcpd/dhcpd.leases related in that
case.
>
> On Tue, Jan 21, 2014 at 3:51 PM, Russell Jones
> <russell-l...@jonesmail.me> wrote:
> > It *should* work with xNBA and Genesis - xNBA is the PXE image
that
> > loads Genesis. :-)
> >
> > Genesis is the utility image that handles shell commands,
runimages, etc.
> >
> > Don't confuse NBFS with xNBA - NBFS is deprecated via Genesis.
xNBA is
> > the gpxe image that loads Genesis or your normal OS image
depending on
> > what you sent via nodeset. Genesis would not be able to load
without
> > xNBA (or standard PXE), and neither would any netboot images.
> >
> > On 1/21/2014 3:33 PM, Josh Nielsen wrote:
> >> my case it still works with
> >> both xnba and genesis because of the nature of PXE
chainloading. It
> >> probably adds deployment time, but it actually works in such a
mixed
> >> configuration.
> >>
> >> -Josh
> >
> >
> >
>
------------------------------------------------------------------------------
> > CenturyLink Cloud: The Leader in Enterprise Cloud Services.
> > Learn Why More Businesses Are Choosing CenturyLink Cloud For
> > Critical Workloads, Development Environments & Everything In
Between.
> > Get a Quote or Start a Free Trial Today.
> >
>
http://pubads.g.doubleclick.net/gampad/clk?id=119420431&iu=/4140/ostg.clktrk
> > _______________________________________________
> > xCAT-user mailing list
> > xCAT-user@lists.sourceforge.net
> > https://lists.sourceforge.net/lists/listinfo/xcat-user
>
>
------------------------------------------------------------------------------
> CenturyLink Cloud: The Leader in Enterprise Cloud Services.
> Learn Why More Businesses Are Choosing CenturyLink Cloud For
> Critical Workloads, Development Environments & Everything In
Between.
> Get a Quote or Start a Free Trial Today.
>
http://pubads.g.doubleclick.net/gampad/clk?id=119420431&iu=/4140/ostg.clktrk
> _______________________________________________
> xCAT-user mailing list
> xCAT-user@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/xcat-user
>
>
--
Jonathan Mills
Systems Administrator
Renaissance Computing Institute
UNC-Chapel Hill
------------------------------------------------------------------------------
CenturyLink Cloud: The Leader in Enterprise Cloud Services.
Learn Why More Businesses Are Choosing CenturyLink Cloud For
Critical Workloads, Development Environments & Everything In Between.
Get a Quote or Start a Free Trial Today.
http://pubads.g.doubleclick.net/gampad/clk?id=119420431&iu=/4140/ostg.clktrk
_______________________________________________
xCAT-user mailing list
xCAT-user@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/xcat-user
------------------------------------------------------------------------------
CenturyLink Cloud: The Leader in Enterprise Cloud Services.
Learn Why More Businesses Are Choosing CenturyLink Cloud For
Critical Workloads, Development Environments & Everything In Between.
Get a Quote or Start a Free Trial Today.
http://pubads.g.doubleclick.net/gampad/clk?id=119420431&iu=/4140/ostg.clktrk
_______________________________________________
xCAT-user mailing list
xCAT-user@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/xcat-user
------------------------------------------------------------------------------
CenturyLink Cloud: The Leader in Enterprise Cloud Services.
Learn Why More Businesses Are Choosing CenturyLink Cloud For
Critical Workloads, Development Environments & Everything In Between.
Get a Quote or Start a Free Trial Today.
http://pubads.g.doubleclick.net/gampad/clk?id=119420431&iu=/4140/ostg.clktrk_______________________________________________
xCAT-user mailing list
xCAT-user@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/xcat-user
------------------------------------------------------------------------------
CenturyLink Cloud: The Leader in Enterprise Cloud Services.
Learn Why More Businesses Are Choosing CenturyLink Cloud For
Critical Workloads, Development Environments & Everything In Between.
Get a Quote or Start a Free Trial Today.
http://pubads.g.doubleclick.net/gampad/clk?id=119420431&iu=/4140/ostg.clktrk
_______________________________________________
xCAT-user mailing list
xCAT-user@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/xcat-user
<<inline: graycol.gif>>
------------------------------------------------------------------------------ CenturyLink Cloud: The Leader in Enterprise Cloud Services. Learn Why More Businesses Are Choosing CenturyLink Cloud For Critical Workloads, Development Environments & Everything In Between. Get a Quote or Start a Free Trial Today. http://pubads.g.doubleclick.net/gampad/clk?id=119420431&iu=/4140/ostg.clktrk
_______________________________________________ xCAT-user mailing list xCAT-user@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/xcat-user
