Hi Lissa, The Management Node is indeed RHEL but I need to make the Service Nodes Centos like the compute nodes. RHEL has a pay-for licensing scheme and I can't just deploy new instances of it without paying Redhat for new licenses. Why does the OS version matter (other than some possible limitation between SN and MN interoperability - which I'm willing to risk just to try it)?
>Also why do you have the servicenode.nameserver attribute set to 2 only 0, 1, yes or no are valid? Wow, that's a good catch. The service node documentation links to an HTML version of the node man page which must be out-of-date because it says: "setupnameserver (servicenode.nameserver) Do we set up DNS on this service node? Valid values: 2, 1, no or 0. If 2, creates named.conf as dns slave, using the management node as dns master, and starts named. If 1, creates named.conf file with forwarding to the management node and starts named. If no or 0, it does not change the current state of the service." A "man node" on my MN shows only 0 and 1 as valid options though. I need to set it up a slave DNS server so that the SN can serve up DNS without the MN (temporarily of course - for maintenance, outages, etc.). Since the options apparently are now only 0 and 1 will 1 set up a slave DNS configuration? Why was the older 3-option method removed? Thanks, Josh On Wed, Jan 15, 2014 at 6:06 AM, Lissa Valletta <[email protected]> wrote: > hyphen is fine. > your servicenode provmethod should be rhels5.3-x86_64-install-service > Then when you run nodeset it should be > nodeset xcat-serv1 osimage= rhels5.3-x86_64-install-service > > Try that and see if you get anything. If not then check the following: > Since you upgraded want to make sure xcatd stoped and started cleanly. > > Run rpm -qa | grep xCAT check rpms are correct > > Could you service xcatd stop > ps -ef | grep xcatd make sure all xcatd processes are gone then > service xcatd start > > If you still have the same problem try this to see if we are getting any > hidden errors > > export XCATBYPASS=1 > nodeset xcat-serv1 osimage= rhels5.3-x86_64-install-service > > > Also why do you have the servicenode.nameserver attribute set to 2 only > 0, 1, yes or no are valid? > > Verify your configuration with the following doc: > https://sourceforge.net/apps/mediawiki/xcat/index.php?title=XCAT_iDataPlex_Cluster_Quick_Start > > > > > > Lissa K. Valletta > 8-3/B10 > Poughkeepsie, NY 12601 > (tie 293) 433-3102 > > > > [image: Inactive hide details for Josh Nielsen ---01/14/2014 05:27:47 > PM---> Then the thing turns to you need make sure the nodeset has]Josh > Nielsen ---01/14/2014 05:27:47 PM---> Then the thing turns to you need make > sure the nodeset has been run correctly on your management n > > From: Josh Nielsen <[email protected]> > To: xCAT Users Mailing list <[email protected]>, > Date: 01/14/2014 05:27 PM > Subject: Re: [xcat-user] Node discovery for VMs in VMWare > ------------------------------ > > > > > Then the thing turns to you need make sure the nodeset has been run > correctly on your management node. Did you see the message like this? > > <node name> : netboot sles11.2-x86_64-compute > > Actually, no, nodeset didn't return anything. I tried "nodeset xcat-serv1 > install". The hyphen in the node name isn't problematic is it? After the > upgrade to 2.8.3 the warning about the SN daemons not being up is gone now > (which is good), but nothing is returned to the console when I do a nodeset > (it completes silently). I don't think it is working, and I didn't see an > entry created for it in /tftpboot/xcat/xnba/nodes/. > > Here are the entries in my tables: > > * tabdump nodelist:* > ... > "xcat-serv2","service,ipmi,all",,,,,,,,,, > "xcat-serv1","service,ipmi,all",,,,,,,,,, > > *tabdump servicenode:* > > #node,nameserver,dhcpserver,tftpserver,nfsserver,conserver,monserver,ldapserver,ntpserver,ftpserver,nimserver,ipforward,dhcpinterfaces,comments,disable > "service","2","1","1","1","1",,,"1",,,,,, > > *lsdef service:* > > Object name: xcat-serv1 > arch=x86_64 > groups=service,ipmi,all > installnic=mac > ip=172.20.3.1 > mac=00:50:56:bc:0c:db > netboot=xnba > nfsserver=10.X.X.X > nodetype=osi > os=centos6.4 > > postscripts=syslog,remoteshell,ospkgs,addsiteyum,otherpkgs,syncfiles,ifcfg-eth,fstab,servicenode > primarynic=mac > profile=service > provmethod=centos6.4-x86_64-install-compute > setupconserver=1 > setupdhcp=1 > setupnameserver=2 > setupnfs=1 > setupntp=1 > setuptftp=1 > tftpserver=10.X.X.X > xcatmaster=10.X.X.X > Object name: xcat-serv2 > arch=x86_64 > groups=service,ipmi,all > installnic=mac > ip=172.20.3.2 > netboot=xnba > nfsserver=10.X.X.X > nodetype=osi > os=centos6.4 > > postscripts=syslog,remoteshell,ospkgs,addsiteyum,otherpkgs,syncfiles,ifcfg-eth,fstab,servicenode > primarynic=mac > profile=service > provmethod=centos6.4-x86_64-install-compute > setupconserver=1 > setupdhcp=1 > setupnameserver=2 > setupnfs=1 > setupntp=1 > setuptftp=1 > tftpserver=10.X.X.X > xcatmaster=10.X.X.X > > And the OS images: > > *lsdef -t osimage:* > .... > centos6.4-x86_64-install-all (osimage) > centos6.4-x86_64-install-compute (osimage) > centos6.4-x86_64-install-iscsi (osimage) > centos6.4-x86_64-install-kvm (osimage) > centos6.4-x86_64-install-login (osimage) > centos6.4-x86_64-install-storage (osimage) > centos6.4-x86_64-install-xen (osimage) > centos6.4-x86_64-netboot-compute (osimage) > centos6.4-x86_64-netboot-kvm (osimage) > centos6.4-x86_64-netboot-xen (osimage) > centos6.4-x86_64-statelite-compute (osimage) > centos6.4-x86_64-statelite-kvm (osimage) > centos6.4-x86_64-statelite-xen (osimage) > rhels5.3-x86_64-install-compute (osimage) > rhels5.3-x86_64-install-iscsi (osimage) > rhels5.3-x86_64-install-kvm (osimage) > rhels5.3-x86_64-install-service (osimage) > rhels5.3-x86_64-install-storage (osimage) > rhels5.3-x86_64-install-xen (osimage) > > Any idea what might be going wrong? > > Thanks, > Josh > > On Mon, Jan 13, 2014 at 7:12 PM, Xiao Peng Wang > <*[email protected]*<[email protected]>> > wrote: > > Regarding the dispatching xCAT command request to service node, in > certain case (e.g. create dhcpd configuration) the request will be sent to > all the service nodes in the xCAT database (which is configured in > servicenode table) so that every service nodes can handle the dhcp request > for load balance. > > In your current situation, you don't need service node to handle your > target nodes (they are service node), xCAT MN will cover them. So you can > ignore this error message anyway. > > Then the thing turns to you need make sure the nodeset has been run > correctly on your management node. Did you see the message like this? > > <node name> : netboot sles11.2-x86_64-compute > > > Thanks > Best Regards > ---------------------------------------------------------------------- > Wang Xiaopeng (王晓朋) > IBM China System Technology Laboratory > Tel: 86-10-82453455 > Email: *[email protected]* <[email protected]> > Address: 28,ZhongGuanCun Software Park,No.8 Dong Bei Wang West Road, > Haidian District Beijing P.R.China 100193 > > [image: Inactive hide details for Josh Nielsen ---2014/01/14 > 07:39:35---Thank you, that information is very useful. I just realized > tha]Josh > Nielsen ---2014/01/14 07:39:35---Thank you, that information is very > useful. I just realized that I have an older version of xCAT (2. > > From: Josh Nielsen <*[email protected]*<[email protected]> > > > To: xCAT Users Mailing list > <*[email protected]*<[email protected]>>, > > Date: 2014/01/14 07:39 > Subject: Re: [xcat-user] Node discovery for VMs in VMWare > ------------------------------ > > > > Thank you, that information is very useful. I just realized that I > have an older version of xCAT (2.7.3) and need to upgrade to get those > commands for node discovery. I will do that soon. > > Also when I did a 'nodeset' on one of the service nodes I saw an > error, as if xcat were already trying to delegate commands to service nodes > that aren't even provisioned yet. I'm pretty sure it would do this > regardless of what node I tried to nodeset. What I can't tell is whether > the command was successful or not, despite the errors saying that it can't > reach the service node daemons. Here is what I got: > > [root@x3650-head01 ~]# nodeset xcat-serv1 > Error: Unable to dispatch hierarchical sub-command to xcat-serv1:3001. > This service node may be down or its xcatd daemon may not be responding. > Error: Unable to dispatch hierarchical sub-command to xcat-serv2:3001. > This service node may be down or its xcatd daemon may not be responding. > > That is very odd since this presents a chicken-and-egg problem if the > nodeset is not working (the nodes can't be required to be present before > they are provisioned). I followed the xCAT guide to fully define the > service nodes in the xCAT tables first, but it appears something in the > tables is making xCAT think that the service nodes are/should be up > already. Can I ignore this or is nodeset not going to work until I fix this > somehow? Maybe this will be fixed by upgrading xCAT though. > > -Josh > > > > > On Sun, Jan 12, 2014 at 8:29 PM, Xiao Peng Wang > <*[email protected]*<[email protected]>> > wrote: > You saw the discovery message was because of the node configuration > was not finished yet. After running 'nodeset' and start the node > deployment, the discovery message won't show again. > > Regarding the discovery, you can use 'sequential discovery' to > discover virtual node. Refer to: > > *https://sourceforge.net/apps/mediawiki/xcat/index.php?title=XCAT_iDataPlex_Cluster_Quick_Start#Option_1:_Sequential_Discovery*<https://sourceforge.net/apps/mediawiki/xcat/index.php?title=XCAT_iDataPlex_Cluster_Quick_Start#Option_1:_Sequential_Discovery> > Another easy manual method is: > > You can check the undiscovered node by command: 'nodediscoverls > -t all' (Any nodes which is sending discovery request will be > recorded in > discoverydata table and can be dispalyed by nodediscoverls command). > And > run 'nodediscoverdef' to define the undiscovered node to a node > definition > in xCAT db. > See examples: > # nodediscoverls -t all > UUID NODE > METHOD MTM SERIAL > 643CC79B-B7BD-224F-8105-9AEF8329E195 undef undef > 9AA99E16 > > # nodediscoverls -t all -l > Object uuid: 643CC79B-B7BD-224F-8105-9AEF8329E195 > method=undef > discoverytime=01-13-2014 01:14:28 > arch=x86_64 > cpucount=2 > cputype=Intel Core 2 Duo P9xxx (Penryn Class Core 2) > memory=3770188 > serial=9AA99E16-BAAA-11E1-B9E3-3440B5E0E828_34:40:B5:E0:E8:28 > nicdriver=eth0!e1000 > nicipv4=eth0!*10.1.100.114/16* <http://10.1.100.114/16> > nichwaddr=eth0!00:1A:4A:01:00:5D > nicpci=eth0!0000:00:03.0 > > Thanks > Best Regards > > ---------------------------------------------------------------------- > Wang Xiaopeng (王晓朋) > IBM China System Technology Laboratory > Tel: 86-10-82453455 > Email: *[email protected]* <[email protected]> > Address: 28,ZhongGuanCun Software Park,No.8 Dong Bei Wang West > Road, Haidian District Beijing P.R.China 100193 > > [image: Inactive hide details for Josh Nielsen ---2014/01/11 > 08:09:31---I tried the manual insertion of the MAC address and I was > able]Josh > Nielsen ---2014/01/11 08:09:31---I tried the manual insertion of the MAC > address and I was able to get a DHCP lease for the VM (IP 10 > > From: Josh Nielsen <*[email protected]*<[email protected]> > > > To: xCAT Users Mailing list > <*[email protected]*<[email protected]>>, > > Date: 2014/01/11 08:09 > Subject: Re: [xcat-user] Node discovery for VMs in VMWare > ------------------------------ > > > > I tried the manual insertion of the MAC address and I was able to > get a DHCP lease for the VM (IP 10.20.240.254) but for some reason it > just > kept saying it was processing the discovery request like this over and > over > again: > > Jan 10 17:45:11 x3650-head01 xCAT: xcatd: Processing discovery > request from 10.20.240.254 > Jan 10 23:45:14 10.20.240.254 (none) dhclient[310]: XMT: Solicit on > eth0, interval 125010ms. > Jan 10 17:45:16 x3650-head01 xCAT: xcatd: Processing discovery > request from 10.20.240.254 > Jan 10 23:45:17 10.20.240.254 (none) dhclient[321]: XMT: Solicit on > eth1, interval 112560ms. > Jan 10 17:45:21 x3650-head01 xCAT: xcatd: Processing discovery > request from 10.20.240.254 > Jan 10 17:45:36 x3650-head01 last message repeated 3 times > > I'll have to debug this more after the weekend. > > -Josh > > > > On Fri, Jan 10, 2014 at 3:22 PM, Josh Nielsen < > *[email protected]* <[email protected]>> wrote: > Hello all, > > I would like to provision some new nodes in my xCAT cluster > inside VMWare but I just realized that the way xCAT has identified > and > discovered my nodes in the past has been by dedicated physical port > numbers > on the switches as defined in the xCAT switch database table. That > is not a > problem for physical nodes which have a single cable going into a > port on a > switch dedicated only to that node. > > For example one of my nodes has this entry in the switch table: > > #node,switch,port,vlan,interface,comments,disable > "hinode","bnt01","44","1","eth0","bnt01:p44" > > This tells xCAT that the node found connected to port 44 on > switch bnt01 can be identified as node "hinode". With a VMWare > cluster > however a VM may reside on many ports (in my case I have 3 ESX > servers - > and 3 corresponding cables to the switch - which the VM may be on) > at any > given time, depending on which VMWare host it is running on. And on > top of > that the network connection is trunked so that every VM running on > each ESX > host goes through the same network port. > > Has anyone provisioned nodes in VMWare before with xCAT? And if > there is not a way to do this automatically by the switch/port > associations, is there another manual way that I can discover the > node? > Would manually inserting the node's MAC address into the xCAT 'mac' > table > work, or is more than that required for (auto)discovery? > > Thanks, > Josh Nielsen > > > ------------------------------------------------------------------------------ > CenturyLink Cloud: The Leader in Enterprise Cloud Services. > Learn Why More Businesses Are Choosing CenturyLink Cloud For > Critical Workloads, Development Environments & Everything In > Between. > Get a Quote or Start a Free Trial Today. > > > *http://pubads.g.doubleclick.net/gampad/clk?id=119420431&iu=/4140/ostg.clktrk*<http://pubads.g.doubleclick.net/gampad/clk?id=119420431&iu=/4140/ostg.clktrk> > _______________________________________________ > xCAT-user mailing list > *[email protected]* <[email protected]> > *https://lists.sourceforge.net/lists/listinfo/xcat-user*<https://lists.sourceforge.net/lists/listinfo/xcat-user> > > > > > ------------------------------------------------------------------------------ > CenturyLink Cloud: The Leader in Enterprise Cloud Services. > Learn Why More Businesses Are Choosing CenturyLink Cloud For > Critical Workloads, Development Environments & Everything In > Between. > Get a Quote or Start a Free Trial Today. > > > *http://pubads.g.doubleclick.net/gampad/clk?id=119420431&iu=/4140/ostg.clktrk*<http://pubads.g.doubleclick.net/gampad/clk?id=119420431&iu=/4140/ostg.clktrk> > _______________________________________________ > xCAT-user mailing list > *[email protected]* <[email protected]> > *https://lists.sourceforge.net/lists/listinfo/xcat-user*<https://lists.sourceforge.net/lists/listinfo/xcat-user> > > > ------------------------------------------------------------------------------ > CenturyLink Cloud: The Leader in Enterprise Cloud Services. > Learn Why More Businesses Are Choosing CenturyLink Cloud For > Critical Workloads, Development Environments & Everything In Between. > Get a Quote or Start a Free Trial Today. > > > *http://pubads.g.doubleclick.net/gampad/clk?id=119420431&iu=/4140/ostg.clktrk*<http://pubads.g.doubleclick.net/gampad/clk?id=119420431&iu=/4140/ostg.clktrk> > _______________________________________________ > xCAT-user mailing list > *[email protected]* <[email protected]> > *https://lists.sourceforge.net/lists/listinfo/xcat-user*<https://lists.sourceforge.net/lists/listinfo/xcat-user> > > > > > ------------------------------------------------------------------------------ > CenturyLink Cloud: The Leader in Enterprise Cloud Services. > Learn Why More Businesses Are Choosing CenturyLink Cloud For > Critical Workloads, Development Environments & Everything In Between. > Get a Quote or Start a Free Trial Today. > > > *http://pubads.g.doubleclick.net/gampad/clk?id=119420431&iu=/4140/ostg.clktrk*<http://pubads.g.doubleclick.net/gampad/clk?id=119420431&iu=/4140/ostg.clktrk> > _______________________________________________ > xCAT-user mailing list > *[email protected]* <[email protected]> > *https://lists.sourceforge.net/lists/listinfo/xcat-user*<https://lists.sourceforge.net/lists/listinfo/xcat-user> > > > ------------------------------------------------------------------------------ > CenturyLink Cloud: The Leader in Enterprise Cloud Services. > Learn Why More Businesses Are Choosing CenturyLink Cloud For > Critical Workloads, Development Environments & Everything In Between. > Get a Quote or Start a Free Trial Today. > > http://pubads.g.doubleclick.net/gampad/clk?id=119420431&iu=/4140/ostg.clktrk > _______________________________________________ > xCAT-user mailing list > [email protected] > https://lists.sourceforge.net/lists/listinfo/xcat-user > > > > ------------------------------------------------------------------------------ > CenturyLink Cloud: The Leader in Enterprise Cloud Services. > Learn Why More Businesses Are Choosing CenturyLink Cloud For > Critical Workloads, Development Environments & Everything In Between. > Get a Quote or Start a Free Trial Today. > > http://pubads.g.doubleclick.net/gampad/clk?id=119420431&iu=/4140/ostg.clktrk > _______________________________________________ > xCAT-user mailing list > [email protected] > https://lists.sourceforge.net/lists/listinfo/xcat-user > >
<<graycol.gif>>
------------------------------------------------------------------------------ CenturyLink Cloud: The Leader in Enterprise Cloud Services. Learn Why More Businesses Are Choosing CenturyLink Cloud For Critical Workloads, Development Environments & Everything In Between. Get a Quote or Start a Free Trial Today. http://pubads.g.doubleclick.net/gampad/clk?id=119420431&iu=/4140/ostg.clktrk
_______________________________________________ xCAT-user mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/xcat-user
