Re: [xcat-user] Policy table question
Here is an example of a policy table in a hierarchical cluster. You do not have to add anything to the defaults configured by xCAT for it to work. #priority,name,host,commands,noderange,parameters,time,rule,comments,disable 1,root,,allow,, 1.2,manage-02,,trusted,, 2,,,getbmcconfigallow,, 2.3,,,lsxcatdallow,, 3,,,nextdestinyallow,, 4,,,getdestinyallow,, 4.4,,,getpostscriptallow,, 4.5,,,getcredentialsallow,, 4.6,,,syncfilesallow,, 4.7,,,litefileallow,, 4.8,,,litetreeallow,, 2.1,,,remoteimmsetupallow,, Lissa K. Valletta 8-3/B10 Poughkeepsie, NY 12601 (tie 293) 433-3102 From: Lissa Valletta/Poughkeepsie/IBM@IBMUS To: xCAT Users Mailing list xcat-user@lists.sourceforge.net, Cc: xCAT Users Mailing list xcat-user@lists.sourceforge.net Date: 01/13/2014 08:19 AM Subject:Re: [xcat-user] Policy table question Make sure the credential on the service node and manage node has master.local in it all so look on the service node at the file /etc/xcat/cert/server-cred.pem for the line Subject: CN=manage-02make sure it says master.local. I should be the same as /etc/xcat/cert/server-cred.pem on the management node. If it is not run updatenode servicenode -K to update the credentials on the service nodes from the MN. Another problem could be the domain does not match what is in site.domain. What database are you running. Make sure you service node is configured correctly . Run lsxcatd -a on the Service Node and check that it is picking up the policy table from the database on the Managment Node. Monitoring the commands in syslog on the management node as Xiao Peng suggests you should see the error from xcatd why the command is rejected. Also take these out, there is no need to add the service nodes. 5.1,,master.local,allow,, 6.1,root,master.local,allow,, 6.2,root,servicefarm01,allow,, 6.3,root,servicefarm02,allow,, 6.4,root,servicefarm03,allow,, You should only need the following: 1,root,,allow,, 1.2,master.local,,trusted,, Lissa K. Valletta 8-3/B10 Poughkeepsie, NY 12601 (tie 293) 433-3102 Inactive hide details for Xiao Peng Wang ---01/12/2014 08:54:14 PM---What I can think of is the user/certificates/permission thXiao Peng Wang ---01/12/2014 08:54:14 PM---What I can think of is the user/certificates/permission things are not correct on your service node. From: Xiao Peng Wang w...@cn.ibm.com To: xCAT Users Mailing list xcat-user@lists.sourceforge.net, Cc: xCAT Users Mailing list xcat-user@lists.sourceforge.net Date: 01/12/2014 08:54 PM Subject: Re: [xcat-user] Policy table question What I can think of is the user/certificates/permission things are not correct on your service node. Try to run 'rpower' or 'lsdef' on service node directly and check the syslog to see the xCAT log like this 'xCAT: Allowing lsdef for root from xxx' to get the current user. Thanks Best Regards -- Wang Xiaopeng (王晓朋) IBM China System Technology Laboratory Tel: 86-10-82453455 Email: w...@cn.ibm.com Address: 28,ZhongGuanCun Software Park,No.8 Dong Bei Wang West Road, Haidian District Beijing P.R.China 100193 Inactive hide details for Russell Jones ---2014/01/11 04:34:56---Hi all, What are the default policy attributes service nodes sRussell Jones ---2014/01/11 04:34:56---Hi all, What are the default policy attributes service nodes should have in the From: Russell Jones russell-l...@jonesmail.me To: xCAT Users Mailing list xcat-user@lists.sourceforge.net, Date: 2014/01/11 04:34 Subject: [xcat-user] Policy table question Hi all, What are the default policy attributes service nodes should have in the policy table for xCAT 2.8+? Unless I specifically add, for example, rpower to the below list, I get a permission denied when a compute node is configured to a service node. If the compute node is not configured to use a service node, it works fine. This doesn't seem right given that I have granted the root user full access. Any ideas what's going on? Table is below. Thanks! #priority,name,host,commands,noderange,parameters,time,rule,comments,disable 1,root,,allow,, 1.2,master.local,,trusted,, 2,,,getbmcconfigallow,, 2.1,,,remoteimmsetupallow,, 2.3,,,lsxcatdallow,, 3,,,nextdestinyallow,, 4,,,getdestinyallow,, 4.1,,,rpowerallow,, 4.2,,,makedhcpallow,, 4.3,,,nodesetallow,, 4.4,,,getpostscriptallow,, 4.5,,,getcredentialsallow,, 4.6,,,syncfilesallow,, 4.7,,,litefileallow,, 4.8,,,litetreeallow,, 5.1,,master.local,allow,, 6.1,root,master.local,allow,, 6.2,root,servicefarm01,allow,, 6.3,root,servicefarm02,allow,, 6.4,root,servicefarm03,allow,, -- CenturyLink Cloud: The Leader in Enterprise Cloud Services. Learn Why More Businesses Are Choosing CenturyLink Cloud For Critical Workloads,
Re: [xcat-user] bmc attribute confusion
You need to provide the mgt attribute also as indicated by the error message. Sure you can tabedit and get around it but that is not satisfying the xcat database setup requirement. You need to tell us the method used for hardware control, in this case ipmi. Use this document as a reference: https://sourceforge.net/apps/mediawiki/xcat/index.php?title=XCAT_iDataPlex_Cluster_Quick_Start Lissa K. Valletta 8-3/B10 Poughkeepsie, NY 12601 (tie 293) 433-3102 From: Russell Jones russell-l...@jonesmail.me To: xCAT Users Mailing list xcat-user@lists.sourceforge.net, Date: 01/10/2014 03:08 PM Subject:[xcat-user] bmc attribute confusion Hi all, When configuring a node to utilize a java console via wvid, and ipmi for power, things get a little screwy: [root@master xCAT_plugin]# chdef c01n69 bmc=c01n69-bmc Cannot set the 'bmc' attribute unless a value is provided for 'mgt'. mgt = The method to use to do general hardware management of the node. This attribute is used as the default if power or getmac is not set. Valid values: ipmi, blade, hmc, ivm, fsp, bpa. See the power attribute for more details. Error: Cannot set the attr='bmc' attribute unless 'mgt=ipmi'. 1 object definitions have been created or modified. An lsdef of the node shows the bmc attribute empty. I have to manually edit the ipmi table to add the bmc address for the node so that rpower works. lsdef still shows it blank, but at least at that point rpower is able to communicate with the node's BMC. Why is xCAT requiring mgt to be set for the BMC attribute, and all I am trying to do is utilize rpower for remote power control? -- CenturyLink Cloud: The Leader in Enterprise Cloud Services. Learn Why More Businesses Are Choosing CenturyLink Cloud For Critical Workloads, Development Environments Everything In Between. Get a Quote or Start a Free Trial Today. http://pubads.g.doubleclick.net/gampad/clk?id=119420431iu=/4140/ostg.clktrk ___ xCAT-user mailing list xCAT-user@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/xcat-user inline: graycol.gif-- CenturyLink Cloud: The Leader in Enterprise Cloud Services. Learn Why More Businesses Are Choosing CenturyLink Cloud For Critical Workloads, Development Environments Everything In Between. Get a Quote or Start a Free Trial Today. http://pubads.g.doubleclick.net/gampad/clk?id=119420431iu=/4140/ostg.clktrk___ xCAT-user mailing list xCAT-user@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/xcat-user
Re: [xcat-user] Policy table question
Thanks, it's working better now. Redeploying the service nodes under the updated 2.8.3 seems to have fixed the issues where your default policy list you've provided seems to be sufficient. On 1/13/2014 9:38 AM, Lissa Valletta wrote: Here is an example of a policy table in a hierarchical cluster. You do not have to add anything to the defaults configured by xCAT for it to work. #priority,name,host,commands,noderange,parameters,time,rule,comments,disable "1","root",,"allow",, "1.2","manage-02",,"trusted",, "2",,,"getbmcconfig""allow",, "2.3",,,"lsxcatd""allow",, "3",,,"nextdestiny""allow",, "4",,,"getdestiny""allow",, "4.4",,,"getpostscript""allow",, "4.5",,,"getcredentials""allow",, "4.6",,,"syncfiles""allow",, "4.7",,,"litefile""allow",, "4.8",,,"litetree""allow",, "2.1",,,"remoteimmsetup""allow",, Lissa K. Valletta 8-3/B10 Poughkeepsie, NY 12601 (tie 293) 433-3102 Lissa Valletta---01/13/2014 08:19:02 AM---Make sure the credential on the service node and manage node has master.local in it all so look From: Lissa Valletta/Poughkeepsie/IBM@IBMUS To: xCAT Users Mailing list xcat-user@lists.sourceforge.net, Cc: xCAT Users Mailing list xcat-user@lists.sourceforge.net Date: 01/13/2014 08:19 AM Subject: Re: [xcat-user] Policy table question Make sure the credential on the service node and manage node has master.local in it all so look on the service node at the file /etc/xcat/cert/server-cred.pem for the line Subject: CN=manage-02 make sure it says master.local. I should be the same as /etc/xcat/cert/server-cred.pem on the management node. If it is not run updatenode servicenode -K to update the credentials on the service nodes from the MN. Another problem could be the domain does not match what is in site.domain. What database are you running. Make sure you service node is configured correctly . Run lsxcatd -a on the Service Node and check that it is picking up the policy table from the database on the Managment Node. Monitoring the commands in syslog on the management node as Xiao Peng suggests you should see the error from xcatd why the command is rejected. Also take these out, there is no need to add the service nodes. "5.1",,"master.local","allow",, "6.1","root","master.local","allow",, "6.2","root","servicefarm01","allow",, "6.3","root","servicefarm02","allow",, "6.4","root","servicefarm03","allow",, You should only need the following: "1","root",,"allow",, "1.2","master.local",,"trusted",, Lissa K. Valletta 8-3/B10 Poughkeepsie, NY 12601 (tie 293) 433-3102 Xiao Peng Wang ---01/12/2014 08:54:14 PM---What I can think of is the user/certificates/permission things are not correct on your service node. From: Xiao Peng Wang w...@cn.ibm.com To: xCAT Users Mailing list xcat-user@lists.sourceforge.net, Cc: xCAT Users Mailing list xcat-user@lists.sourceforge.net Date: 01/12/2014 08:54 PM Subject: Re: [xcat-user] Policy table question What I can think of is the user/certificates/permission things are not correct on your service node. Try to run 'rpower' or 'lsdef' on service node directly and check the syslog to see the xCAT log like this 'xCAT: Allowing lsdef for root from xxx' to get the current user. Thanks Best Regards -- Wang Xiaopeng () IBM China System Technology Laboratory Tel: 86-10-82453455 Email: w...@cn.ibm.com Address: 28,ZhongGuanCun Software Park,No.8 Dong Bei Wang West Road, Haidian District Beijing P.R.China 100193 Russell Jones ---2014/01/11 04:34:56---Hi all, What are the default policy attributes service nodes should have in the From: Russell Jones russell-l...@jonesmail.me To: xCAT Users Mailing list xcat-user@lists.sourceforge.net, Date: 2014/01/11 04:34 Subject: [xcat-user] Policy table question Hi all,
Re: [xcat-user] bmc attribute confusion
Also just for more info, this is a Dell SC1435 node that has an upgraded iDRAC that uses a java console, while power is controlled via standard IPMI. So, we need to be able to do nodehm.power=ipmi, and nodehm.mgt=iKVM. Then under /opt/xcat/lib/perl/xCAT_plugin, we have a custom iKVM.pm module that gets called when wvid is ran. On 1/13/2014 1:35 PM, Russell Jones wrote: Thanks! I was under the impression mgt attribute was just a "catch-all" for if you didn't want to have to manually set both nodehm.power and nodehm.cons. We have custom perl modules that are utilizing nodehm.mgt for storing data for launching custom java consoles when wvid is called. So that I am better aware of what the downsides are to this, what is nodehm.mgt used for that nodehm.power and nodehm.cons is not? On 1/13/2014 10:07 AM, Lissa Valletta wrote: You need to provide the mgt attribute also as indicated by the error message. Sure you can tabedit and get around it but that is not satisfying the xcat database setup requirement. You need to tell us the method used for hardware control, in this case ipmi. Use this document as a reference: https://sourceforge.net/apps/mediawiki/xcat/index.php?title=XCAT_iDataPlex_Cluster_Quick_Start Lissa K. Valletta 8-3/B10 Poughkeepsie, NY 12601 (tie 293) 433-3102 Russell Jones ---01/10/2014 03:08:33 PM---Hi all, When configuring a node to utilize a java console via wvid, and ipmi for From: Russell Jones russell-l...@jonesmail.me To: xCAT Users Mailing list xcat-user@lists.sourceforge.net, Date: 01/10/2014 03:08 PM Subject: [xcat-user] bmc attribute confusion Hi all, When configuring a node to utilize a java console via wvid, and ipmi for power, things get a little screwy: [root@master xCAT_plugin]# chdef c01n69 bmc=c01n69-bmc Cannot set the 'bmc' attribute unless a value is provided for 'mgt'. mgt = The method to use to do general hardware management of the node. This attribute is used as the default if power or getmac is not set. Valid values: ipmi, blade, hmc, ivm, fsp, bpa. See the power attribute for more details. Error: Cannot set the attr='bmc' attribute unless 'mgt=ipmi'. 1 object definitions have been created or modified. An lsdef of the node shows the bmc attribute empty. I have to manually edit the ipmi table to add the bmc address for the node so that rpower works. "lsdef" still shows it blank, but at least at that point rpower is able to communicate with the node's BMC. Why is xCAT requiring mgt to be set for the BMC attribute, and all I am trying to do is utilize rpower for remote power control?-- CenturyLink Cloud: The Leader in Enterprise Cloud Services. Learn Why More Businesses Are Choosing CenturyLink Cloud For Critical Workloads, Development Environments Everything In Between. Get a Quote or Start a Free Trial Today. http://pubads.g.doubleclick.net/gampad/clk?id=119420431iu=/4140/ostg.clktrk___ xCAT-user mailing list xCAT-user@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/xcat-user -- CenturyLink Cloud: The Leader in Enterprise Cloud Services. Learn Why More Businesses Are Choosing CenturyLink Cloud For Critical Workloads, Development Environments Everything In Between. Get a Quote or Start a Free Trial Today. http://pubads.g.doubleclick.net/gampad/clk?id=119420431iu=/4140/ostg.clktrk ___ xCAT-user mailing list xCAT-user@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/xcat-user -- CenturyLink Cloud: The Leader in Enterprise Cloud Services. Learn Why More Businesses Are Choosing CenturyLink Cloud For Critical Workloads, Development Environments Everything In Between. Get a Quote or Start a
Re: [xcat-user] bmc attribute confusion
If you look at handle commands in the plugins and find nodehm:mgt, you can
see how it drives the selection of which plugin will run for various
commands. So if nodehm.mgt is ipmi for the node, then the ipmi.pm plugin
will be called for rinv below. This is a pretty complex area.I asked
some our our developers if there is a way to do what I think you want to
do . You want to add a plugin to run some commands and yet still use the
ipmi plugin for others.
ipmi.pm:
sub handled_commands {
return {
rpower = 'nodehm:power,mgt', #done
renergy = 'nodehm:power,mgt',
getipmicons = 'ipmi', #done
rspconfig = 'nodehm:mgt', #done
rspreset = 'nodehm:mgt', #done
rvitals = 'nodehm:mgt', #done
rinv = 'nodehm:mgt', #done
rflash = 'nodehm:mgt', #done
rsetboot = 'nodehm:mgt', #done
rbeacon = 'nodehm:mgt', #done
reventlog = 'nodehm:mgt',
Lissa K. Valletta
8-3/B10
Poughkeepsie, NY 12601
(tie 293) 433-3102
From: Russell Jones russell-l...@jonesmail.me
To: xcat-user@lists.sourceforge.net,
Date: 01/13/2014 02:39 PM
Subject:Re: [xcat-user] bmc attribute confusion
Also just for more info, this is a Dell SC1435 node that has an upgraded
iDRAC that uses a java console, while power is controlled via standard
IPMI. So, we need to be able to do nodehm.power=ipmi, and nodehm.mgt=iKVM.
Then under /opt/xcat/lib/perl/xCAT_plugin, we have a custom iKVM.pm module
that gets called when wvid is ran.
On 1/13/2014 1:35 PM, Russell Jones wrote:
Thanks!
I was under the impression mgt attribute was just a catch-all for
if you didn't want to have to manually set both nodehm.power and
nodehm.cons.
We have custom perl modules that are utilizing nodehm.mgt for storing
data for launching custom java consoles when wvid is called. So that
I am better aware of what the downsides are to this, what is
nodehm.mgt used for that nodehm.power and nodehm.cons is not?
On 1/13/2014 10:07 AM, Lissa Valletta wrote:
You need to provide the mgt attribute also as indicated by the
error message. Sure you can tabedit and get around it but that
is not satisfying the xcat database setup requirement. You
need to tell us the method used for hardware control, in this
case ipmi.
Use this document as a reference:
https://sourceforge.net/apps/mediawiki/xcat/index.php?title=XCAT_iDataPlex_Cluster_Quick_Start
Lissa K. Valletta
8-3/B10
Poughkeepsie, NY 12601
(tie 293) 433-3102
Inactive hide details for Russell Jones ---01/10/2014
03:08:33 PM---Hi all, When configuring a node to utilize a
java console vRussell Jones ---01/10/2014 03:08:33 PM---Hi all,
When configuring a node to utilize a java console via wvid, and
ipmi for
From: Russell Jones russell-l...@jonesmail.me
To: xCAT Users Mailing list xcat-user@lists.sourceforge.net,
Date: 01/10/2014 03:08 PM
Subject: [xcat-user] bmc attribute confusion
Hi all,
When configuring a node to utilize a java console via wvid, and
ipmi for power, things get a little screwy:
[root@master xCAT_plugin]# chdef c01n69 bmc=c01n69-bmc
Cannot set the 'bmc' attribute unless a value is provided
for 'mgt'.
mgt = The method to use to do general hardware
management of the node. This attribute is used as the
default if power or getmac is not set. Valid values:
ipmi, blade, hmc, ivm, fsp, bpa. See the power attribute
for more details.
Error: Cannot set the attr='bmc' attribute unless
'mgt=ipmi'.
1 object definitions have been created or modified.
An lsdef of the node shows the bmc attribute empty. I have to
manually edit the ipmi table to add the bmc address for the
node so that rpower works. lsdef still shows it blank, but at
least at that point rpower is able to communicate with the
node's BMC.
Why is xCAT requiring mgt to be set for the BMC attribute, and
all I am trying to do is utilize rpower for remote power
control?
--
CenturyLink Cloud: The Leader in Enterprise Cloud Services.
Learn Why More Businesses Are Choosing CenturyLink Cloud For
Critical Workloads, Development Environments Everything In
Between.
Get a Quote or Start a Free Trial Today.
http://pubads.g.doubleclick.net/gampad/clk?id=119420431iu=/4140/ostg.clktrk
Re: [xcat-user] bmc attribute confusion
Correct. This is a normal old Dell box, so rinv and the like isn't really necessary for these nodes. I believe we might be able to utilize nodehm.cons to put our iKVM string in, set ipmi for nodehm.mgt and nodehm.power, and then go off of the nodehm.cons column if it won't negatively affect other major functions. Thoughts? On 1/13/2014 2:02 PM, Lissa Valletta wrote: I asked some our our developers if there is a way to do what I think you want to do . You want to add a plugin to run some commands and yet still use the ipmi plugin for others. -- CenturyLink Cloud: The Leader in Enterprise Cloud Services. Learn Why More Businesses Are Choosing CenturyLink Cloud For Critical Workloads, Development Environments Everything In Between. Get a Quote or Start a Free Trial Today. http://pubads.g.doubleclick.net/gampad/clk?id=119420431iu=/4140/ostg.clktrk___ xCAT-user mailing list xCAT-user@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/xcat-user
Re: [xcat-user] Node discovery for VMs in VMWare
Thank you, that information is very useful. I just realized that I have an older version of xCAT (2.7.3) and need to upgrade to get those commands for node discovery. I will do that soon. Also when I did a 'nodeset' on one of the service nodes I saw an error, as if xcat were already trying to delegate commands to service nodes that aren't even provisioned yet. I'm pretty sure it would do this regardless of what node I tried to nodeset. What I can't tell is whether the command was successful or not, despite the errors saying that it can't reach the service node daemons. Here is what I got: [root@x3650-head01 ~]# nodeset xcat-serv1 Error: Unable to dispatch hierarchical sub-command to xcat-serv1:3001. This service node may be down or its xcatd daemon may not be responding. Error: Unable to dispatch hierarchical sub-command to xcat-serv2:3001. This service node may be down or its xcatd daemon may not be responding. That is very odd since this presents a chicken-and-egg problem if the nodeset is not working (the nodes can't be required to be present before they are provisioned). I followed the xCAT guide to fully define the service nodes in the xCAT tables first, but it appears something in the tables is making xCAT think that the service nodes are/should be up already. Can I ignore this or is nodeset not going to work until I fix this somehow? Maybe this will be fixed by upgrading xCAT though. -Josh On Sun, Jan 12, 2014 at 8:29 PM, Xiao Peng Wang w...@cn.ibm.com wrote: You saw the discovery message was because of the node configuration was not finished yet. After running 'nodeset' and start the node deployment, the discovery message won't show again. Regarding the discovery, you can use 'sequential discovery' to discover virtual node. Refer to: https://sourceforge.net/apps/mediawiki/xcat/index.php?title=XCAT_iDataPlex_Cluster_Quick_Start#Option_1:_Sequential_Discovery Another easy manual method is: You can check the undiscovered node by command: 'nodediscoverls -t all' (Any nodes which is sending discovery request will be recorded in discoverydata table and can be dispalyed by nodediscoverls command). And run 'nodediscoverdef' to define the undiscovered node to a node definition in xCAT db. See examples: # nodediscoverls -t all UUIDNODEMETHOD MTM SERIAL 643CC79B-B7BD-224F-8105-9AEF8329E195undef undef 9AA99E16 # nodediscoverls -t all -l Object uuid: 643CC79B-B7BD-224F-8105-9AEF8329E195 method=undef discoverytime=01-13-2014 01:14:28 arch=x86_64 cpucount=2 cputype=Intel Core 2 Duo P9xxx (Penryn Class Core 2) memory=3770188 serial=9AA99E16-BAAA-11E1-B9E3-3440B5E0E828_34:40:B5:E0:E8:28 nicdriver=eth0!e1000 nicipv4=eth0!10.1.100.114/16 nichwaddr=eth0!00:1A:4A:01:00:5D nicpci=eth0!:00:03.0 Thanks Best Regards -- Wang Xiaopeng (王晓朋) IBM China System Technology Laboratory Tel: 86-10-82453455 Email: w...@cn.ibm.com Address: 28,ZhongGuanCun Software Park,No.8 Dong Bei Wang West Road, Haidian District Beijing P.R.China 100193 [image: Inactive hide details for Josh Nielsen ---2014/01/11 08:09:31---I tried the manual insertion of the MAC address and I was able]Josh Nielsen ---2014/01/11 08:09:31---I tried the manual insertion of the MAC address and I was able to get a DHCP lease for the VM (IP 10 From: Josh Nielsen jniel...@hudsonalpha.org To: xCAT Users Mailing list xcat-user@lists.sourceforge.net, Date: 2014/01/11 08:09 Subject: Re: [xcat-user] Node discovery for VMs in VMWare -- I tried the manual insertion of the MAC address and I was able to get a DHCP lease for the VM (IP 10.20.240.254) but for some reason it just kept saying it was processing the discovery request like this over and over again: Jan 10 17:45:11 x3650-head01 xCAT: xcatd: Processing discovery request from 10.20.240.254 Jan 10 23:45:14 10.20.240.254 (none) dhclient[310]: XMT: Solicit on eth0, interval 125010ms. Jan 10 17:45:16 x3650-head01 xCAT: xcatd: Processing discovery request from 10.20.240.254 Jan 10 23:45:17 10.20.240.254 (none) dhclient[321]: XMT: Solicit on eth1, interval 112560ms. Jan 10 17:45:21 x3650-head01 xCAT: xcatd: Processing discovery request from 10.20.240.254 Jan 10 17:45:36 x3650-head01 last message repeated 3 times I'll have to debug this more after the weekend. -Josh On Fri, Jan 10, 2014 at 3:22 PM, Josh Nielsen *jniel...@hudsonalpha.org*jniel...@hudsonalpha.org wrote: Hello all, I would like to provision some new nodes in my xCAT cluster inside VMWare but I just realized that the way xCAT has identified and discovered my nodes in the past has been by dedicated physical port numbers on the switches as defined in the xCAT switch database table. That is not a
Re: [xcat-user] bmc attribute confusion
Looks good. BTW, what functionalities have been implemented in your iKVM.pm, only stuff for cons support? Thanks Best Regards -- Wang Xiaopeng (王晓朋) IBM China System Technology Laboratory Tel: 86-10-82453455 Email: w...@cn.ibm.com Address: 28,ZhongGuanCun Software Park,No.8 Dong Bei Wang West Road, Haidian District Beijing P.R.China 100193 From: Russell Jones russell-l...@jonesmail.me To: xcat-user@lists.sourceforge.net, Date: 2014/01/14 04:08 Subject:Re: [xcat-user] bmc attribute confusion Correct. This is a normal old Dell box, so rinv and the like isn't really necessary for these nodes. I believe we might be able to utilize nodehm.cons to put our iKVM string in, set ipmi for nodehm.mgt and nodehm.power, and then go off of the nodehm.cons column if it won't negatively affect other major functions. Thoughts? On 1/13/2014 2:02 PM, Lissa Valletta wrote: I asked some our our developers if there is a way to do what I think you want to do . You want to add a plugin to run some commands and yet still use the ipmi plugin for others. -- CenturyLink Cloud: The Leader in Enterprise Cloud Services. Learn Why More Businesses Are Choosing CenturyLink Cloud For Critical Workloads, Development Environments Everything In Between. Get a Quote or Start a Free Trial Today. http://pubads.g.doubleclick.net/gampad/clk?id=119420431iu=/4140/ostg.clktrk ___ xCAT-user mailing list xCAT-user@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/xcat-user inline: graycol.gif-- CenturyLink Cloud: The Leader in Enterprise Cloud Services. Learn Why More Businesses Are Choosing CenturyLink Cloud For Critical Workloads, Development Environments Everything In Between. Get a Quote or Start a Free Trial Today. http://pubads.g.doubleclick.net/gampad/clk?id=119420431iu=/4140/ostg.clktrk___ xCAT-user mailing list xCAT-user@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/xcat-user
Re: [xcat-user] Node discovery for VMs in VMWare
Regarding the dispatching xCAT command request to service node, in certain case (e.g. create dhcpd configuration) the request will be sent to all the service nodes in the xCAT database (which is configured in servicenode table) so that every service nodes can handle the dhcp request for load balance. In your current situation, you don't need service node to handle your target nodes (they are service node), xCAT MN will cover them. So you can ignore this error message anyway. Then the thing turns to you need make sure the nodeset has been run correctly on your management node. Did you see the message like this? node name : netboot sles11.2-x86_64-compute Thanks Best Regards -- Wang Xiaopeng (王晓朋) IBM China System Technology Laboratory Tel: 86-10-82453455 Email: w...@cn.ibm.com Address: 28,ZhongGuanCun Software Park,No.8 Dong Bei Wang West Road, Haidian District Beijing P.R.China 100193 From: Josh Nielsen jniel...@hudsonalpha.org To: xCAT Users Mailing list xcat-user@lists.sourceforge.net, Date: 2014/01/14 07:39 Subject:Re: [xcat-user] Node discovery for VMs in VMWare Thank you, that information is very useful. I just realized that I have an older version of xCAT (2.7.3) and need to upgrade to get those commands for node discovery. I will do that soon. Also when I did a 'nodeset' on one of the service nodes I saw an error, as if xcat were already trying to delegate commands to service nodes that aren't even provisioned yet. I'm pretty sure it would do this regardless of what node I tried to nodeset. What I can't tell is whether the command was successful or not, despite the errors saying that it can't reach the service node daemons. Here is what I got: [root@x3650-head01 ~]# nodeset xcat-serv1 Error: Unable to dispatch hierarchical sub-command to xcat-serv1:3001. This service node may be down or its xcatd daemon may not be responding. Error: Unable to dispatch hierarchical sub-command to xcat-serv2:3001. This service node may be down or its xcatd daemon may not be responding. That is very odd since this presents a chicken-and-egg problem if the nodeset is not working (the nodes can't be required to be present before they are provisioned). I followed the xCAT guide to fully define the service nodes in the xCAT tables first, but it appears something in the tables is making xCAT think that the service nodes are/should be up already. Can I ignore this or is nodeset not going to work until I fix this somehow? Maybe this will be fixed by upgrading xCAT though. -Josh On Sun, Jan 12, 2014 at 8:29 PM, Xiao Peng Wang w...@cn.ibm.com wrote: You saw the discovery message was because of the node configuration was not finished yet. After running 'nodeset' and start the node deployment, the discovery message won't show again. Regarding the discovery, you can use 'sequential discovery' to discover virtual node. Refer to: https://sourceforge.net/apps/mediawiki/xcat/index.php?title=XCAT_iDataPlex_Cluster_Quick_Start#Option_1:_Sequential_Discovery Another easy manual method is: You can check the undiscovered node by command: 'nodediscoverls -t all' (Any nodes which is sending discovery request will be recorded in discoverydata table and can be dispalyed by nodediscoverls command). And run 'nodediscoverdef' to define the undiscovered node to a node definition in xCAT db. See examples: # nodediscoverls -t all UUID NODE METHOD MTM SERIAL 643CC79B-B7BD-224F-8105-9AEF8329E195 undef undef 9AA99E16 # nodediscoverls -t all -l Object uuid: 643CC79B-B7BD-224F-8105-9AEF8329E195 method=undef discoverytime=01-13-2014 01:14:28 arch=x86_64 cpucount=2 cputype=Intel Core 2 Duo P9xxx (Penryn Class Core 2) memory=3770188 serial=9AA99E16-BAAA-11E1-B9E3-3440B5E0E828_34:40:B5:E0:E8:28 nicdriver=eth0!e1000 nicipv4=eth0!10.1.100.114/16 nichwaddr=eth0!00:1A:4A:01:00:5D nicpci=eth0!:00:03.0 Thanks Best Regards -- Wang Xiaopeng (王晓朋) IBM China System Technology Laboratory Tel: 86-10-82453455 Email: w...@cn.ibm.com Address: 28,ZhongGuanCun Software Park,No.8 Dong Bei Wang West Road, Haidian District Beijing P.R.China 100193 Inactive hide details for Josh Nielsen ---2014/01/11 08:09:31---I tried the manual insertion of the MAC address and I was able Josh Nielsen ---2014/01/11 08:09:31---I tried the manual insertion of the MAC address and I was able to get a DHCP lease for the VM (IP 10 From: Josh Nielsen jniel...@hudsonalpha.org To: xCAT Users Mailing list xcat-user@lists.sourceforge.net, Date: 2014/01/11 08:09 Subject: Re: [xcat-user] Node discovery for VMs in VMWare I tried the manual insertion of the MAC address and
Re: [xcat-user] bmc attribute confusion
Did you implemented function getrvidparms in your iKVM for getting the parameters of console? If yes, could you try to change the name of it to make it different with getrvidparms? Thanks Best Regards -- Wang Xiaopeng (王晓朋) IBM China System Technology Laboratory Tel: 86-10-82453455 Email: w...@cn.ibm.com Address: 28,ZhongGuanCun Software Park,No.8 Dong Bei Wang West Road, Haidian District Beijing P.R.China 100193 From: Russell Jones russell-l...@jonesmail.me To: xcat-user@lists.sourceforge.net, Date: 2014/01/14 09:13 Subject:Re: [xcat-user] bmc attribute confusion Unfortunately after testing this does not work real well - it results in the ipmi.pm module saying Remote video is not supported, and then our iKVM.pm module actually launching and working. Perhaps this needs to be a feature request so that when nodehm.cons is set, ipmi.pm does not attempt to do any video support? Also yes, this is only stuff for supporting remote video on Dell iDRACs that utilize java consoles. On 1/13/2014 6:17 PM, Xiao Peng Wang wrote: Looks good. BTW, what functionalities have been implemented in your iKVM.pm, only stuff for cons support? Thanks Best Regards -- Wang Xiaopeng (王晓朋) IBM China System Technology Laboratory Tel: 86-10-82453455 Email: w...@cn.ibm.com Address: 28,ZhongGuanCun Software Park,No.8 Dong Bei Wang West Road, Haidian District Beijing P.R.China 100193 Inactive hide details for Russell Jones ---2014/01/14 04:08:11---Correct. This is a normal old Dell box, so rinv and the like iRussell Jones ---2014/01/14 04:08:11---Correct. This is a normal old Dell box, so rinv and the like isn't really necessary for these nodes From: Russell Jones russell-l...@jonesmail.me To: xcat-user@lists.sourceforge.net, Date: 2014/01/14 04:08 Subject: Re: [xcat-user] bmc attribute confusion Correct. This is a normal old Dell box, so rinv and the like isn't really necessary for these nodes. I believe we might be able to utilize nodehm.cons to put our iKVM string in, set ipmi for nodehm.mgt and nodehm.power, and then go off of the nodehm.cons column if it won't negatively affect other major functions. Thoughts? On 1/13/2014 2:02 PM, Lissa Valletta wrote: I asked some our our developers if there is a way to do what I think you want to do . You want to add a plugin to run some commands and yet still use the ipmi plugin for others. -- CenturyLink Cloud: The Leader in Enterprise Cloud Services. Learn Why More Businesses Are Choosing CenturyLink Cloud For Critical Workloads, Development Environments Everything In Between. Get a Quote or Start a Free Trial Today. http://pubads.g.doubleclick.net/gampad/clk?id=119420431iu=/4140/ostg.clktrk ___ xCAT-user mailing list xCAT-user@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/xcat-user -- CenturyLink Cloud: The Leader in Enterprise Cloud Services. Learn Why More Businesses Are Choosing CenturyLink Cloud For Critical Workloads, Development Environments Everything In Between. Get a Quote or Start a Free Trial Today. http://pubads.g.doubleclick.net/gampad/clk?id=119420431iu=/4140/ostg.clktrk ___ xCAT-user mailing list xCAT-user@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/xcat-user -- CenturyLink Cloud: The Leader in Enterprise Cloud Services. Learn Why More Businesses Are Choosing CenturyLink Cloud For Critical Workloads, Development Environments Everything In Between. Get a Quote or Start a Free Trial Today. http://pubads.g.doubleclick.net/gampad/clk?id=119420431iu=/4140/ostg.clktrk ___ xCAT-user mailing list xCAT-user@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/xcat-user inline: graycol.gif-- CenturyLink Cloud: The Leader in Enterprise Cloud Services. Learn Why More Businesses Are Choosing CenturyLink Cloud For Critical Workloads, Development Environments Everything In Between. Get a Quote or Start a Free Trial Today. http://pubads.g.doubleclick.net/gampad/clk?id=119420431iu=/4140/ostg.clktrk___ xCAT-user mailing list
[xcat-user] Don't see addition of bootparams.addkcmdline to /boot/grub/grub.conf
I'm trying to disable acpi_pad.disable=1 in the kernel tabch node=cswarm bootparams.addkcmdline=acpi_pad.disable=1 nodeset d8civy106 install [root@opt-mgmt rh]# lsdef d8civy106 Object name: d8civy106 addkcmdline=acpi_pad.disable=1 arch=x86_64 bmc=d8civy106-bmc bmcpassword=Ddofs811 bmcusername=USERID currchain=boot currstate=boot groups=ndcompute,cswarm,condor,sgecondor,rack59,ipmi,crc_passwd,all initrd=xcat/rhels6.4/x86_64/compute/initrd.img installnic=eth0 kcmdline=quiet repo=http://10.32.64.2:80/install/rhels6.4/x86_64 ks=http://10.32.64.2:80/install/autoinst/d8civy106 ksdevice=eth0 cmdline console=tty0 console=ttyS0,115200n8r kernel=xcat/rhels6.4/x86_64/compute/vmlinuz mac=6c:ae:8b:08:97:c3 mgt=ipmi monserver=10.32.64.2 netboot=xnba nfsdir=/install nfsserver=10.32.64.2 os=rhels6.4 postbootscripts=otherpkgs postscripts=syslog,remoteshell,addsiteyum,ndcompute power=ipmi primarynic=eth0 profile=compute provmethod=install serialflow=hard serialport=0 serialspeed=115200 servicenode=10.32.64.2 status=booted statustime=01-13-2014 21:03:01 tftpserver=10.32.64.2 xcatmaster=10.32.64.2 [root@opt-mgmt rh]# I see acpi_pad.disable=1 added to /tftpboot/[/xcat/xnba/nodes/d8civy106 but then after installing and rebooting I don't see acpi_pad.disable=1 appended in /boot/grub/grub.conf I thought I've done this before and it worked but not now... Any help would be appreciated. Thanks, Rich -- Rich Sudlow University of Notre Dame Center for Research Computing - Union Station 506 W. South St South Bend, In 46601 (574) 631-7258 (office) (574) 807-1046 (cell) -- CenturyLink Cloud: The Leader in Enterprise Cloud Services. Learn Why More Businesses Are Choosing CenturyLink Cloud For Critical Workloads, Development Environments Everything In Between. Get a Quote or Start a Free Trial Today. http://pubads.g.doubleclick.net/gampad/clk?id=119420431iu=/4140/ostg.clktrk ___ xCAT-user mailing list xCAT-user@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/xcat-user
Re: [xcat-user] Don't see addition of bootparams.addkcmdline to /boot/grub/grub.conf
On 01/13/2014 09:17 PM, Rich Sudlow wrote: I'm trying to disable acpi_pad.disable=1 in the kernel tabch node=cswarm bootparams.addkcmdline=acpi_pad.disable=1 nodeset d8civy106 install [root@opt-mgmt rh]# lsdef d8civy106 Object name: d8civy106 addkcmdline=acpi_pad.disable=1 arch=x86_64 bmc=d8civy106-bmc bmcpassword=Ddofs811 bmcusername=USERID currchain=boot currstate=boot groups=ndcompute,cswarm,condor,sgecondor,rack59,ipmi,crc_passwd,all initrd=xcat/rhels6.4/x86_64/compute/initrd.img installnic=eth0 kcmdline=quiet repo=http://10.32.64.2:80/install/rhels6.4/x86_64 ks=http://10.32.64.2:80/install/autoinst/d8civy106 ksdevice=eth0 cmdline console=tty0 console=ttyS0,115200n8r kernel=xcat/rhels6.4/x86_64/compute/vmlinuz mac=6c:ae:8b:08:97:c3 mgt=ipmi monserver=10.32.64.2 netboot=xnba nfsdir=/install nfsserver=10.32.64.2 os=rhels6.4 postbootscripts=otherpkgs postscripts=syslog,remoteshell,addsiteyum,ndcompute power=ipmi primarynic=eth0 profile=compute provmethod=install serialflow=hard serialport=0 serialspeed=115200 servicenode=10.32.64.2 status=booted statustime=01-13-2014 21:03:01 tftpserver=10.32.64.2 xcatmaster=10.32.64.2 [root@opt-mgmt rh]# I see acpi_pad.disable=1 added to /tftpboot/[/xcat/xnba/nodes/d8civy106 but then after installing and rebooting I don't see acpi_pad.disable=1 appended in /boot/grub/grub.conf I thought I've done this before and it worked but not now... Any help would be appreciated. Thanks, Rich Forgot to add [root@opt-mgmt tftpboot]# xcatconfig -v Version 2.8.3 (built Tue Nov 12 23:16:15 EST 2013) Thanks, Rich -- Rich Sudlow University of Notre Dame Center for Research Computing - Union Station 506 W. South St South Bend, In 46601 (574) 631-7258 (office) (574) 807-1046 (cell) -- CenturyLink Cloud: The Leader in Enterprise Cloud Services. Learn Why More Businesses Are Choosing CenturyLink Cloud For Critical Workloads, Development Environments Everything In Between. Get a Quote or Start a Free Trial Today. http://pubads.g.doubleclick.net/gampad/clk?id=119420431iu=/4140/ostg.clktrk ___ xCAT-user mailing list xCAT-user@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/xcat-user
