Correct. I do not have /tftpboot mounted from the MN on the service
nodes, and site.sharedtftp is 0.
To clarify the behavior that I am seeing right now, the
/tftpboot/mypostscript/mypostscript.c100n1 file is updated on the
service node that the compute node is assigned to when running
updatenode c100n1 -P otherpkgs (time stamp changes and contents
change). However, the node is getting pushed the
/tftpboot/mypostscript/mypostscript.c100n1 file from the Management
Node, not the Service Node, when it is running.
This is causing a problem because if I change, for example,
OTHERPKGDIR in the osimage and then run an "updatenode c100n1 -P
otherpkgs", the service node gets the updated mypostscript.c100n1
file, but that file is never then pushed to the node. The management
node does *not* have its mypostscript.c100n1 file updated with the
new configuration, and as a result the compute node is pushed an old
mypostscript.c100n1 file from the management node.
Is this the expected behavior, or should the node be getting the
mypostscript file from the Service Node it is assigned to?
On 1/21/2014 9:48 AM, Lissa Valletta
wrote:
If you do not have /tftpboot
mounted on the service node usually because
site.sharedtftp=0 and hierarchy is setup correctly. Then when
you run updatenode to the compute node, you should see a
/tftpboot/mypostscripts directory on the service node of the
compute node containing the new
mypostscript..<computenodename> file.
Lissa K. Valletta
8-3/B10
Poughkeepsie, NY 12601
(tie 293) 433-3102
Lissa
Valletta---01/21/2014 08:54:38 AM---How many service nodes do
you have? I hope you have enough memory, cpus etc on the
Management No
From: Lissa
Valletta/Poughkeepsie/IBM@IBMUS
To: xCAT Users Mailing list
<xcat-user@lists.sourceforge.net>,
Cc: xcat-user@lists.sourceforge.net
Date: 01/21/2014 08:54 AM
Subject: Re: [xcat-user] xCAT ignoring my
otherpkgdir setting
How many service nodes do you
have? I hope you have enough memory, cpus etc on the
Management Node and Service nodes to handle 6000 nodes or
500-1000 nodes from each service node.
We also have some hints and tips for Large Cluster tuning.
https://sourceforge.net/apps/mediawiki/xcat/index.php?title=Hints_and_Tips_for_Large_Scale_Clusters
updatenode to the node should update the mypostscript file when
you have precreatemypostscripts=1. It sounds like something is
happening that that does not get downloaded to the nodes.
Try this set the attribute: chtab key=precreatemypostscripts
site.value=1
Run an simple updatenode to one of your nodes.
updatenode compute-03 -P mytest
Look in on the MN
/tftpboot/mypostscripts
You should see a file mypostscript.compute-03 where compute-03
is your nodename
It should change (date) each time you run updatenode or nodeset.
That is the file that is put on the node and modified during
updatenode and should contain the latest changes. It will be
modified and put in /xcatpost/mypostscript
You do have to have /tftpboot mounted on the Service nodes from
the Management Node for updatenode, if you are updating a
compute node attached to a service node. updatenode is actually
running on the service node in this case.
Lissa K. Valletta
8-3/B10
Poughkeepsie, NY 12601
(tie 293) 433-3102
Russell Jones ---01/20/2014 09:36:26
PM---Thanks! It is working fine now that I figured out what the
issue is. We will
From: Russell Jones
<russell-l...@jonesmail.me>
To: xcat-user@lists.sourceforge.net,
Date: 01/20/2014 09:36
PM
Subject: Re:
[xcat-user] xCAT ignoring my otherpkgdir setting
Thanks!
It is working fine now that I figured out what the issue is. We
will gain a lot better performance with
site.precreatemypostscripts enabled, so we wish to keep it on.
This is a cluster with ~6000 nodes.
On 1/20/2014 7:32 PM, Xiao Peng Wang wrote:
The question turns to whether to use the
site.precreatemypostscripts. This site attribute is used to
improve the performance of postscript mechanism in a big
cluster.
If site.precreatpostescripts is enabled, the mypostscript for
the node will be generated by nodeset command on xCAT MN. When
booting of node, the created mypostscript will be copied to
compute node directly for using. The advantage is it can save
the computing resource of MN during the node booting process,
the shortage is you must run nodeset for each changing which
related to postscripts.
If site.precreatescripts is disabled, nodeset command won't do
anything for mypostscirpt. When booting of node, it will try
to require the xCAT MN to generate the mypostscript at that
time.
So for your issue, you can try to disable the
site.precreatemypostscripts and to see whether it works well.
Thanks
Best Regards
----------------------------------------------------------------------
Wang Xiaopeng (王晓朋)
IBM China System Technology Laboratory
Tel: 86-10-82453455
Email: w...@cn.ibm.com
Address: 28,ZhongGuanCun Software Park,No.8 Dong Bei Wang West
Road, Haidian District Beijing P.R.China 100193
Russell Jones ---2014/01/18
03:40:35---I figured out what's going on - we are using the
site.precreatemypostscripts=1 option. Even though
From: Russell Jones <russell-l...@jonesmail.me>
To: xcat-user@lists.sourceforge.net,
Date: 2014/01/18
03:40
Subject: Re:
[xcat-user] xCAT ignoring my otherpkgdir setting
I figured out what's going on - we are using the
site.precreatemypostscripts=1 option. Even though the man page
on the site table states that the mypostscript file for the
node should be updated when an updatenode is ran as all as a
nodeset, this is not happening. I have to do a nodeset on the
node to have that file updated.
There's also a gap here in that since the node utilizes it's
local /xcatpost/mypostscript for pulling in variables that the
otherpkgs script needs, specifically $OTHERPKGDIR and
$OTHERPKGS1, you need to reboot your node or manually push the
new copy of this file to the nodes for your changes to
OTHERPKGDIR in the osimage to be seen by your node. In my
opinion, enhancements to updatenode need to be made so that:
A) updatenode rewrites the mypostscript file to capture any
changes you may have made to your osimage definitions
and
B) updatenode pushes this new mypostscript file to the node so
that updatenode will be aware of any osimage definition
changes.
On 1/17/2014 12:40 PM, Russell Jones wrote:
Well, genimage seems to pick up my
change just fine - it's just updatenode that doesn't. Here's
the temp yum.conf that is created during otherpkgs time with
genimage:
[otherpkgs1]
name=otherpkgs1
baseurl=file:///install/post/otherpkgs/centos5.4-new-kernel/x86_64/v5.4.8-dl-compute//.
gpgpcheck=0
[otherpkgs2]
name=otherpkgs2
baseurl=file:///install/post/otherpkgs/centos5.4-new-kernel/x86_64/v5.4.8-dl-compute//dell
gpgpcheck=0
We are wanting to separate out the otherpkgs based on image
name. Being able to configure otherpkgdir is a good feature
that seems to work fine during genimage time - I would
highly encourage you guys continue with this feature and
push it to the otherpkgs postscript.
On 1/17/2014 12:25 PM, Lissa Valletta wrote:
.
Take a look at this documentation , the otherpkgdir always
ends with the architecture directory and then the
directories under that contain the rpms. I have never seen
anything different so this may be a limitation in our code.
In other words in your case it should be otherpkgdir=/install/post/otherpkgs/centos5.4-new-kernel/x86_64
https://sourceforge.net/apps/mediawiki/xcat/index.php?title=XCAT_iDataPlex_Cluster_Quick_Start#Installing_Additional_Packages_Using_an_Otherpkgs_Pkglist
Lissa K. Valletta
8-3/B10
Poughkeepsie, NY 12601
(tie 293) 433-3102
Russell Jones ---01/17/2014
12:42:10 PM---Hi all, I am manually setting my otherpkgdir
for an osimage that a node belongs
From: Russell Jones
<russell-l...@jonesmail.me>
To: xCAT Users
Mailing list <xcat-user@lists.sourceforge.net>,
Date: 01/17/2014
12:42 PM
Subject: [xcat-user]
xCAT ignoring my otherpkgdir setting
Hi all,
I am manually setting my otherpkgdir for an osimage that a
node belongs to. However when running "updatenode $node -S",
the setting is being ignored. The problem is bolded below.
Example is below, how do I get this thing to look at the
right path?
[root@master v5.4.8-dl-compute]# chdef -t osimage
v5.4.8-dl-compute
otherpkgdir=/install/post/otherpkgs/centos5.4-new-kernel/x86_64/v5.4.8-dl-compute/
1 object definitions have been created or modified.
[root@master v5.4.8-dl-compute]# lsdef -t osimage
v5.4.8-dl-compute
Object name: v5.4.8-dl-compute
exlist=/install/custom/netboot/centos/v5.4.8-dl-compute.exlist
groups=all
imagetype=linux
kerneldir=/install/netboot/centos5.4-new-kernel/x86_64/v5.4.8-dl-compute
netdrivers=libphy,tg3,bnx2,e1000,dca,8021q,igb,forcedeth,squashfs,aufs,loop
nodebootif=eth0
osarch=x86_64
osdistroname=centos5.4-new-kernel-x86_64
osname=Linux
osvers=centos5.4-new-kernel
otherpkgdir=/install/post/otherpkgs/centos5.4-new-kernel/x86_64/v5.4.8-dl-compute/
otherpkglist=/install/custom/netboot/centos/v5.4.8-dl-compute.otherpkgs.pkglist
pkgdir=/install/centos5.4-new-kernel/x86_64/
pkglist=/install/custom/netboot/centos/v5.4.8-dl-compute.pkglist
postinstall=/install/custom/netboot/centos/v5.4.8-dl-compute.postinstall
postscripts=remoteshell,localrepo5,hardeths,postage.sh
profile="">
provmethod=netboot
rootimgdir=/install/netboot/centos5.4-new-kernel/x86_64/v5.4.8-dl-compute
[root@master v5.4.8-dl-compute]# lsdef c100n4
Object name: c100n4
<snip>
profile="">
provmethod=v5.4.8-dl-compute
[root@master v5.4.8-dl-compute]# updatenode c100n4 -S
Performing software maintenance operations. This could take
a while, if there are packages to install.
c100n4: Fri Jan 17 11:32:04 CST 2014 Running postscript:
ospkgs
c100n4: Postscript: ospkgs exited with code 0
c100n4: Fri Jan 17 11:32:57 CST 2014 Running postscript:
otherpkgs
c100n4: NFSSERVER=master
c100n4:
OTHERPKGDIR=master/install/post/otherpkgs/centos5.4-new-kernel/x86_64
c100n4: Loaded plugins: changelog, fastestmirror, keys,
list-data, tmprepo, verify
c100n4: Cleaning up Everything
c100n4: Loaded plugins: changelog, fastestmirror, keys,
list-data, tmprepo, verify
c100n4: Cleaning up Everything
c100n4: Cleaning up list of fastest mirrors
c100n4: yum -y upgrade
c100n4: Loaded plugins: changelog, fastestmirror, keys,
list-data, tmprepo, verify
c100n4: Loading mirror speeds from cached hostfile
c100n4: http://master/install/post/otherpkgs/centos5.4-new-kernel/x86_64/dell/repodata/repomd.xml: [Errno 14] HTTP Error 404: Not Found
c100n4: Trying other mirror.
c100n4: Error: Cannot retrieve repository metadata
(repomd.xml) for repository: xcat-otherpkgs0. Please verify
its path and try again
<snip>
c100n4: Postscript: otherpkgs exited with code 34
c100n4: Running of Software Maintenance has completed.
------------------------------------------------------------------------------
CenturyLink Cloud: The Leader in Enterprise Cloud
Services.
Learn Why More Businesses Are Choosing CenturyLink Cloud
For
Critical Workloads, Development Environments &
Everything In Between.
Get a Quote or Start a Free Trial Today.
http://pubads.g.doubleclick.net/gampad/clk?id=119420431&iu=/4140/ostg.clktrk_______________________________________________
xCAT-user mailing list
xCAT-user@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/xcat-user
------------------------------------------------------------------------------
CenturyLink Cloud: The Leader in Enterprise Cloud
Services.
Learn Why More Businesses Are Choosing CenturyLink Cloud
For
Critical Workloads, Development Environments &
Everything In Between.
Get a Quote or Start a Free Trial Today.
http://pubads.g.doubleclick.net/gampad/clk?id=119420431&iu=/4140/ostg.clktrk
_______________________________________________
xCAT-user mailing list
xCAT-user@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/xcat-user
------------------------------------------------------------------------------
CenturyLink Cloud: The Leader in Enterprise Cloud
Services.
Learn Why More Businesses Are Choosing CenturyLink Cloud
For
Critical Workloads, Development Environments &
Everything In Between.
Get a Quote or Start a Free Trial Today.
http://pubads.g.doubleclick.net/gampad/clk?id=119420431&iu=/4140/ostg.clktrk
_______________________________________________
xCAT-user mailing list
xCAT-user@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/xcat-user
------------------------------------------------------------------------------
CenturyLink Cloud: The Leader in Enterprise Cloud Services.
Learn Why More Businesses Are Choosing CenturyLink Cloud For
Critical Workloads, Development Environments &
Everything In Between.
Get a Quote or Start a Free Trial Today.
http://pubads.g.doubleclick.net/gampad/clk?id=119420431&iu=/4140/ostg.clktrk_______________________________________________
xCAT-user mailing list
xCAT-user@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/xcat-user
------------------------------------------------------------------------------
CenturyLink Cloud: The Leader in Enterprise Cloud Services.
Learn Why More Businesses Are Choosing CenturyLink Cloud For
Critical Workloads, Development Environments &
Everything In Between.
Get a Quote or Start a Free Trial Today.
http://pubads.g.doubleclick.net/gampad/clk?id=119420431&iu=/4140/ostg.clktrk
_______________________________________________
xCAT-user mailing list
xCAT-user@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/xcat-user
------------------------------------------------------------------------------
CenturyLink Cloud: The Leader in Enterprise Cloud Services.
Learn Why More Businesses Are Choosing CenturyLink Cloud For
Critical Workloads, Development Environments & Everything
In Between.
Get a Quote or Start a Free Trial Today.
http://pubads.g.doubleclick.net/gampad/clk?id=119420431&iu=/4140/ostg.clktrk_______________________________________________
xCAT-user mailing list
xCAT-user@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/xcat-user
------------------------------------------------------------------------------
CenturyLink Cloud: The Leader in Enterprise Cloud Services.
Learn Why More Businesses Are Choosing CenturyLink Cloud For
Critical Workloads, Development Environments & Everything
In Between.
Get a Quote or Start a Free Trial Today.
http://pubads.g.doubleclick.net/gampad/clk?id=119420431&iu=/4140/ostg.clktrk_______________________________________________
xCAT-user mailing list
xCAT-user@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/xcat-user
------------------------------------------------------------------------------
CenturyLink Cloud: The Leader in Enterprise Cloud Services.
Learn Why More Businesses Are Choosing CenturyLink Cloud For
Critical Workloads, Development Environments & Everything In Between.
Get a Quote or Start a Free Trial Today.
http://pubads.g.doubleclick.net/gampad/clk?id=119420431&iu=/4140/ostg.clktrk
_______________________________________________
xCAT-user mailing list
xCAT-user@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/xcat-user
|