Loos like your osimage configured with ramdisk-based statelite, so when run 'nodeset <node> osimage=xxx" the node booted to 'ramdisk based'. If run 'nodeset <node> statelite', it got into 'nfs-based statelite'. You could run 'mount' on your booted system to see where the root file system comes from.
Thanks Best Regards ---------------------------------------------------------------------- Wang Xiaopeng (王晓朋) IBM China System Technology Laboratory Tel: 86-10-82453455 Email: w...@cn.ibm.com Address: 28,ZhongGuanCun Software Park,No.8 Dong Bei Wang West Road, Haidian District Beijing P.R.China 100193 From: Christopher Samuel <sam...@unimelb.edu.au> To: Song BJ Yang/China/IBM@IBMCN, Cc: xCAT Users Mailing list <xcat-user@lists.sourceforge.net> Date: 2013/04/25 20:58 Subject: Re: [xcat-user] Fw: Statelite newbie problem On 24/04/13 21:35, Song BJ Yang wrote: > Of course, you can do some investigation by yourself, unzip the initrd > and check whether the file "90parse-nfsroot.sh" exists under directory > "cmdline" in the initrd, the steps are: > > #mkdir -p /tmp/initrd > #cp /install/netboot/rhels6/x86_64/compute/initrd-statelite.gz > /tmp/initrd After some more digging it appears that whilst genimage is indeed updating both stateless and statelite initrd's in that directory. However, the initrd referred to in /tftpboot/xcat/xnba/nodes/barcoo001.elilo is actually under /tftpboot/xcat/osimage/rhel64nophi. The problem seems to be that when I do "nodeset barcoo001 osimage=rhel64nophi" it is only copying the stateless initrd to /tftpboot/xcat/osimage/rhel64nophi, and missing/skipping the statelite one. [root@barcoo-m ~]# ls -ltr /install/netboot/rhels6/x86_64/compute/ total 198976 -rw-r--r-- 1 root root 4044560 Apr 25 22:38 kernel -rw-r--r-- 1 root root 18124689 Apr 25 22:39 initrd-statelite.gz -rw-r--r-- 1 root root 20281613 Apr 25 22:40 initrd-stateless.gz dr-xr-xr-x 25 root root 4096 Apr 25 22:40 rootimg -rw-r--r-- 1 root root 161288681 Apr 25 22:41 rootimg-statelite.gz versus: [root@barcoo-m ~]# ls -ltr /tftpboot/xcat/osimage/rhel64nophi/ total 31772 -rw-r--r-- 1 root root 8201559 Apr 24 16:28 initrd-statelite.gz -rw-r--r-- 1 root root 4044560 Apr 25 22:42 kernel -rw-r--r-- 1 root root 20281613 Apr 25 22:42 initrd-stateless.gz If I use the deprecated "nodeset barcoo001 statelite" then it changes the files from: :::::::::::::: /tftpboot/xcat/xnba/nodes/barcoo001 :::::::::::::: #!gpxe #statelite rhels6-x86_64-compute imgfetch -n kernel http://${next-server}/tftpboot/xcat/osimage/rhel64nophi/kernel imgload kernel imgargs kernel imgurl=http://$ {next-server}:80//install/netboot/rhels6/x86_64/compute/rootimg-statelite.gz STATEMNT=10.3.0.58:/state XCAT=${next-server}:3001 console=tty0 console=ttyS0,115200 n8r MNTOPTS= BOOTIF=01-${netX/machyp} imgfetch http://${next-server}/tftpboot/xcat/osimage/rhel64nophi/initrd-stateless.gz imgexec kernel :::::::::::::: /tftpboot/xcat/xnba/nodes/barcoo001.elilo :::::::::::::: default="xCAT" delay=0 image=/tftpboot/xcat/osimage/rhel64nophi/kernel label="xCAT" initrd=/tftpboot/xcat/osimage/rhel64nophi/initrd-stateless.gz append="imgurl=http://%N:80//install/netboot/rhels6/x86_64/compute/rootimg-statelite.gz STATEMNT=10.3.0.58:/state XCAT=%N:3001 console=tty0 console=ttyS0,115200n8r MNTOPTS= BOOTIF=%B" :::::::::::::: /tftpboot/xcat/xnba/nodes/barcoo001.uefi :::::::::::::: #!gpxe chain http://${next-server}/tftpboot/xcat/elilo-x64.efi -C /tftpboot/xcat/xnba/nodes/barcoo001.elilo To: [root@barcoo-m ~]# more /tftpboot/xcat/xnba/nodes/barcoo001* :::::::::::::: /tftpboot/xcat/xnba/nodes/barcoo001 :::::::::::::: #!gpxe #statelite rhels6-x86_64-compute imgfetch -n kernel http://${next-server}/tftpboot/xcat/netboot/rhels6/x86_64/compute//kernel imgload kernel imgargs kernel root=nfs:${next-server}:/install/netboot/rhels6/x86_64/compute/rootimg:ro STATEMNT=10.3.0.58:/state XCAT=${next-server}:3001 console=tty0 console=ttyS0,115200n8r MNTOPTS= BOOTI F=01-${netX/machyp} imgfetch http://$ {next-server}/tftpboot/xcat/netboot/rhels6/x86_64/compute//initrd-statelite.gz imgexec kernel :::::::::::::: /tftpboot/xcat/xnba/nodes/barcoo001.elilo :::::::::::::: default="xCAT" delay=0 image=/tftpboot/xcat/netboot/rhels6/x86_64/compute//kernel label="xCAT" initrd=/tftpboot/xcat/netboot/rhels6/x86_64/compute//initrd-statelite.gz append="root=nfs:%N:/install/netboot/rhels6/x86_64/compute/rootimg:ro STATEMNT=10.3.0.58:/state XCAT=%N:3001 console=tty0 console=ttyS0,115200n8r MNTOPTS= BOOTIF=%B" :::::::::::::: /tftpboot/xcat/xnba/nodes/barcoo001.uefi :::::::::::::: #!gpxe chain http://${next-server}/tftpboot/xcat/elilo-x64.efi -C /tftpboot/xcat/xnba/nodes/barcoo001.elilo ...and then it boots, as it's now using the correct files! So it looks to me that something is going wrong with nodeset and the new osimage config for statelite. All the best, Chris -- Christopher Samuel Senior Systems Administrator VLSCI - Victorian Life Sciences Computation Initiative Email: sam...@unimelb.edu.au Phone: +61 (0)3 903 55545 http://www.vlsci.org.au/ http://twitter.com/vlsci ------------------------------------------------------------------------------ Try New Relic Now & We'll Send You this Cool Shirt New Relic is the only SaaS-based application performance monitoring service that delivers powerful full stack analytics. Optimize and monitor your browser, app, & servers with just a few lines of code. Try New Relic and get this awesome Nerd Life shirt! http://p.sf.net/sfu/newrelic_d2d_apr _______________________________________________ xCAT-user mailing list xCAT-user@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/xcat-user
<<inline: graycol.gif>>
------------------------------------------------------------------------------ Try New Relic Now & We'll Send You this Cool Shirt New Relic is the only SaaS-based application performance monitoring service that delivers powerful full stack analytics. Optimize and monitor your browser, app, & servers with just a few lines of code. Try New Relic and get this awesome Nerd Life shirt! http://p.sf.net/sfu/newrelic_d2d_apr
_______________________________________________ xCAT-user mailing list xCAT-user@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/xcat-user
