Yuan Bai hello,
I did follow exactly those instructions (although I am pretty sure the litefile
table part is not needed for the stateless image) but I still see nothing
happening on the nodes. I suspect that either there is no piece of code for
stateless that handle localdisk or I am missing something very basic.
Have you tried it with stateless? Where can I find the code and how I can debug
it? I can’t find anything related to partition nor local disk setup in the
logs.
Here is my local disk file –
enable=yes
enablepart=yes
[disk]
dev=/dev/sda
clear=yes
parts=1,19,80
[swapspace]
dev=/dev/sda1
[localspace]
dev=/dev/sda2
fstype=ext4
[localspace]
dev=/dev/sda3
fstype=ext4
# lsdef -t osimage -o rhels7.3-x86_64-netboot-compute
Object name: rhels7.3-x86_64-netboot-compute
exlist=/opt/xcat/share/xcat/netboot/rh/compute.rhels7.x86_64.exlist
imagetype=linux
osarch=x86_64
osdistroname=rhels7.3-x86_64
osname=Linux
osvers=rhels7.3
otherpkgdir=/install/post/otherpkgs/rhels7.3/x86_64
partitionfile=/install/custom/netboot/localdisk
permission=755
pkgdir=/install/rhels7.3/x86_64
pkglist=/opt/xcat/share/xcat/netboot/rh/compute.rhels7.x86_64.pkglist
postinstall=/opt/xcat/share/xcat/netboot/rh/compute.rhels7.x86_64.postinstall
profile=compute
provmethod=netboot
rootimgdir=/install/netboot/rhels7.3/x86_64/compute
synclists=/install/custom/netboot/compute.synclist
THX!!
[http://lenovocentral.lenovo.com/marketing/branding/email_signature/images/gradient.gif]
Gilad Berman
HPC Architect
Lenovo EMEA
[Phone]+972-52-2554262
[Email]gber...@lenovo.com<mailto:gber...@lenovo.com>
Lenovo.com <http://www.lenovo.com/>
Twitter<http://twitter.com/lenovo> | Facebook<http://www.facebook.com/lenovo> |
Instagram<https://instagram.com/lenovo> | Blogs<http://blog.lenovo.com/> |
Forums<http://forums.lenovo.com/>
[DCG-Hardware]
From: Yuan Y Bai [mailto:by...@cn.ibm.com]
Sent: Tuesday, November 28, 2017 7:30 AM
To: xcat-user@lists.sourceforge.net
Cc: xcat-user@lists.sourceforge.net
Subject: Re: [xcat-user] Local scratch for stateless compute nodes
Hello,
Please refer to "Enabling the localdisk Option" section under "diskless
installation" section :
http://xcat-docs.readthedocs.io/en/latest/guides/admin-guides/manage_clusters/ppc64le/diskless/customize_image/localdisk.html
The main diskless installation doc link is here:
http://xcat-docs.readthedocs.io/en/latest/guides/admin-guides/manage_clusters/ppc64le/diskless/index.html
Best Regards
--------------------------------------------------
Yuan Bai (白媛)
CSTL HPC System Management Development
Tel:86-10-82451401
E-mail: by...@cn.ibm.com<mailto:by...@cn.ibm.com>
Address: IBM ZGC Campus. Ring Building 28,
ZhongGuanCun Software Park,No.8 Dong Bei Wang West Road, Haidian District,
Beijing P.R.China 100193
IBM环宇大厦
北京市海淀区东北旺西路8号，中关村软件园28号楼
邮编:100193
----- Original message -----
From: Vinícius Ferrão
<fer...@versatushpc.com.br<mailto:fer...@versatushpc.com.br>>
To: xCAT Users Mailing list
<xcat-user@lists.sourceforge.net<mailto:xcat-user@lists.sourceforge.net>>
Cc:
Subject: Re: [xcat-user] Local scratch for stateless compute nodes
Date: Tue, Nov 28, 2017 12:40 PM
Hello,
The major problem is the missing documentation on how to use the local disks on
a stateless (diskless) installation. Tricks are being deployed instead.
Trying to mimic the steps of a statelite installation is not sufficient to make
it work on stateless deployments.
V.
On 28 Nov 2017, at 00:15, Yuan Y Bai
<by...@cn.ibm.com<mailto:by...@cn.ibm.com>> wrote:
That is correct, diskless and statelite both support local disk for different
purposes now.
Best Regards
--------------------------------------------------
Yuan Bai (白媛)
CSTL HPC System Management Development
Tel:86-10-82451401
E-mail: by...@cn.ibm.com<mailto:by...@cn.ibm.com>
Address: IBM ZGC Campus. Ring Building 28,
ZhongGuanCun Software Park,No.8 Dong Bei Wang West Road, Haidian District,
Beijing P.R.China 100193
IBM环宇大厦
北京市海淀区东北旺西路8号，中关村软件园28号楼
邮编:100193
----- Original message -----
From: Vinícius Ferrão
<fer...@versatushpc.com.br<mailto:fer...@versatushpc.com.br>>
To: xCAT Users Mailing list
<xcat-user@lists.sourceforge.net<mailto:xcat-user@lists.sourceforge.net>>
Cc:
Subject: Re: [xcat-user] Local scratch for stateless compute nodes
Date: Tue, Nov 28, 2017 12:14 AM
Hello,
Accordingly to the documentation they are different on a specific way:
. Stateless: nodes boot from a RAMdisk OS image downloaded from the xCAT mgmt
node or service node at boot time.
. Statelite: nodes boot from an NFS-root diskless OS image.
And both support local disk for different purposes, what we are targeting are
local disks just for scratch and swap. They will not handle any state, and this
is perfectly supported as said on the documentation.
Here’s the documentation:
https://sourceforge.net/p/xcat/wiki/XCAT_Overview,_Architecture,_and_Planning/#xcat-cluster-node-types<https://urldefense.proofpoint.com/v2/url?u=https-3A__sourceforge.net_p_xcat_wiki_XCAT-5FOverview-2C-5FArchitecture-2C-5Fand-5FPlanning_-23xcat-2Dcluster-2Dnode-2Dtypes&d=DwMFaQ&c=jf_iaSHvJObTbx-siA1ZOg&r=uiTcPxjMR44SPRNNb6l_nA&m=oAQVc_Sh4trqtOHvVelQBzsfz8vF7IL0CwQcnYf1Nbs&s=fH1AxDWPRLVZLj9RfODpdKPJOENCWrDCRvH0_M8TsjA&e=>
Thanks,
V.
Sent from my iPhone
On 27 Nov 2017, at 12:50, Russ Auld
<russa...@comcast.net<mailto:russa...@comcast.net>> wrote:
If you're using netboot and local disk, then isn't that "statelite"?
Do the satellite instructions not work?
On Nov 27, 2017 9:26 AM, Gilad Berman
<gber...@lenovo.com<mailto:gber...@lenovo.com>> wrote:
All,
I would like to join this question –
Does even localdisk works with stateless? From the docs it seems that should be
supported (because it is under stateless), however –
- the instructions are taken from statelite and refer to statelite code
(litefile)
- The rc.localdisk code is under statelite
- In the linuximage man – “Partitionfile - Only available for diskful
osimages and statelite osimages(localdisk enabled)“
A very quick trial on my statless nodes results in nothing ☺, it seems there is
simply no reference to localdisk with stateless.
So, can someone please help clarify it?
** as always, there is a chance I missed something very basic and it should be
working ☺
THX in advance!
[http://lenovocentral.lenovo.com/marketing/branding/email_signature/images/gradient.gif]
Gilad Berman
HPC Architect
Lenovo EMEA
[Phone]+972-52-2554262
[Email]gber...@lenovo.com<mailto:gber...@lenovo.com>
Lenovo.com
<https://urldefense.proofpoint.com/v2/url?u=http-3A__www.lenovo.com_&d=DwMFaQ&c=jf_iaSHvJObTbx-siA1ZOg&r=uiTcPxjMR44SPRNNb6l_nA&m=oAQVc_Sh4trqtOHvVelQBzsfz8vF7IL0CwQcnYf1Nbs&s=X4IxhzhlpZBcc7jTaTYACA25o1VeJYQRFpalyqxbTAA&e=>
Twitter<https://urldefense.proofpoint.com/v2/url?u=http-3A__twitter.com_lenovo&d=DwMFaQ&c=jf_iaSHvJObTbx-siA1ZOg&r=uiTcPxjMR44SPRNNb6l_nA&m=oAQVc_Sh4trqtOHvVelQBzsfz8vF7IL0CwQcnYf1Nbs&s=gho5DwChsdnzs9Dw5ZV_88KpPl44Ip7sh52Wg0EBHhY&e=>
|
Facebook<https://urldefense.proofpoint.com/v2/url?u=http-3A__www.facebook.com_lenovo&d=DwMFaQ&c=jf_iaSHvJObTbx-siA1ZOg&r=uiTcPxjMR44SPRNNb6l_nA&m=oAQVc_Sh4trqtOHvVelQBzsfz8vF7IL0CwQcnYf1Nbs&s=JOvwli3J9WR0J39QGoi4B0QeJy10-ovWRDSiLphZUq8&e=>
|
Instagram<https://urldefense.proofpoint.com/v2/url?u=https-3A__instagram.com_lenovo&d=DwMFaQ&c=jf_iaSHvJObTbx-siA1ZOg&r=uiTcPxjMR44SPRNNb6l_nA&m=oAQVc_Sh4trqtOHvVelQBzsfz8vF7IL0CwQcnYf1Nbs&s=4AAUTt59CFyotMoxHfUfncLrD9IWapwC9-OIIZLV9zQ&e=>
|
Blogs<https://urldefense.proofpoint.com/v2/url?u=http-3A__blog.lenovo.com_&d=DwMFaQ&c=jf_iaSHvJObTbx-siA1ZOg&r=uiTcPxjMR44SPRNNb6l_nA&m=oAQVc_Sh4trqtOHvVelQBzsfz8vF7IL0CwQcnYf1Nbs&s=9x0nK_W79dF0Tvc0NMKUhQTRqTdVYfRDY08BLuU8UDM&e=>
|
Forums<https://urldefense.proofpoint.com/v2/url?u=http-3A__forums.lenovo.com_&d=DwMFaQ&c=jf_iaSHvJObTbx-siA1ZOg&r=uiTcPxjMR44SPRNNb6l_nA&m=oAQVc_Sh4trqtOHvVelQBzsfz8vF7IL0CwQcnYf1Nbs&s=mt0bevTff4R5xmLMfS4Z6HE6OzmCoPwx3PIpKs6hk4o&e=>
[DCG-Hardware]
From: Vinícius Ferrão [mailto:fer...@versatushpc.com.br]
Sent: Wednesday, November 22, 2017 4:09 AM
To: xcat-user@lists.sourceforge.net<mailto:xcat-user@lists.sourceforge.net>
Subject: [xcat-user] Local scratch for stateless compute nodes
Hello,
I would like to enable swap and local /tmp on my stateless nodes, but after
following the documentation on the following link nothing appears to work:
http://xcat-docs.readthedocs.io/en/stable/advanced/hierarchy/provision/diskless_sn.html<https://urldefense.proofpoint.com/v2/url?u=http-3A__xcat-2Ddocs.readthedocs.io_en_stable_advanced_hierarchy_provision_diskless-5Fsn.html&d=DwMFaQ&c=jf_iaSHvJObTbx-siA1ZOg&r=uiTcPxjMR44SPRNNb6l_nA&m=oAQVc_Sh4trqtOHvVelQBzsfz8vF7IL0CwQcnYf1Nbs&s=Gx5Rpj3rHwRYRV3sDlD3Gw5m4HChY86jM8rPWsui31M&e=>
I’m aware that the documentation is for service nodes and not for compute
nodes, but I was thinking the procedure would be similar.
At this point I’m with this settings on osimage:
[root@headnode xcat]# lsdef -t osimage centos7.4-x86_64-netboot-compute
exlist=/opt/xcat/share/xcat/netboot/centos/compute.centos7.exlist
imagetype=linux
osarch=x86_64
osdistroname=centos7.4-x86_64
osname=Linux
osvers=centos7.4
otherpkgdir=/install/post/otherpkgs/centos7.4/x86_64
****
partitionfile=/install/custom/netboot/centos7.4-x86_64-netboot-compute/partitionfile
permission=755
pkgdir=/install/centos7.4/x86_64
pkglist=/opt/xcat/share/xcat/netboot/centos/compute.centos7.pkglist
postinstall=/opt/xcat/share/xcat/netboot/centos/compute.centos7.postinstall
profile=compute
provmethod=netboot
rootimgdir=/install/netboot/centos7.4/x86_64/compute
synclists=/install/custom/netboot/compute.synclist
And the content of the partition file is the following:
cat /install/custom/netboot/centos7.4-x86_64-netboot-compute/partitionfile
enable=yes
enablepart=yes
[disk]
dev=/dev/sda
clear=yes
parts=10,90
[swapspace]
dev=/dev/sda1
[localspace]
dev=/dev/sda2
fstype=xfs
Finally the following commands were executed:
chtab priority=7.1 policy.commands=getpartition policy.rule=allow
chtab litefile.image=centos7.4-x86_64-netboot-compute litefile.file=/var/log/
litefile.options=localdisk
chtab litefile.image=centos7.4-x86_64-netboot-compute litefile.file=/tmp/
litefile.options=localdisk
After a new genimage/packimage the local scratch does not appears to be made
nor working.
Someone knows what to do next?
Thanks,
V.
------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites,
Slashdot.org<https://urldefense.proofpoint.com/v2/url?u=http-3A__Slashdot.org&d=DwMFaQ&c=jf_iaSHvJObTbx-siA1ZOg&r=uiTcPxjMR44SPRNNb6l_nA&m=oAQVc_Sh4trqtOHvVelQBzsfz8vF7IL0CwQcnYf1Nbs&s=z6I-UL4HsS48c3bBReYJMdwxy_es4RGAPf_Iz5R1OBk&e=>!
http://sdm.link/slashdot<https://urldefense.proofpoint.com/v2/url?u=http-3A__sdm.link_slashdot&d=DwMFaQ&c=jf_iaSHvJObTbx-siA1ZOg&r=uiTcPxjMR44SPRNNb6l_nA&m=oAQVc_Sh4trqtOHvVelQBzsfz8vF7IL0CwQcnYf1Nbs&s=dz2jXUMV84xRcXmPqkIFax-QT2ohLF-q9GVvyjAwq4E&e=>
_______________________________________________
xCAT-user mailing list
xCAT-user@lists.sourceforge.net<mailto:xCAT-user@lists.sourceforge.net>
https://lists.sourceforge.net/lists/listinfo/xcat-user<https://urldefense.proofpoint.com/v2/url?u=https-3A__lists.sourceforge.net_lists_listinfo_xcat-2Duser&d=DwMFaQ&c=jf_iaSHvJObTbx-siA1ZOg&r=uiTcPxjMR44SPRNNb6l_nA&m=oAQVc_Sh4trqtOHvVelQBzsfz8vF7IL0CwQcnYf1Nbs&s=pxDjbuNwMM5N-ML97kogip_ZqRD1ioRXc3AVwGp6v_0&e=>
------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites,
Slashdot.org<https://urldefense.proofpoint.com/v2/url?u=http-3A__Slashdot.org&d=DwMFaQ&c=jf_iaSHvJObTbx-siA1ZOg&r=uiTcPxjMR44SPRNNb6l_nA&m=bJlh5sWbgdtZM7vwR5StzuCLPzUxwmdKcNMoKV431G8&s=UsILkKN3zC4PMI82G0zulyF4shZfPWz2-Qu7tpD0iZs&e=>!
https://urldefense.proofpoint.com/v2/url?u=http-3A__sdm.link_slashdot&d=DwICAg&c=jf_iaSHvJObTbx-siA1ZOg&r=uiTcPxjMR44SPRNNb6l_nA&m=oAQVc_Sh4trqtOHvVelQBzsfz8vF7IL0CwQcnYf1Nbs&s=dz2jXUMV84xRcXmPqkIFax-QT2ohLF-q9GVvyjAwq4E&e=
_______________________________________________
xCAT-user mailing list
xCAT-user@lists.sourceforge.net<mailto:xCAT-user@lists.sourceforge.net>
https://urldefense.proofpoint.com/v2/url?u=https-3A__lists.sourceforge.net_lists_listinfo_xcat-2Duser&d=DwICAg&c=jf_iaSHvJObTbx-siA1ZOg&r=uiTcPxjMR44SPRNNb6l_nA&m=oAQVc_Sh4trqtOHvVelQBzsfz8vF7IL0CwQcnYf1Nbs&s=pxDjbuNwMM5N-ML97kogip_ZqRD1ioRXc3AVwGp6v_0&e=
------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites,
Slashdot.org<https://urldefense.proofpoint.com/v2/url?u=http-3A__Slashdot.org&d=DwMFaQ&c=jf_iaSHvJObTbx-siA1ZOg&r=uiTcPxjMR44SPRNNb6l_nA&m=bJlh5sWbgdtZM7vwR5StzuCLPzUxwmdKcNMoKV431G8&s=UsILkKN3zC4PMI82G0zulyF4shZfPWz2-Qu7tpD0iZs&e=>!
http://sdm.link/slashdot_______________________________________________<https://urldefense.proofpoint.com/v2/url?u=http-3A__sdm.link_slashdot-5F-5F-5F-5F-5F-5F-5F-5F-5F-5F-5F-5F-5F-5F-5F-5F-5F-5F-5F-5F-5F-5F-5F-5F-5F-5F-5F-5F-5F-5F-5F-5F-5F-5F-5F-5F-5F-5F-5F-5F-5F-5F-5F-5F-5F-5F-5F&d=DwMFaQ&c=jf_iaSHvJObTbx-siA1ZOg&r=uiTcPxjMR44SPRNNb6l_nA&m=bJlh5sWbgdtZM7vwR5StzuCLPzUxwmdKcNMoKV431G8&s=kRmYjL5fAgPw1XrDBkaOJZOOxo7PUYXRhJFt9oxKJK4&e=>
xCAT-user mailing list
xCAT-user@lists.sourceforge.net<mailto:xCAT-user@lists.sourceforge.net>
https://lists.sourceforge.net/lists/listinfo/xcat-user
------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org!
https://urldefense.proofpoint.com/v2/url?u=http-3A__sdm.link_slashdot&d=DwICAg&c=jf_iaSHvJObTbx-siA1ZOg&r=uiTcPxjMR44SPRNNb6l_nA&m=bJlh5sWbgdtZM7vwR5StzuCLPzUxwmdKcNMoKV431G8&s=MZdE_Br9c0Q15XZHVl7kH-W9YEuArDRrhJ2PRrwwquI&e=
_______________________________________________
xCAT-user mailing list
xCAT-user@lists.sourceforge.net<mailto:xCAT-user@lists.sourceforge.net>
https://urldefense.proofpoint.com/v2/url?u=https-3A__lists.sourceforge.net_lists_listinfo_xcat-2Duser&d=DwICAg&c=jf_iaSHvJObTbx-siA1ZOg&r=uiTcPxjMR44SPRNNb6l_nA&m=bJlh5sWbgdtZM7vwR5StzuCLPzUxwmdKcNMoKV431G8&s=DnfIb8O529ICv-d9obwAEhm6U22mQPibiLteXmJ2VLM&e=
------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
_______________________________________________
xCAT-user mailing list
xCAT-user@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/xcat-user
