Re: [xcat-user] Local scratch for stateless compute nodes

Tue, 28 Nov 2017 18:10:51 -0800

 
Hi Gilad,
Could you add an entry in policy table to permit the running of the "getpartition" command from the node?
 
chtab priority=7.1 policy.commands=getpartition policy.rule=allow
 
Best Regards
--------------------------------------------------
Yuan Bai (白媛)

CSTL HPC System Management Development
Tel:86-10-82451401
E-mail: by...@cn.ibm.com
Address: IBM ZGC Campus. Ring Building 28,
ZhongGuanCun Software Park,No.8 Dong Bei Wang West Road, Haidian District,
Beijing P.R.China 100193

IBM环宇大厦
北京市海淀区东北旺西路8号，中关村软件园28号楼
邮编:100193
 
 
----- Original message -----
From: Gilad Berman <gber...@lenovo.com>
To: xCAT Users Mailing list <xcat-user@lists.sourceforge.net>
Cc:
Subject: Re: [xcat-user] Local scratch for stateless compute nodes
Date: Tue, Nov 28, 2017 8:34 PM
 

Yuan Bai hello,

 

I did follow exactly those instructions (although I am pretty sure the litefile table part is not needed for the stateless image) but I still see nothing happening on the nodes. I suspect that either there is no piece of code for stateless that handle localdisk or I am missing something very basic.

 

Have you tried it with stateless? Where can I find the code and how I can debug it?    I can’t find anything related to partition nor local disk setup in the logs.

 

Here is my local disk file –

enable=yes

enablepart=yes

 

[disk]

dev=/dev/sda

clear=yes

parts=1,19,80

 

[swapspace]

dev=/dev/sda1

 

[localspace]

dev=/dev/sda2

fstype=ext4

 

[localspace]

dev=/dev/sda3

fstype=ext4

 

 

 

# lsdef -t osimage -o rhels7.3-x86_64-netboot-compute

Object name: rhels7.3-x86_64-netboot-compute

    exlist=/opt/xcat/share/xcat/netboot/rh/compute.rhels7.x86_64.exlist

    imagetype=linux

    osarch=x86_64

    osdistroname=rhels7.3-x86_64

    osname=Linux

    osvers=rhels7.3

    otherpkgdir=/install/post/otherpkgs/rhels7.3/x86_64

    partitionfile=/install/custom/netboot/localdisk

    permission=755

    pkgdir=/install/rhels7.3/x86_64

    pkglist=/opt/xcat/share/xcat/netboot/rh/compute.rhels7.x86_64.pkglist

    postinstall=/opt/xcat/share/xcat/netboot/rh/compute.rhels7.x86_64.postinstall

    profile="">

    provmethod=netboot

    rootimgdir=/install/netboot/rhels7.3/x86_64/compute

    synclists=/install/custom/netboot/compute.synclist

THX!!

 

 

http://lenovocentral.lenovo.com/marketing/branding/email_signature/images/gradient.gif

Gilad Berman
HPC Architect
Lenovo EMEA

Phone+972-52-2554262
Emailgber...@lenovo.com

 

  

Lenovo.com
Twitter | Facebook | Instagram | Blogs | Forums

DCG-Hardware
 

 

 

From: Yuan Y Bai [mailto:by...@cn.ibm.com]
Sent: Tuesday, November 28, 2017 7:30 AM
To: xcat-user@lists.sourceforge.net
Cc: xcat-user@lists.sourceforge.net
Subject: Re: [xcat-user] Local scratch for stateless compute nodes

 

Hello,

 

Please refer to "Enabling the localdisk Option" section under "diskless installation" section : http://xcat-docs.readthedocs.io/en/latest/guides/admin-guides/manage_clusters/ppc64le/diskless/customize_image/localdisk.html

 

The main diskless installation doc link is here:

 

 

Best Regards
--------------------------------------------------
Yuan Bai (白媛)

CSTL HPC System Management Development
Tel:86-10-82451401
E-mail: by...@cn.ibm.com
Address: IBM ZGC Campus. Ring Building 28,
ZhongGuanCun Software Park,No.8 Dong Bei Wang West Road, Haidian District,
Beijing P.R.China 100193

IBM环宇大厦
北京市海淀区东北旺西路8号，中关村软件园28号楼
邮编:100193

 

 

----- Original message -----
From: Vinícius Ferrão <fer...@versatushpc.com.br>
To: xCAT Users Mailing list <xcat-user@lists.sourceforge.net>
Cc:
Subject: Re: [xcat-user] Local scratch for stateless compute nodes
Date: Tue, Nov 28, 2017 12:40 PM
 

Hello,

 

The major problem is the missing documentation on how to use the local disks on a stateless (diskless) installation. Tricks are being deployed instead.

 

Trying to mimic the steps of a statelite installation is not sufficient to make it work on stateless deployments.

 

V.

 

On 28 Nov 2017, at 00:15, Yuan Y Bai <by...@cn.ibm.com> wrote:

 

That is correct, diskless and statelite both support local disk for different purposes now.

 

Best Regards
--------------------------------------------------
Yuan Bai (白媛)

CSTL HPC System Management Development
Tel:86-10-82451401
E-mail: by...@cn.ibm.com
Address: IBM ZGC Campus. Ring Building 28,
ZhongGuanCun Software Park,No.8 Dong Bei Wang West Road, Haidian District,
Beijing P.R.China 100193

IBM环宇大厦
北京市海淀区东北旺西路8号，中关村软件园28号楼
邮编:100193

 

 

----- Original message -----
From: Vinícius Ferrão <fer...@versatushpc.com.br>
To: xCAT Users Mailing list <xcat-user@lists.sourceforge.net>
Cc:
Subject: Re: [xcat-user] Local scratch for stateless compute nodes
Date: Tue, Nov 28, 2017 12:14 AM
 

 

Hello,

 

Accordingly to the documentation they are different on a specific way:

 

. Stateless: nodes boot from a RAMdisk OS image downloaded from the xCAT mgmt node or service node at boot time.

 

. Statelite: nodes boot from an NFS-root diskless OS image.

 

And both support local disk for different purposes, what we are targeting are local disks just for scratch and swap. They will not handle any state, and this is perfectly supported as said on the documentation.

 

 

Thanks,

V.
 

Sent from my iPhone


On 27 Nov 2017, at 12:50, Russ Auld <russa...@comcast.net> wrote:
 

If you're using netboot and local disk,  then isn't that "statelite"?

Do the satellite instructions not work? 

 

On Nov 27, 2017 9:26 AM, Gilad Berman <gber...@lenovo.com> wrote:

All,

 

I would like to join this question –

Does even localdisk works with stateless? From the docs it seems that should be supported (because it is under stateless), however –

-         the instructions are taken from statelite and refer to statelite code (litefile)

-         The rc.localdisk code is under statelite

-         In the linuximage man – “Partitionfile - Only available for diskful osimages and statelite osimages(localdisk enabled)“

 

A very quick trial on my statless nodes results in nothing J, it seems there is simply no reference to localdisk with stateless.

 

So, can someone please help clarify it?

 

** as always, there is a chance I missed something very basic and it should be working J

 

THX in advance!

 

http://lenovocentral.lenovo.com/marketing/branding/email_signature/images/gradient.gif

Gilad Berman
HPC Architect
Lenovo EMEA

Phone+972-52-2554262
Emailgber...@lenovo.com

 

 

Lenovo.com
Twitter | Facebook | Instagram | Blogs | Forums

DCG-Hardware

 

 

 

From: Vinícius Ferrão [mailto:fer...@versatushpc.com.br]
Sent: Wednesday, November 22, 2017 4:09 AM
To: xcat-user@lists.sourceforge.net
Subject: [xcat-user] Local scratch for stateless compute nodes

 

Hello,

 

I would like to enable swap and local /tmp on my stateless nodes, but after following the documentation on the following link nothing appears to work:

 

I’m aware that the documentation is for service nodes and not for compute nodes, but I was thinking the procedure would be similar.

 

At this point I’m with this settings on osimage:

[root@headnode xcat]# lsdef -t osimage centos7.4-x86_64-netboot-compute
    exlist=/opt/xcat/share/xcat/netboot/centos/compute.centos7.exlist
    imagetype=linux
    osarch=x86_64
    osdistroname=centos7.4-x86_64
    osname=Linux
    osvers=centos7.4
    otherpkgdir=/install/post/otherpkgs/centos7.4/x86_64

****    partitionfile=/install/custom/netboot/centos7.4-x86_64-netboot-compute/partitionfile

    permission=755
    pkgdir=/install/centos7.4/x86_64
    pkglist=/opt/xcat/share/xcat/netboot/centos/compute.centos7.pkglist
    postinstall=/opt/xcat/share/xcat/netboot/centos/compute.centos7.postinstall
    profile="">    provmethod=netboot
    rootimgdir=/install/netboot/centos7.4/x86_64/compute
    synclists=/install/custom/netboot/compute.synclist

 

And the content of the partition file is the following:

cat /install/custom/netboot/centos7.4-x86_64-netboot-compute/partitionfile
enable=yes
enablepart=yes

[disk]
dev=/dev/sda
clear=yes
parts=10,90

[swapspace]
dev=/dev/sda1

[localspace]
dev=/dev/sda2
fstype=xfs

 

Finally the following commands were executed:

chtab priority=7.1 policy.commands=getpartition policy.rule=allow

chtab litefile.image=centos7.4-x86_64-netboot-compute litefile.file=/var/log/ litefile.options=localdisk

chtab litefile.image=centos7.4-x86_64-netboot-compute litefile.file=/tmp/ litefile.options=localdisk

 

After a new genimage/packimage the local scratch does not appears to be made nor working.

 

Someone knows what to do next?

 

Thanks,

V.

 

------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot

_______________________________________________
xCAT-user mailing list
xCAT-user@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/xcat-user

------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! https://urldefense.proofpoint.com/v2/url?u=http-3A__sdm.link_slashdot&d=DwICAg&c=jf_iaSHvJObTbx-siA1ZOg&r=uiTcPxjMR44SPRNNb6l_nA&m=oAQVc_Sh4trqtOHvVelQBzsfz8vF7IL0CwQcnYf1Nbs&s=dz2jXUMV84xRcXmPqkIFax-QT2ohLF-q9GVvyjAwq4E&e=

 


------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot_______________________________________________
xCAT-user mailing list
xCAT-user@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/xcat-user

------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! https://urldefense.proofpoint.com/v2/url?u=http-3A__sdm.link_slashdot&d=DwICAg&c=jf_iaSHvJObTbx-siA1ZOg&r=uiTcPxjMR44SPRNNb6l_nA&m=bJlh5sWbgdtZM7vwR5StzuCLPzUxwmdKcNMoKV431G8&s=MZdE_Br9c0Q15XZHVl7kH-W9YEuArDRrhJ2PRrwwquI&e=

 

 

------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! https://urldefense.proofpoint.com/v2/url?u=http-3A__sdm.link_slashdot&d=DwICAg&c=jf_iaSHvJObTbx-siA1ZOg&r=uiTcPxjMR44SPRNNb6l_nA&m=ViJ7B2a6TXCErHqzBDQi34NpuIAwf6uQyk6FhdDE4ec&s=LIGi1xHrD7Qh0pA3Xj4y28L0Rd5mx5K0ZeT5djsHbF8&e=
 

------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
_______________________________________________
xCAT-user mailing list
xCAT-user@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/xcat-user

Reply via email to