Re: [xcat-user] Issue when running nodeset - kcmdline & initrd not set using xcat 2.13 and CentOS7

Long LA Cheng Mon, 24 Jul 2017 22:38:31 -0700

Hi,

'bootparams.kcmdline' is not a proper field to customize the kcmdline, it is a readonly column maintained by xcat to pass the information among the plugins previously. You should use 'bootparams.addkcmdline' instead to append some useful parameters like 'BOOTIF' or 'ifname' in your environment. For the other parameter like imgurl or console, I think xcat can help generate it based on your node definition.

So I think you can just change the definition like below, then rerun nodeset command.

chtab node=n113 bootparams.addkcmdline="FC=0 ifname=em1:48:4D:7E:81:F2:93 netdev=em1"

For genimage question, I think you can still use it for CentOS 6 image no matter what os is running on management node.

Thanks

Best Regards

Long Cheng(程龙)
IBM Systems &Technology Group, Development
SOFTWARE ENGINEER
Tel:86-10-82453046
Email:cheng...@cn.ibm.com
Address: 3F, Building 28, Zhong Guan Cun Software Park, No.8, Dong Bei Wang West Road, Hai Dian District, Beijing 100193, PRC
地址：国际商业机器中国(投资)有限公司, 中国系统科技实验室, 北京市海淀区东北旺西路8号中关村软件园28号楼3层，邮编:100193

----- Original message -----
From: "J. Smith" <cybersy...@gmail.com>
To: xCAT Users Mailing list <xcat-user@lists.sourceforge.net>
Cc:
Subject: Re: [xcat-user] Issue when running nodeset - kcmdline & initrd not set using xcat 2.13 and CentOS7
Date: Tue, Jul 25, 2017 11:41 AM

Hi Zhao & Long,

Thank you for the suggestions!

1) I fixed the issue with the permission error, there was one sub-directory that was missing the right permission under /install/netboot so that is okay now.

2) I made a mistake on my previous message when I updated "bootparams.addkcmdline", lsdef info was updated properly and it was the same for the node file after running nodeset it was also updated properly under pxelinux.cfg.

However, that does not work if I update "bootparams.kcmdline=", lsdef shows the proper information, but after running nodeset, the node file under pxelinux.cfg does not get updated. If I update manually the node file, and do a pxeboot the installation works but as soon as I run nodeset, the file doesn't include all my changes.

The node file with my manual changes looks like that:
DEFAULT xCAT
LABEL xCAT
KERNEL xcat/osimage/centos6.5-x86_64-netboot-panther-pec6220/kernel
APPEND initrd=xcat/osimage/centos6.5-x86_64-netboot-panther-pec6220/initrd-stateless.gz imgurl=http://xcatmn:80//install/netboot/centos6.5/x86_64/panther-pec6220/rootimg.gz XCAT=xcatmn:300
1 NODE=n113 FC=0 ifname=em1:48:4D:7E:81:F2:93 netdev=em1 console=tty0 console=ttyS0,115200
IPAPPEND 2

When I run,

chtab node=n113 bootparams.kcmdline="imgurl=http://xcatmn:80//install/netboot/centos6.5/x86_64/panther-pec6220/rootimg.gz XCAT=xcatmn:3001 NODE=n124 FC=0 ifname=em1:48:4D:7E:81:F2:93 netdev=em1 console=tty0 console=ttyS0,115200"

The part that doesn't get updated for some reason after running nodeset is "ifname=em1:48:4D:7E:81:F2:93". This is removed.
This is the right mac and interface name to be used.

If I run nodeset this is the output, as you can see "ifname=" is removed:
DEFAULT xCAT
LABEL xCAT
KERNEL xcat/osimage/centos6.5-x86_64-netboot-panther-pec6220/kernel
APPEND initrd=xcat/osimage/centos6.5-x86_64-netboot-panther-pec6220/initrd-stateless.gz imgurl=http://xcatmn:80//install/netboot/centos6.5/x86_64/panther-pec6220/rootimg.gz XCAT=xcatmn:300
1 NODE=n113 FC=0 netdev=em1 console=tty0 console=ttyS0,115200
IPAPPEND 2

Any ideas?

3) General question: If a management node runs on CentOS7 with xCAT 2.13, can we still run "genimage" to create/update a CentOS6 osimage or this needs to be done on a management node running CentOS6?

On Mon, Jul 24, 2017 at 10:01 PM, Long LA Cheng <cheng...@cn.ibm.com> wrote:
Hi,

For the pxe boot question, the network interface of the deploying node broadcasts the dhcp request and the dhcp server on xcat management node will reply to this if the host configuration(mac) can match the request. So this is handled by dhcp server, not the kcmdline in the pxe configuration file.

For the issue 1, could you double check with the following steps:

(1) `lsdef <node>, is there any entry like 'addkcmdline=<your input>'

(2) runs nodeset against the node.

(3) check the pxe configuration for the node.

For the issue 2, could you check the permission of the directory/file under /install directory at first, '755' permission is required, then restart apache service. You can try to download some file under the directory with 'wget' to check.

Thanks

Best Regards

Long Cheng(程龙)
IBM Systems &Technology Group, Development
SOFTWARE ENGINEER
Tel:86-10-82453046
Email:cheng...@cn.ibm.com
Address: 3F, Building 28, Zhong Guan Cun Software Park, No.8, Dong Bei Wang West Road, Hai Dian District, Beijing 100193, PRC
地址：国际商业机器中国(投资)有限公司, 中国系统科技实验室, 北京市海淀区东北旺西路8号中关村软件园28号楼3层，邮编:100193

----- Original message -----
From: "J. Smith" <cybersy...@gmail.com>
To: xCAT Users Mailing list <xcat-user@lists.sourceforge.net>
Cc:
Subject: Re: [xcat-user] Issue when running nodeset - kcmdline & initrd not set using xcat 2.13 and CentOS7
Date: Tue, Jul 25, 2017 4:54 AM

In addition to my previous email, I have also noticed the following, not sure if it is a bug:

1) If I update the bootparams.addkcmdline entry for the specific node it does not seem to update the content of the node file under pxelinux.cfg. Is that normal?

Changes seem to take effect only when I modify directly on the node file under pxelinux.cfg

2) I see some permissions Error on /var/log/html/error_log

[Mon Jul 24 16:42:39.622769 2017] [core:error] [pid 187765] (13)Permission denied: [client 192.168.248.153:56111] AH00035: access to /install/netboot/centos6.5/x86_64/panther-pec6220/rootimg.gz denied (filesystem path '/install/netboot/centos6.5') because search permissions are missing on a component of the path

I compared with my old environment and it seems to be the same. Any suggestions?

Thanks!

On Mon, Jul 24, 2017 at 11:09 AM, J. Smith <cybersy...@gmail.com> wrote:
Thank you Long for your reply,

I did check the information for my node, notice that in the append the ifname entry was missing.

DEFAULT xCAT
LABEL xCAT
KERNEL xcat/osimage/centos6.5-x86_64-netboot-panther-pec6220/kernel
APPEND initrd=xcat/osimage/centos6.5-x86_64-netboot-panther-pec6220/initrd-stateless.gz imgurl=http://xcatmn:80//install/netboot/centos6.5/x86_64/panther-pec6220/rootimg.gz XCAT=xcatmn:300
1 NODE=n113 FC=0 netdev=em1 console=tty0 console=ttyS0,115200
IPAPPEND 2

I try adding it (ifname=em1:48:4D:7E:81:F2:93) but I still have the same issue.
The pxe boot seems to work until it detects the network interface but then nothing happens. Does not seem that the post installation and postscripts start running.

Any suggestions?

Thanks!

On Sun, Jul 23, 2017 at 9:06 PM, Long LA Cheng <cheng...@cn.ibm.com> wrote:
Hi,

As pxe is used as the netboot loader, you can check the 'kernel/initrd/kcmdline' configuration in '/tftpboot/pxelinux.cfg/<node>'.

Thanks.

Best Regards

Long Cheng(程龙)
IBM Systems &Technology Group, Development
SOFTWARE ENGINEER
Tel:86-10-82453046
Email:cheng...@cn.ibm.com
Address: 3F, Building 28, Zhong Guan Cun Software Park, No.8, Dong Bei Wang West Road, Hai Dian District, Beijing 100193, PRC
地址：国际商业机器中国(投资)有限公司, 中国系统科技实验室, 北京市海淀区东北旺西路8号中关村软件园28号楼3层，邮编:100193

----- Original message -----
From: "J. Smith" <cybersy...@gmail.com>
To: xCAT Users Mailing list <xcat-user@lists.sourceforge.net>
Cc:
Subject: Re: [xcat-user] Issue when running nodeset - kcmdline & initrd not set using xcat 2.13 and CentOS7
Date: Sat, Jul 22, 2017 3:18 AM

Hi,
Are you saying that kcmdline and initrd does not need to be defined anymore for a diskless installation? So how does the new xCAT knows where to get initrd and the kcmdline for pxe boot?

I checked this path /tftpboot/petitboot/ but I don't have it on my environment.

Thanks.

On Thu, Jul 20, 2017 at 6:13 PM, Casandra H Qiu <cxh...@us.ibm.com> wrote:
Hi:

For better performance, nodeset will not add kcmdline and initrd to node definition any more.
But you can find those in the /tftpboot/petitboot/nodename after ran nodeset command.

Thanks,
Casandra

...................................................................
Casandra Hong Qiu
Phone: (845) 433-9291, t/l 293-9291
Office: Building 8, 3-B-04
cxh...@us.ibm.com

"J. Smith" ---07/20/2017 05:48:55 PM---Hello, I have installed a new version of xcat v2.13 on CentOS7 and have migrated

From: "J. Smith" <cybersy...@gmail.com>
To: xCAT Users Mailing list <xcat-user@lists.sourceforge.net>
Date: 07/20/2017 05:48 PM
Subject: [xcat-user] Issue when running nodeset - kcmdline & initrd not set using xcat 2.13 and CentOS7

Hello,

I have installed a new version of xcat v2.13 on CentOS7 and have migrated my xcat tables from another xcat server that was running CentOS6 with xcat 2.9

The migrated data looks fine but when adding new nodes, I see some incomplete information after I run nodeset. For instance on node 113 there is no information set on kcmdline & initrd. Information copied over from xcatdump for node 102 looks fine.
Does anyone has any suggestions?

New Environment Information:

2 Managements Nodes set for HA using GPFS to share the xCAT data and I use a VIP Interface to bring up xcat services.

Virtual IP Alias Address: xcatmn 192.168.248.60
Primary Management Node: ms1 192.168.248.61
Secondary Management Node: ms2 192.168.248.62

[[hpcslurm01]root@ms1 x86_64]# lsxcatd -v
Version 2.13.3 (git commit 7f9e0b57554c3a1975b83308935b7d183c632a9d, built Thu Apr 13 01:56:07 EDT 2017)

CentOS 7
Linux ms1 3.10.0-229.el7.x86_64

[[hpcslurm01]root@ms1 x86_64]# lsdef -t site -l
Object name: clustersite
    SNsyncfiledir=/var/xcat/syncfiles
    auditnosyslog=0
    auditskipcmds=ALL
    blademaxp=64
    cleanupxcatpost=no
    consoleondemand=no
    databaseloc=/var/lib
    db2installloc=/mntdb2
    dhcpinterfaces=em3:0
    dhcplease=43200
    dnshandler=ddns
    domain=panther.net
    enableASMI=no
    forwarders=131.94.205.10,131.94.7.220
    fsptimeout=0
    installdir=/install
    ipmimaxp=64
    ipmiretries=3
    ipmitimeout=2
    master=192.168.248.60
    maxssh=8
    nameservers=192.168.248.61,192.168.248.62
    nodesyncfiledir=/var/xcat/node/syncfiles
    ntpservers=ms1,ms2
    powerinterval=0
    ppcmaxp=64
    ppcretry=3
    ppctimeout=0
    sharedtftp=1
    sshbetweennodes=ALLGROUPS
    syspowerinterval=0
    tftpdir=/tftpboot
    timezone=America/New_York
    useNmapfromMN=no
    vsftp=n
    xcatconfdir=/etc/xcat
    xcatdport=3001
    xcatiport=3002
    xcatsslversion=TLSv1

Migrated data for node 102 looks fine:
[[hpcslurm01]root@ms1 x86_64]# lsdef n102
Object name: n102
    arch=x86_64
    bmc=r102
    currstate=netboot centos6.5-x86_64-panther-pec6220
    groups=panther-pem420,dell
    hostnames=n102
    initrd=xcat/osimage/centos6.5-x86_64-netboot-panther-pec6220/initrd-stateless.gz
    installnic=em1
    ip=192.168.248.142
    kcmdline=imgurl=http://xcatmn:80//install/netboot/centos6.5/x86_64/panther-pec6220/rootimg.gz XCAT=xcatmn:3001 NODE=n102 FC=0 ifname=em1:F8:CA:B8:A9:0E:04 netdev=em1 console=tty0 console=ttyS0,115200
    kernel=xcat/osimage/centos6.5-x86_64-netboot-panther-pec6220/kernel
    mac=F8:CA:B8:A9:0E:04
    mgt=ipmi
    netboot=pxe
    os=centos6.5
    postscripts=syslog,remoteshell,otherpkgs,syncfiles,panther-bondtrunknics,panther-ldap,panther-nouserlogin,panther-engineerlicense,panther-resolv,panther-yumrepo-centos65,panther-rpms,panther-mlnx-ofed,panther-upgradegpfs-diskless-4.2.1-2,panther-setupgpfs,panther-lsf
    power=impi
    primarynic=em1
    profile="">    provmethod=centos6.5-x86_64-netboot-panther-pec6220
    serialport=0
    serialspeed=115200
    status=booted
    statustime=02-08-2017 16:57:05
    updatestatus=synced
    updatestatustime=03-30-2017 17:15:00
    xcatmaster=xcatmn

New added node 113 is not setup properly, there is no information set on kcmdline & initrd
[[hpcslurm01]root@ms1 x86_64]# lsdef n113
Object name: n113
    arch=x86_64
    bmc=r113
    currstate=netboot centos6.5-x86_64-panther-pec6220
    groups=panther-pem420,dell
    hostnames=n113
    installnic=em1
    ip=192.168.248.153
    mac=48:4D:7E:81:F2:93
    mgt=ipmi
    netboot=pxe
    os=centos6.5
    postscripts=syslog,remoteshell,otherpkgs,syncfiles,panther-bondtrunknics,panther-ldap,panther-nouserlogin,panther-engineerlicense,panther-resolv,panther-yumrepo-centos65,panther-rpms,panther-mlnx-ofed,panther-upgradegpfs-diskless-4.2.1-2,panther-setupgpfs,panther-lsf
    power=impi
    primarynic=em1
    profile="">    provmethod=centos6.5-x86_64-netboot-panther-pec6220
    serialport=0
    serialspeed=115200
    xcatmaster=xcatmn

Thanks!

------------------------------------------------------------------------------ Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org!http://sdm.link/slashdot_______________________________________________ xCAT-user mailing list xcat-u...@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/xcat-user

------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
_______________________________________________
xCAT-user mailing list
xcat-u...@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/xcat-user

------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot

_______________________________________________
xCAT-user mailing list
xcat-u...@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/xcat-user

------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
_______________________________________________
xCAT-user mailing list
xcat-u...@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/xcat-user

------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot

_______________________________________________
xCAT-user mailing list
xCAT-user@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/xcat-user

------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
_______________________________________________
xCAT-user mailing list
xCAT-user@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/xcat-user

------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot

_______________________________________________
xCAT-user mailing list
xCAT-user@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/xcat-user

------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot

_______________________________________________
xCAT-user mailing list
xCAT-user@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/xcat-user

Re: [xcat-user] Issue when running nodeset - kcmdline & initrd not set using xcat 2.13 and CentOS7

Reply via email to