Dear Wang Xiaopeng,
Thank you for your support.
My xCAT server's environment is following.
- lenovo x3650 m5
- Xeon E5-2620v3 2.4GHz 12cores
- Memory 64GB
- network bandwidth of install network
- 4GbE (1GbE*4) bond0 (mode: 802.3ad (eth0, eth1, eth2, eth3))
Is this machine's performance insufficiency to install 50nodes over ?
Best Regards,
Keiichi Suzuki.
---------------------------------------------------------------------
Then it was a performance issue.
What's the network bandwidth of your install network?
What was the usage of cpu and memory during the OS deployment?
Thanks
Best Regards
----------------------------------------------------------------------
Wang Xiaopeng (王?朋)
IBM China System Technology Laboratory
Tel: 86-10-82453455
Email: wxp@...
Address: 28,ZhongGuanCun Software Park,No.8 Dong Bei Wang West Road,
Haidian District Beijing P.R.China 100193
----- Original message -----
From: "Keiichi Suzuki" <KEISUZU@...>
To: xcat-user@...
Cc:
Subject: Re: [xcat-user] Fail to rinstall node on NextScale nx360m5
Date: Thu, Apr 28, 2016 11:54 AM
Dear Wang Xiaopeng,
Thank you for your support.
50 nodes were performing installing in parallel. (wherever feasible, I
hope 300nodes are wanted to install in parallel)
Failed node ,in parallel, succed to install individually. (one node at
one time)
Best Regards,
Keiichi Suzuki.
----------------------------------------------------------------------
How many nodes you were performing installing in parallel?
Will it succeed if you run the OS install for failed node individually?
(one node at one time)
Thanks
Best Regards
----------------------------------------------------------------------
Wang Xiaopeng (‰????)
IBM China System Technology Laboratory
Tel: 86-10-82453455
Email: wxp@...
Address: 28,ZhongGuanCun Software Park,No.8 Dong Bei Wang West Road,
Haidian District Beijing P.R.China 100193
----- Original message -----
From: "Keiichi Suzuki" <KEISUZU@...>
To: xcat-user@...
Cc:
Subject: [xcat-user] Fail to rinstall node on NextScale nx360m5
Date: Wed, Apr 27, 2016 11:47 AM
I want to install SL6.7 to node on NextScale nx360m5.
I can install SL6.7 to 1-30nodes successfully. But I can't install
30nodes over with following messages.
(ex. Error messages on one of failed node)
Unable to download the kickstart file. Please modify the kickstart
parameter below or press Cansel to procees as an interactive installation.
http://10.35.37.27:80/install/autoinst/testnode005
Please help me what to do to install successfully.
I write detail, following.
***********************************************************
1) Background / I want to do
- I want to install SL6.7 to 300nodes on NextScale nx360m5, using xCAT.
- It was success to install OS 1-30nodes.
- It was failed to install OS 30nodes over.
2) Environment (xCAT server)
- Lenovo system x3550 (Mem.64GB)
- xCAT 2.11 (OS is RHEL7.2)
I customized following parameter.
- cat /etc/sysconfig/nfs
> RPCNFSDCOUNT=100
- /proc/sys/net/core/rmem_default
16777216
- /proc/sys/net/core/rmem_max
16777216
- /proc/sys/net/core/wmem_default
16777216
- /proc/sys/net/core/wmem_max
16777216
- ulimit -a
core file size (blocks, -c) unlimited
data seg size (kbytes, -d) unlimited
scheduling priority (-e) 0
file size (blocks, -f) unlimited
pending signals (-i) 16371
max locked memory (kbytes, -l) unlimited
max memory size (kbytes, -m) unlimited
open files (-n) 65536
pipe size (512 bytes, -p) 8
POSIX message queues (bytes, -q) 819200
real-time priority (-r) 0
stack size (kbytes, -s) unlimited
cpu time (seconds, -t) unlimited
max user processes (-u) 16371
virtual memory (kbytes, -v) unlimited
file locks (-x) unlimited
- /etc/http/conf/httpd.conf
Timeout 120
KeepAlive Off
MaxKeepAliveRequests 100
KeepAliveTimeout 15
<IfModule prefork.c>
StartServers 80
MinSpareServers 50
MaxSpareServers 200
ServerLimit 512
MaxClients 512
MaxRequestsPerChild 8000
</IfModule>
<IfModule worker.c>
StartServers 80
MaxClients 512
MinSpareThreads 50
MaxSpareThreads 200
ThreadsPerChild 50
MaxRequestsPerChild 0
</IfModule>
3) Environment(xCAT client)
- Lenovo NextScale n360m5
- SL6.7
4) xCAT settings
[root@... ~]# tabdump site
#key,value,comments,disable
blademaxp,"64",,
domain,"test.jp",,
fsptimeout,"0",,
installdir,"/install",,
ipmimaxp,"64",,
ipmiretries,"3",,
ipmitimeout,"2",,
consoleondemand,"no",,
master,"192.168.37.27",,
nameservers,"192.168.37.27",,
maxssh,"8",,
ppcmaxp,"64",,
ppcretry,"3",,
ppctimeout,"0",,
sharedtftp,"1",,
SNsyncfiledir,"/var/xcat/syncfiles",,
tftpdir,"/tftpboot",,
xcatdport,"3001",,
xcatiport,"3002",,
xcatconfdir,"/etc/xcat",,
timezone,"Asia/Tokyo",,
useNmapfromMN,"no",,
enableASMI,"no",,
db2installloc,"/mntdb2",,
databaseloc,"/var/lib",,
sshbetweennodes,"ALLGROUPS",,
dnshandler,"ddns",,
vsftp,"y",,
cleanupxcatpost,"no",,
dhcpinterfaces,"bond0",,
***********************************************************
Best Regards,
Keiichi Suzuki.
------------------------------------------------------------------------------
Find and fix application performance issues faster with Applications
Manager
Applications Manager provides deep performance insights into multiple
tiers of
your business applications. It resolves application problems quickly
and
reduces your MTTR. Get your free trial!
https://ad.doubleclick.net/ddm/clk/302982198;130105516;z
;
_______________________________________________
xCAT-user mailing list
xCAT-user@...
https://lists.sourceforge.net/lists/listinfo/xcat-user
;
------------------------------------------------------------------------------
Find and fix application performance issues faster with Applications
Manager
Applications Manager provides deep performance insights into multiple
tiers of
your business applications. It resolves application problems quickly
and
reduces your MTTR. Get your free trial!
https://ad.doubleclick.net/ddm/clk/302982198;130105516;z
;
_______________________________________________
xCAT-user mailing list
xCAT-user@...
https://lists.sourceforge.net/lists/listinfo/xcat-user
;
------------------------------------------------------------------------------
Find and fix application performance issues faster with Applications Manager
Applications Manager provides deep performance insights into multiple tiers of
your business applications. It resolves application problems quickly and
reduces your MTTR. Get your free trial!
https://ad.doubleclick.net/ddm/clk/302982198;130105516;z
_______________________________________________
xCAT-user mailing list
xCAT-user@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/xcat-user
