Hello Bai, I've enabled the debugmode and made a system provision. I'm reading the log right now, but I also attached relevant parts of the log to this e-mail.
Thanks for all the help, Regards, Hakan On 10/12/2017 01:02 PM, Yuan Y Bai wrote: > Hi Hakan, > > Run updatenode to synchronize the files : "updatenode <nodename> -F -V" . > Other tips: `remoteshell` is running before `syncfiles` in postscripts, > `remoteshell` will start up the sshd for syncfiles postscript to do the > sync work. you can look if there is error during running remoteshell, > "updatenode <nodename> remoteshell" > > If you got nothing from updatenode, after open xcatdebugmode, you can > re-provision the node, and look into the xcat.log for all postscript > remoteshell/syncfiles may help. > > In `syncfiles`, it calls `startsyncfiles.awk` using openssl. > > > Best Regards > -------------------------------------------------- > Yuan Bai (白媛) > > CSTL HPC System Management Development > Tel:86-10-82451401 > E-mail: by...@cn.ibm.com > Address: IBM ZGC Campus. Ring Building 28, > ZhongGuanCun Software Park,No.8 Dong Bei Wang West Road, Haidian District, > Beijing P.R.China 100193 > > IBM环宇大厦 > 北京市海淀区东北旺西路8号，中关村软件园28号楼 > 邮编:100193 > > > > ----- Original message ----- > From: Hakan Bayındır <hakan.bayin...@tubitak.gov.tr> > To: xCAT Users Mailing list <xcat-user@lists.sourceforge.net>, Xiao > Peng Wang <w...@cn.ibm.com> > Cc: > Subject: Re: [xcat-user] Problem with syncfiles after install. > Date: Thu, Oct 12, 2017 5:32 PM > > Hello Again, > > After enabling debuglevel with the suggestion of Yuan, I noticed that > syncfiles also doesn't work after update, but with a different error. > The complete log is below. > > server1: Thu Oct 12 12:29:27 +03 2017 Running postscript: syncfiles > server1: + '[' -d /.statelite ']' > server1: + '[' -f /etc/os-release ']' > server1: + cat /etc/os-release > server1: + grep -i -e '^NAME=[ "'\'']*Cumulus Linux[ "'\'']*$' > server1: + '[' -n 1 ']' > server1: + '[' 1 -eq 1 ']' > server1: + logger -t xcat -p local4.err './syncfiles: Did not sync any > files. Use updatenode -F to sync the files.' > server1: + exit 0 > server1: postscript: syncfiles exited with code 0 > server1: Running of postscripts has completed. > > Regards, > > Hakan > > On 10/12/2017 11:34 AM, Hakan Bayındır wrote: > > Hello Wang, > > > > When I run 'updatenode <node> -P syncfiles' after automated > install and > > reboot, the process runs without any problems. The log is below. > > > > server1: xcatdsklspost: downloaded postscripts successfully > > server1: Thu Oct 12 11:30:16 +03 2017 Running postscript: syncfiles > > server1: postscript: syncfiles exited with code 0 > > server1: Running of postscripts has completed. > > > > Regards, > > > > Hakan > > > > On 10/11/2017 01:34 PM, Xiao Peng Wang wrote: > >> xdcp -F calls the 'rsync' to sync files to CN directly from MN. But > >> during the OS deployment, a postscript named 'syncfiles' is > executed in > >> compute node side. > >> > >> You may try 'updatenode <node> -P syncfiles'. And could you paste > the log? > >> > >> Best Regards > >> > ---------------------------------------------------------------------- > >> Wang Xiaopeng (王晓朋) > >> > >> Manager for HPC SW Dev: xCAT, ESSL, SMI, Test > >> IBM China Systems Laboratory (CSL) > >> > >> Tel: 86-10-82453455 > >> Email: w...@cn.ibm.com > >> > >> > >> > >> ----- Original message ----- > >> From: Hakan Bayındır <hakan.bayin...@tubitak.gov.tr> > >> To: xcat-user@lists.sourceforge.net > >> Cc: > >> Subject: Re: [xcat-user] Problem with syncfiles after install. > >> Date: Wed, Oct 11, 2017 2:13 PM > >> > >> Hello Wang, > >> > >> I guessed that they're different, but don't know the details > abut the > >> differences. I tested with xdcp anyway to be sure that my > syncfile is > >> correct. > >> > >> Is there any way to debug syncfiles further? > >> > >> Thanks in advance, > >> > >> Hakan > >> > >> On 10/10/2017 05:57 PM, Xiao Peng Wang wrote: > >> > One thing to be aware that using xdcp -F is different with the > >> syncfile > >> > process during OS deployment. > >> > > >> > Best Regards > >> > > ---------------------------------------------------------------------- > >> > Wang Xiaopeng (王晓朋) > >> > > >> > Manager for HPC SW Dev: xCAT, ESSL, SMI, Test > >> > IBM China Systems Laboratory (CSL) > >> > > >> > Tel: 86-10-82453455 > >> > Email: w...@cn.ibm.com > >> > > >> > > >> > > >> > ----- Original message ----- > >> > From: Russ Auld <russa...@comcast.net> > >> > To: xCAT Users Mailing list > <xcat-user@lists.sourceforge.net> > >> > Cc: > >> > Subject: Re: [xcat-user] Problem with syncfiles after > install. > >> > Date: Tue, Oct 10, 2017 7:17 PM > >> > > >> > Typically this is indicative of a problem with ssh > >> connectivity between > >> > the compute node and the master/service node. > >> > Ensure that DNS is also working correctly. > >> > > >> > On Mon, 2017-10-09 at 19:00 +0300, Hakan Bayındır wrote: > >> > > Hello All, > >> > > > >> > > I'm having a problem with the default syncfiles > script, which is > >> > > fired by default as a "postscript" after an > installation. The > >> > > installation completes as it should be and the system > reboots, > >> > > however I get an error in the xcat.log which states > that the > >> > > syncfiles have returned 1, hence failed. The strange > thing > >> is, when I > >> > > fire the same syncfile with xdcp, everything works as it > >> should. Did > >> > > anyone had this error and nudge me in the right > direction? > >> > > > >> > > Best regards, > >> > > > >> > > Hakan > >> > > > >> > > Hakan BAYINDIR > >> > > Uzman Araştırmacı > >> > > Ağ Teknolojileri Birimi > >> > > YÖK Binası B-5 Blok Kat:4 > >> > > 06539 Bilkent ANKARA > >> > > T +90 312 298 9373 > >> > > F +90 312 266 5181 > >> > > [ > >> > > >> > > https://urldefense.proofpoint.com/v2/url?u=http-3A__www.ulakbim.gov.tr_&d=DwIGaQ&c=jf_iaSHvJObTbx-siA1ZOg&r=178VMrolfAlMh59RUGWQ4w&m=l7Ul6dv91Ff5_6PZBSWmfgvE6bVWX6QQzOXqenGV4jE&s=J6K2ffHm0Jm29fFeOyQp-hggkr_YHQfohHuRVUtCy3Q&e= > | > >> > www.ulakbim.gov.tr ] > >> > > hakan.bayin...@tubitak.gov.tr > >> > > > >> > ..................................................................... > >> > > > ........................................................... > >> > > > >> > > [ > >> > > >> > > https://urldefense.proofpoint.com/v2/url?u=http-3A__www.ulakbim.gov.tr_&d=DwIGaQ&c=jf_iaSHvJObTbx-siA1ZOg&r=178VMrolfAlMh59RUGWQ4w&m=l7Ul6dv91Ff5_6PZBSWmfgvE6bVWX6QQzOXqenGV4jE&s=J6K2ffHm0Jm29fFeOyQp-hggkr_YHQfohHuRVUtCy3Q&e= > ] > >> > > [ > >> > > >> > > https://urldefense.proofpoint.com/v2/url?u=http-3A__www.tubitak.gov.tr_sorumlulukreddi&d=DwIGaQ&c=jf_iaSHvJObTbx-siA1ZOg&r=178VMrolfAlMh59RUGWQ4w&m=l7Ul6dv91Ff5_6PZBSWmfgvE6bVWX6QQzOXqenGV4jE&s=X1PvO5UA5EIZma9wQQ-7Daf9LWCzEzRNp3VLqIMBqc4&e= > | > >> > > Sorumluluk Reddi ] > >> > > > >> > > > >> > ------------------------------------------------------------------- > >> > > ----------- > >> > > Check out the vibrant tech community on one of the > world's most > >> > > engaging tech sites, Slashdot.org! > >> > > >> > > https://urldefense.proofpoint.com/v2/url?u=http-3A__sdm.link_slashdot&d=DwIGaQ&c=jf_iaSHvJObTbx-siA1ZOg&r=178VMrolfAlMh59RUGWQ4w&m=l7Ul6dv91Ff5_6PZBSWmfgvE6bVWX6QQzOXqenGV4jE&s=GdwB33kriDHKDlBuKHx051_0AI_Rd4Ifm89G-ou6FUU&e= > >> > > _______________________________________________ > >> > > xCAT-user mailing list > >> > > xCAT-user@lists.sourceforge.net > >> > > > >> > > >> > > https://urldefense.proofpoint.com/v2/url?u=https-3A__lists.sourceforge.net_lists_listinfo_xcat-2Duser&d=DwIGaQ&c=jf_iaSHvJObTbx-siA1ZOg&r=178VMrolfAlMh59RUGWQ4w&m=l7Ul6dv91Ff5_6PZBSWmfgvE6bVWX6QQzOXqenGV4jE&s=3xM66Ed2EAjR4sHpz4DtDUanrCtY2mygM6_P130WwPY&e= > >> > > >> > > >> > > ------------------------------------------------------------------------------ > >> > Check out the vibrant tech community on one of the > world's most > >> > engaging tech sites, Slashdot.org! > >> > > >> > > https://urldefense.proofpoint.com/v2/url?u=http-3A__sdm.link_slashdot&d=DwIGaQ&c=jf_iaSHvJObTbx-siA1ZOg&r=178VMrolfAlMh59RUGWQ4w&m=l7Ul6dv91Ff5_6PZBSWmfgvE6bVWX6QQzOXqenGV4jE&s=GdwB33kriDHKDlBuKHx051_0AI_Rd4Ifm89G-ou6FUU&e= > >> > _______________________________________________ > >> > xCAT-user mailing list > >> > xCAT-user@lists.sourceforge.net > >> > > >> > > https://urldefense.proofpoint.com/v2/url?u=https-3A__lists.sourceforge.net_lists_listinfo_xcat-2Duser&d=DwIGaQ&c=jf_iaSHvJObTbx-siA1ZOg&r=178VMrolfAlMh59RUGWQ4w&m=l7Ul6dv91Ff5_6PZBSWmfgvE6bVWX6QQzOXqenGV4jE&s=3xM66Ed2EAjR4sHpz4DtDUanrCtY2mygM6_P130WwPY&e= > >> > > >> > > >> > > >> > > >> > > >> > > >> > > >> > > ------------------------------------------------------------------------------ > >> > Check out the vibrant tech community on one of the world's most > >> > engaging tech sites, Slashdot.org! http://sdm.link/slashdot > >> > > >> > > >> > > >> > _______________________________________________ > >> > xCAT-user mailing list > >> > xCAT-user@lists.sourceforge.net > >> > https://lists.sourceforge.net/lists/listinfo/xcat-user > >> > > >> > >> -- > >> *Hakan BAYINDIR* > >> Başuzman Araştırmacı > >> Ağ Teknolojileri Birimi > >> TÜBİTAK ULAKBİM > >> T.C. Bilim, Sanayi ve Teknoloji Bakanlığı (Eski Bina) > >> Mustafa Kemal Mahallesi Dumlupınar Bulvarı > >> (Eskişehir Yolu 7.Km) 2151.Cadde No:154 > >> ODTÜ Karşısı > >> 06510 Çankaya, ANKARA > >> T +90 312 298 9373 > >> F +90 312 266 5181 > >> www.ulakbim.gov.tr <http://www.ulakbim.gov.tr> > >> hakan.bayin...@tubitak.gov.tr > >> > > ................................................................................................................................ > >> > >> <http://www.tubitak.gov.tr> > >> > >> Sorumluluk Reddi <http://www.tubitak.gov.tr/sorumlulukreddi> > >> > >> > >> > > ------------------------------------------------------------------------------ > >> Check out the vibrant tech community on one of the world's most > >> engaging tech sites, Slashdot.org! http://sdm.link/slashdot > >> _______________________________________________ > >> xCAT-user mailing list > >> xCAT-user@lists.sourceforge.net > >> https://lists.sourceforge.net/lists/listinfo/xcat-user > >> > >> > >> > >> > >> > >> > > ------------------------------------------------------------------------------ > >> Check out the vibrant tech community on one of the world's most > >> engaging tech sites, Slashdot.org! http://sdm.link/slashdot > >> > >> > >> > >> _______________________________________________ > >> xCAT-user mailing list > >> xCAT-user@lists.sourceforge.net > >> https://lists.sourceforge.net/lists/listinfo/xcat-user > >> > > > > > > > > > > ------------------------------------------------------------------------------ > > Check out the vibrant tech community on one of the world's most > > engaging tech sites, Slashdot.org! http://sdm.link/slashdot > > > > > > > > _______________________________________________ > > xCAT-user mailing list > > xCAT-user@lists.sourceforge.net > > https://lists.sourceforge.net/lists/listinfo/xcat-user > > > > -- > *Hakan BAYINDIR* > Başuzman Araştırmacı > Ağ Teknolojileri Birimi > TÜBİTAK ULAKBİM > T.C. Bilim, Sanayi ve Teknoloji Bakanlığı (Eski Bina) > Mustafa Kemal Mahallesi Dumlupınar Bulvarı > (Eskişehir Yolu 7.Km) 2151.Cadde No:154 > ODTÜ Karşısı > 06510 Çankaya, ANKARA > T +90 312 298 9373 > F +90 312 266 5181 > www.ulakbim.gov.tr <http://www.ulakbim.gov.tr> > hakan.bayin...@tubitak.gov.tr > > ................................................................................................................................ > > <http://www.tubitak.gov.tr> > > Sorumluluk Reddi <http://www.tubitak.gov.tr/sorumlulukreddi> > > > > ------------------------------------------------------------------------------ > Check out the vibrant tech community on one of the world's most > engaging tech sites, Slashdot.org! http://sdm.link/slashdot > _______________________________________________ > xCAT-user mailing list > xCAT-user@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/xcat-user > > > > > > ------------------------------------------------------------------------------ > Check out the vibrant tech community on one of the world's most > engaging tech sites, Slashdot.org! http://sdm.link/slashdot > > > > _______________________________________________ > xCAT-user mailing list > xCAT-user@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/xcat-user > -- *Hakan BAYINDIR* Başuzman Araştırmacı Ağ Teknolojileri Birimi TÜBİTAK ULAKBİM T.C. Bilim, Sanayi ve Teknoloji Bakanlığı (Eski Bina) Mustafa Kemal Mahallesi Dumlupınar Bulvarı (Eskişehir Yolu 7.Km) 2151.Cadde No:154 ODTÜ Karşısı 06510 Çankaya, ANKARA T +90 312 298 9373 F +90 312 266 5181 www.ulakbim.gov.tr <http://www.ulakbim.gov.tr> hakan.bayin...@tubitak.gov.tr ................................................................................................................................ <http://www.tubitak.gov.tr> Sorumluluk Reddi <http://www.tubitak.gov.tr/sorumlulukreddi>
Fri Oct 13 15:17:12 +03 2017 postscript remoteshell return with 0 ++ return 0 ++ run_ps postscript syncfiles ++ local ret_local=0 ++ mkdir -p /var/log/xcat ++ chown root:root /var/log/xcat ++ local logfile=/var/log/xcat/xcat.log ++ local scriptype=postscript ++ shift ++ '[' -z postscript ']' ++ '[' -f syncfiles ']' +++ date ++ msgutil_r <xCAT MN> info 'Fri Oct 13 15:17:12 +03 2017 Running postscript: syncfiles' /var/log/xcat/xcat.log ++ local logserver=<xCAT MN> ++ local msgtype=info ++ local 'msgstr=Fri Oct 13 15:17:12 +03 2017 Running postscript: syncfiles' ++ local logfile=/var/log/xcat/xcat.log ++ '[' -z info ']' ++ '[' -n <xCAT MN> ']' ++ '[' -f /etc/os-release ']' ++ cat /etc/os-release ++ grep -i NAME ++ grep -i Ubuntu ++ logger -n <xCAT MN> -t xcat -p local4.info 'Fri Oct 13 15:17:12 +03 2017 Running postscript: syncfiles' ++ '[' 0 '!=' 0 ']' ++ '[' -n /var/log/xcat/xcat.log ']' +++ dirname /var/log/xcat/xcat.log ++ local logdir=/var/log/xcat ++ '[' '!' -d /var/log/xcat ']' ++ echo 'Fri Oct 13 15:17:12 +03 2017 Running postscript: syncfiles' Fri Oct 13 15:17:12 +03 2017 Running postscript: syncfiles ++ '[' 2 = 1 ']' ++ '[' 2 = 2 ']' +++ file syncfiles ++ local 'compt=syncfiles: Bourne-Again shell script, ASCII text executable' ++ local 'reg=shell script' ++ [[ syncfiles: Bourne-Again shell script, ASCII text executable =~ shell script ]] ++ bash -x ./syncfiles + '[' -d /.statelite ']' + '[' -f /etc/os-release ']' + cat /etc/os-release + grep -i -e '^NAME=[ "'\'']*Cumulus Linux[ "'\'']*$' + '[' -n 0 ']' + '[' 0 -eq 1 ']' + '[' -n '' ']' + logger -t xcat -p local4.info 'Performing syncfiles postscript' ++ uname + osname=Linux + xcatpostdir=/xcatpost + logger -t xcat -p local4.info './syncfiles: the OS name = Linux' + quit=no + count=5 + returncode=0 + '[' no = no ']' + '[' Linux = Linux ']' ++ /xcatpost/startsyncfiles.awk + returncode=1 + '[' 1 -eq 0 ']' + '[' 5 -eq 0 ']' + let SLI=1815%10 + let SLI=SLI+10 + sleep 15 + let count=count-1 + '[' no = no ']' + '[' Linux = Linux ']' ++ /xcatpost/startsyncfiles.awk + returncode=1 + '[' 1 -eq 0 ']' + '[' 4 -eq 0 ']' + let SLI=7394%10 + let SLI=SLI+10 + sleep 14 + let count=count-1 + '[' no = no ']' + '[' Linux = Linux ']' ++ /xcatpost/startsyncfiles.awk + returncode=1 + '[' 1 -eq 0 ']' + '[' 3 -eq 0 ']' + let SLI=24508%10 + let SLI=SLI+10 + sleep 18 + let count=count-1 + '[' no = no ']' + '[' Linux = Linux ']' ++ /xcatpost/startsyncfiles.awk + returncode=1 + '[' 1 -eq 0 ']' + '[' 2 -eq 0 ']' + let SLI=14000%10 + let SLI=SLI+10 + sleep 10 + let count=count-1 + '[' no = no ']' + '[' Linux = Linux ']' ++ /xcatpost/startsyncfiles.awk + returncode=1 + '[' 1 -eq 0 ']' + '[' 1 -eq 0 ']' + let SLI=29625%10 + let SLI=SLI+10 + sleep 15 + let count=count-1 + '[' no = no ']' + '[' Linux = Linux ']' ++ /xcatpost/startsyncfiles.awk + returncode=1 + '[' 1 -eq 0 ']' + '[' 0 -eq 0 ']' + quit=yes + let count=count-1 + '[' yes = no ']' + '[' 1 -eq 0 ']' + logger -t xcat -p local4.err './syncfiles: Perform Syncing File action encountered error' + '[' 1 -eq 0 ']' ++ ret_local=1 ++ '[' 1 -ne 0 ']' ++ return_value=1 +++ date ++ msgutil_r <xCAT MN> info 'Fri Oct 13 15:18:42 +03 2017 postscript syncfiles return with 1' /var/log/xcat/xcat.log ++ local logserver=<xCAT MN> ++ local msgtype=info ++ local 'msgstr=Fri Oct 13 15:18:42 +03 2017 postscript syncfiles return with 1' ++ local logfile=/var/log/xcat/xcat.log ++ '[' -z info ']' ++ '[' -n <xCAT MN> ']' ++ '[' -f /etc/os-release ']' ++ cat /etc/os-release ++ grep -i NAME ++ grep -i Ubuntu ++ logger -n <xCAT MN> -t xcat -p local4.info 'Fri Oct 13 15:18:42 +03 2017 postscript syncfiles return with 1' ++ '[' 0 '!=' 0 ']' ++ '[' -n /var/log/xcat/xcat.log ']' +++ dirname /var/log/xcat/xcat.log ++ local logdir=/var/log/xcat ++ '[' '!' -d /var/log/xcat ']' ++ echo 'Fri Oct 13 15:18:42 +03 2017 postscript syncfiles return with 1' Fri Oct 13 15:18:42 +03 2017 postscript syncfiles return with 1
signature.asc
Description: OpenPGP digital signature
------------------------------------------------------------------------------ Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot
_______________________________________________ xCAT-user mailing list xCAT-user@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/xcat-user
