Hi Paul:

I followed your advises i finally i got rid of the erros.
I configured a cache name server in my master node , but now i am having a new error.

I am sending the logs .

Any ideas?

David

 

Paul Gray wrote:
On Thu, 5 Jun 2003 [EMAIL PROTECTED] wrote:

  
it is seems it is the problem.
When i did
host oscarnode2.oscardomain 127.0.0.1

i got

connection timed out; no server could be reached

But i do not understand why i need i nameserver.
    

PBS requires it to do a lookup for the client nodes.

  
Should i have to make a zone for  my nodes ( i use the private ip network
10.0.2.x )

it will be ok if i put a zone "2.0.10.in-addr.arpa" in my nameserver
    

Bingo.  As soon as your server can resolve the names, you'll be good to
go.

Now, to figure out why the name service didn't get configured correctly.
Did you install OSCAR with your server node off the net?

If you're not a bind guru, consider what I do -- I use "pdnsd".  You can
find pdnsd at rpmfind.net.  It's trivial to set up (it can even just serve
up names based only on your server's /etc/hosts file).  Just make sure
that you take out named from the startup scripts.  Using
	"chkconfig --level 123456 named off"
works.

So, a quick fix:

Download pdnsd.
Modify /etc/pdnsd.conf to use the local hostname and set it up for your
  external DNS.
shut down named  (/etc/init.d/named stop)
clear out named from the startup init's (chkconfig --level 12345 named
   off)
start pdnsd (/etc/init.d/pdnsd start)
re-run your PBS tests.

That's what worked for me when I had the same problem...5 minute fix.

Paul Gray                                         -o)
323 Wright Hall                                   /\\
University of Northern Iowa                      _\_V
  Message void if penguin violated ...  Don't mess with the penguin
  No one ever says "Hey, I can't read that ASCII e-mail ya sent me."

  


=============================================================================
== Running OSCAR install_cluster script
=============================================================================

--> OSCAR version: 2.2.1
--> Command line invocation: ./install_cluster eth1 
--> Hostname: ZEUS
--> Domainname: oscardomain
--> Network interface: eth1
--> Linux distribution: RedHat 7.2
--> Kernel version: 2.4.7-10smp
--> Architecture: i686
--> Running in directory: /root/oscar/oscar-2.2.1
--> PATH: 
/usr/local/sbin:/sbin:/usr/sbin:/bin:/usr/bin:/usr/bin/X11:/usr/local/bin:/usr/bin:/usr/X11R6/bin:/opt/env-switcher/bin:/opt/mpich-1.2.4/bin:/opt/hdf5-oscar-1.4.4-post2/bin/:/opt/kernel_picker/bin:/opt/pbs/bin:/opt/pbs/lib/xpbs/bin:/opt/pvm3/lib:/opt/pvm3/lib/LINUX:/opt/pvm3/bin/LINUX:/opt/c3-3:/root/bin:/root/bin:/bin:/usr/bin:/sbin:/usr/sbin:/usr/local/bin:/usr/local/sbin
--> Running: "./wizard_prep eth1"

=============================================================================
== Running OSCAR wizard_prep script
=============================================================================

--> Running OSCAR wizard prerequisites
--> Checking to see if we need to install HTML::Tree
--> HTML::Tree appears to be installed already
--> Checking to see if we need to install XML::Parser
--> XML::Parser appears to be installed already
--> Checking to see if we need to install XML::Simple
--> XML::Simple appears to be installed already
--> Checking to see if we need to install ODA RPMs
 [OSCAR::PackageBest :: Line 302] Reading package directory
 [OSCAR::PackageBest :: Line 314] Reading cache file.
 [OSCAR::PackageBest :: Line 327] Comparing cache to directory.
 [OSCAR::PackageBest :: Line 352] Writing new cache file.
--> Installing ODA RPMs
--> Finding available packages
--> Found packages: autoupdate, c3, disable-services, hdf5, kernel_picker, lam, 
loghost, mpich, networking, ntpconfig, oda, opium, pbs, pfilter, pvm, sis, switcher
--> Running package setup scripts
--> About to run /root/oscar/oscar-2.2.1/packages/disable-services/scripts/setup for 
disable-services
Created: 
/root/oscar/oscar-2.2.1/packages/disable-services/scripts/post_client_rpm_install
--> About to run /root/oscar/oscar-2.2.1/packages/hdf5/scripts/setup for hdf5
HDF5 will be installed
--> About to run /root/oscar/oscar-2.2.1/packages/switcher/scripts/setup for switcher
--> Successfully ran package setup scripts
Checking if the mysql database server is running ... LC_ALL=EN;/etc/init.d/mysqld 
statusrunning.
Checking for existance of the OSCAR database ...
... OSCAR database exists.
Checking if database table <oda_shortcuts> exists ... exists.
Checking if all required fields are in table <oda_shortcuts> ...
Checking for required field named <expansion> ... exists
Checking for required field named <shortcut> ... exists
Checking for existing oda shortcut <packages> in database <oda_shortcuts> ... found 
with the same expansion
Checking for existing oda shortcut <packages_that_require> in database <oda_shortcuts> 
... found with the same expansion
Checking for existing oda shortcut <switcher_list_packages_tags_names> in database 
<oda_shortcuts> ... found with the same expansion
Checking for existing oda shortcut <switcher_packages_that_provide> in database 
<oda_shortcuts> ... found with the same expansion
Checking for existing oda shortcut <switcher_this_package_provides> in database 
<oda_shortcuts> ... found with the same expansion
Checking for existing oda shortcut <this_package_requires> in database <oda_shortcuts> 
... found with the same expansion
Checking if database table <package_switcher> exists ... exists.
Checking if all required fields are in table <package_switcher> ...
Checking for required field named <name> ... exists
Checking for required field named <package> ... exists
Checking for required field named <tag> ... exists
Checking if database table <packages> exists ... exists.
Checking if all required fields are in table <packages> ...
Checking for required field named <class> ... exists
Checking for required field named <copyright> ... exists
Checking for required field named <description> ... exists
Checking for required field named <group> ... exists
Checking for required field named <installable> ... exists
Checking for required field named <license> ... exists
Checking for required field named <maintainer_email> ... exists
Checking for required field named <maintainer_name> ... exists
Checking for required field named <name> ... exists
Checking for required field named <packager_email> ... exists
Checking for required field named <packager_name> ... exists
Checking for required field named <require_name> ... exists
Checking for required field named <require_type> ... exists
Checking for required field named <summary> ... exists
Checking for required field named <url> ... exists
Checking for required field named <vendor> ... exists
Checking for required field named <version_epoch> ... exists
Checking for required field named <version_major> ... exists
Checking for required field named <version_minor> ... exists
Checking for required field named <version_release> ... exists
Checking for required field named <version_subversion> ... exists
Checking for existing package record <autoupdate> in database <package> ...found
Checking for existing package record <c3> in database <package> ...found
Checking for existing package record <disable-services> in database <package> ... no 
record
Writing new packages record <disable-services> in table <packages> ...
Checking for existing package record <hdf5> in database <package> ...found
Checking for existing package record <kernel_picker> in database <package> ...found
Checking for existing package record <lam> in database <package> ... no record
Writing new packages record <lam> in table <packages> ...
Checking for existing package record <loghost> in database <package> ...found
Checking for existing package record <mpich> in database <package> ...found
Checking for existing package record <networking> in database <package> ...found
Checking for existing package record <ntpconfig> in database <package> ...found
Checking for existing package record <oda> in database <package> ...found
Checking for existing package record <opium> in database <package> ...found
Checking for existing package record <pbs> in database <package> ...found
Checking for existing package record <pfilter> in database <package> ...found
Checking for existing package record <pvm> in database <package> ...found
Checking for existing package record <sis> in database <package> ...found
Checking for/root/oscar/oscar-2.2.1/scripts/package_config_xmls_to_database: package 
<oda> did not supply enough (or any)
specified field names with a construct like this:
<oscar>
  <fieldnames> NAMES</fieldnames>
</oscar>
config.xml construct, not storing the data in the
package/oda/shortcut having data ( packages read_records|modify_records packages 
package %+ , packages_that_require read_records packages_requires package package=%1 , 
this_package_requires read_records packages_requires package package=%1 )
/root/oscar/oscar-2.2.1/scripts/package_config_xmls_to_database: package <switcher> 
did not supply enough (or any)
specified field names with a construct like this:
<oscar>
  <fieldnames> NAMES</fieldnames>
</oscar>
config.xml construct, not storing the data in the
package/oda/shortcut having data ( switcher_packages_that_provide read_records 
package_switcher package tag=%1, switcher_this_package_provides read_records 
package_switcher tag package=%1 , switcher_list_packages_tags_names read_records 
package_switcher package tag name)
 existing package record <switcher> in database <package> ... no record
Writing new packages record <switcher> in table <packages> ...
Checking if database table <packages_package> exists ... exists.
Checking if all required fields are in table <packages_package> ...
Checking for required field named <package> ... exists
Checking if database table <packages_provides> exists ... exists.
Checking if all required fields are in table <packages_provides> ...
Checking for required field named <name> ... exists
Checking for required field named <package> ... exists
Checking for required field named <type> ... exists
Checking if database table <packages_requires> exists ... exists.
Checking if all required fields are in table <packages_requires> ...
Checking for required field named <name> ... exists
Checking for required field named <package> ... exists
Checking for required field named <type> ... exists
Checking if database table <packages_rpmlist> exists ... exists.
Checking if all required fields are in table <packages_rpmlist> ...
Checking for required field named <package> ... exists
Checking for required field named <rpm> ... exists
Checking for required field named <scope> ... exists
--> Copying RPMs to /tftpboot/rpm
--> Copying RPMs from /root/oscar/oscar-2.2.1/packages to /tftpboot/rpm
--> Successfully copied RPMs from /root/oscar/oscar-2.2.1/packages to /tftpboot/rpm
--> Identified core packages: sis switcher c3 oda
--> Returning server RPMs for sis: systemconfigurator systemimager-common 
perl-AppConfig systeminstaller systeminstaller-x11 perl-Tk perl-MLDBM syslinux 
systemimager-server systemimager-i386boot-standard systemimager-ia64boot-standard 
rsync tftp-hpa perl-XML-Simple perl-XML-Parser
--> Returning server RPMs for switcher: env-switcher modules-oscar
--> Returning server RPMs for c3: rsync c3 c3-profiled
--> Returning server RPMs for oda: mysql perl-DBD-MySQL perl-DBI oda mysql-server
 [OSCAR::PackageBest :: Line 302] Reading package directory
 [OSCAR::PackageBest :: Line 314] Reading cache file.
 [OSCAR::PackageBest :: Line 327] Comparing cache to directory.
 [OSCAR::PackageBest :: Line 352] Writing new cache file.
--> Installing server core RPMs
--> Successfully installed server core RPMs
--> Running post_server_install scripts for server core packages
Stopping rsync daemon for systemimager: rsync.
Starting rsync daemon for systemimager: rsync.
--> Successfully ran server core package post_server_install scripts
--> Successfully ran OSCAR wizard_prep script
--> Successfully ran wizard_prep
--> Running: "./oscar_wizard eth1"

=============================================================================
== Running step 7 of the OSCAR wizard: Complete cluster setup
=============================================================================

--> Step 7: Running: ./post_install
Gathering processor count from oscarnode2.oscardomain.
Updating database for machine oscarnode2.oscardomain.
Gathering processor count from oscarnode3.oscardomain.
@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
@    WARNING: REMOTE HOST IDENTIFICATION HAS CHANGED!     @
@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
IT IS POSSIBLE THAT SOMEONE IS DOING SOMETHING NASTY!
Someone could be eavesdropping on you right now (man-in-the-middle attack)!
It is also possible that the RSA host key has just been changed.
The fingerprint for the RSA key sent by the remote host is
42:c0:22:1b:fb:53:08:ea:db:ef:48:14:8c:e0:3a:8b.
Please contact your system administrator.
Add correct host key in /root/.ssh/known_hosts2 to get rid of this message.
Offending key in /root/.ssh/known_hosts2:4
Password authentication is disabled to avoid trojan horses.
X11 forwarding is disabled to avoid trojan horses.
Updating database for machine oscarnode3.oscardomain.
Gathering processor count from oscarnode4.oscardomain.
@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
@    WARNING: REMOTE HOST IDENTIFICATION HAS CHANGED!     @
@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
IT IS POSSIBLE THAT SOMEONE IS DOING SOMETHING NASTY!
Someone could be eavesdropping on you right now (man-in-the-middle attack)!
It is also possible that the RSA host key has just been changed.
The fingerprint for the RSA key sent by the remote host is
42:c0:22:1b:fb:53:08:ea:db:ef:48:14:8c:e0:3a:8b.
Please contact your system administrator.
Add correct host key in /root/.ssh/known_hosts2 to get rid of this message.
Offending key in /root/.ssh/known_hosts2:5
Password authentication is disabled to avoid trojan horses.
X11 forwarding is disabled to avoid trojan horses.
Updating database for machine oscarnode4.oscardomain.
Gathering processor count from oscarnode5.oscardomain.
@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
@    WARNING: REMOTE HOST IDENTIFICATION HAS CHANGED!     @
@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
IT IS POSSIBLE THAT SOMEONE IS DOING SOMETHING NASTY!
Someone could be eavesdropping on you right now (man-in-the-middle attack)!
It is also possible that the RSA host key has just been changed.
The fingerprint for the RSA key sent by the remote host is
42:c0:22:1b:fb:53:08:ea:db:ef:48:14:8c:e0:3a:8b.
Please contact your system administrator.
Add correct host key in /root/.ssh/known_hosts2 to get rid of this message.
Offending key in /root/.ssh/known_hosts2:6
Password authentication is disabled to avoid trojan horses.
X11 forwarding is disabled to avoid trojan horses.
Updating database for machine oscarnode5.oscardomain.
Gathering processor count from oscarnode6.oscardomain.
@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
@    WARNING: REMOTE HOST IDENTIFICATION HAS CHANGED!     @
@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
IT IS POSSIBLE THAT SOMEONE IS DOING SOMETHING NASTY!
Someone could be eavesdropping on you right now (man-in-the-middle attack)!
It is also possible that the RSA host key has just been changed.
The fingerprint for the RSA key sent by the remote host is
42:c0:22:1b:fb:53:08:ea:db:ef:48:14:8c:e0:3a:8b.
Please contact your system administrator.
Add correct host key in /root/.ssh/known_hosts2 to get rid of this message.
Offending key in /root/.ssh/known_hosts2:7
Password authentication is disabled to avoid trojan horses.
X11 forwarding is disabled to avoid trojan horses.
Updating database for machine oscarnode6.oscardomain.
Gathering processor count from oscarnode7.oscardomain.
Updating database for machine oscarnode7.oscardomain.
Gathering processor count from oscarnode8.oscardomain.
Updating database for machine oscarnode8.oscardomain.
building file list ... done
hosts
wrote 358 bytes  read 36 bytes  87.56 bytes/sec
total size is 691  speedup is 1.75
wrote 45 bytes  read 20 bytes  18.57 bytes/sec
total size is 196  speedup is 3.02
building file list ... done
10.0.2.1027951hosts
wrote 372 bytes  read 36 bytes  90.67 bytes/sec
total size is 691  speedup is 1.69
wrote 45 bytes  read 20 bytes  18.57 bytes/sec
total size is 196  speedup is 3.02
building file list ... done
10.0.2.102903710.0.2.1027951hosts
wrote 386 bytes  read 36 bytes  93.78 bytes/sec
total size is 691  speedup is 1.64
wrote 45 bytes  read 20 bytes  18.57 bytes/sec
total size is 196  speedup is 3.02
building file list ... done
10.0.2.103015010.0.2.102903710.0.2.1027951hosts
wrote 400 bytes  read 36 bytes  124.57 bytes/sec
total size is 691  speedup is 1.58
wrote 45 bytes  read 20 bytes  18.57 bytes/sec
total size is 196  speedup is 3.02
building file list ... done
10.0.2.103127310.0.2.103015010.0.2.102903710.0.2.1027951hosts
wrote 414 bytes  read 36 bytes  128.57 bytes/sec
total size is 691  speedup is 1.54
wrote 45 bytes  read 20 bytes  18.57 bytes/sec
total size is 196  speedup is 3.02
building file list ... done
10.0.2.103240110.0.2.103127310.0.2.103015010.0.2.102903710.0.2.1027951hosts
wrote 428 bytes  read 36 bytes  132.57 bytes/sec
total size is 691  speedup is 1.49
wrote 44 bytes  read 20 bytes  14.22 bytes/sec
total size is 196  speedup is 3.06
building file list ... done
10.0.2.10106210.0.2.103240110.0.2.103127310.0.2.103015010.0.2.102903710.0.2.1027951hosts
wrote 441 bytes  read 36 bytes  106.00 bytes/sec
total size is 691  speedup is 1.45
wrote 44 bytes  read 20 bytes  18.29 bytes/sec
total size is 196  speedup is 3.06
building file list ... done
10.0.2.10223510.0.2.10106210.0.2.103240110.0.2.103127310.0.2.103015010.0.2.102903710.0.2.1027951hosts
wrote 454 bytes  read 36 bytes  140.00 bytes/sec
total size is 691  speedup is 1.41
wrote 44 bytes  read 20 bytes  18.29 bytes/sec
total size is 196  speedup is 3.06
building file list ... done
10.0.2.10337210.0.2.10223510.0.2.10106210.0.2.103240110.0.2.103127310.0.2.103015010.0.2.102903710.0.2.1027951hosts
wrote 467 bytes  read 36 bytes  111.78 bytes/sec
total size is 691  speedup is 1.37
wrote 44 bytes  read 20 bytes  18.29 bytes/sec
total size is 196  speedup is 3.06
building file list ... done
10.0.2.10454410.0.2.10337210.0.2.10223510.0.2.10106210.0.2.103240110.0.2.103127310.0.2.103015010.0.2.102903710.0.2.1027951hosts
wrote 480 bytes  read 36 bytes  147.43 bytes/sec
total size is 691  speedup is 1.34
wrote 44 bytes  read 20 bytes  14.22 bytes/sec
total size is 196  speedup is 3.06
building file list ... done
10.0.2.10572410.0.2.10454410.0.2.10337210.0.2.10223510.0.2.10106210.0.2.103240110.0.2.103127310.0.2.103015010.0.2.102903710.0.2.1027951hosts
wrote 493 bytes  read 36 bytes  151.14 bytes/sec
total size is 691  speedup is 1.31
wrote 44 bytes  read 20 bytes  18.29 bytes/sec
total size is 196  speedup is 3.06
building file list ... done
10.0.2.10691010.0.2.10572410.0.2.10454410.0.2.10337210.0.2.10223510.0.2.10106210.0.2.103240110.0.2.103127310.0.2.103015010.0.2.102903710.0.2.1027951hosts
wrote 506 bytes  read 36 bytes  120.44 bytes/sec
total size is 691  speedup is 1.27
wrote 44 bytes  read 20 bytes  18.29 bytes/sec
total size is 196  speedup is 3.06
building file list ... done
10.0.2.10809010.0.2.10691010.0.2.10572410.0.2.10454410.0.2.10337210.0.2.10223510.0.2.10106210.0.2.103240110.0.2.103127310.0.2.103015010.0.2.102903710.0.2.1027951hosts
wrote 519 bytes  read 36 bytes  123.33 bytes/sec
total size is 691  speedup is 1.25
wrote 44 bytes  read 20 bytes  18.29 bytes/sec
total size is 196  speedup is 3.06
building file list ... done
10.0.2.10928210.0.2.10809010.0.2.10691010.0.2.10572410.0.2.10454410.0.2.10337210.0.2.10223510.0.2.10106210.0.2.103240110.0.2.103127310.0.2.103015010.0.2.102903710.0.2.1027951hosts
wrote 532 bytes  read 36 bytes  126.22 bytes/sec
total size is 691  speedup is 1.22
wrote 45 bytes  read 20 bytes  18.57 bytes/sec
total size is 196  speedup is 3.02
building file list ... done
10.0.2.101048110.0.2.10928210.0.2.10809010.0.2.10691010.0.2.10572410.0.2.10454410.0.2.10337210.0.2.10223510.0.2.10106210.0.2.103240110.0.2.103127310.0.2.103015010.0.2.102903710.0.2.1027951hosts
wrote 546 bytes  read 36 bytes  129.33 bytes/sec
total size is 691  speedup is 1.19
wrote 45 bytes  read 20 bytes  18.57 bytes/sec
total size is 196  speedup is 3.02
building file list ... done
10.0.2.101169010.0.2.101048110.0.2.10928210.0.2.10809010.0.2.10691010.0.2.10572410.0.2.10454410.0.2.10337210.0.2.10223510.0.2.10106210.0.2.103240110.0.2.103127310.0.2.103015010.0.2.102903710.0.2.1027951hosts
wrote 560 bytes  read 36 bytes  132.44 bytes/sec
total size is 691  speedup is 1.16
wrote 45 bytes  read 20 bytes  18.57 bytes/sec
total size is 196  speedup is 3.02
building file list ... done
10.0.2.101290010.0.2.101169010.0.2.101048110.0.2.10928210.0.2.10809010.0.2.10691010.0.2.10572410.0.2.10454410.0.2.10337210.0.2.10223510.0.2.10106210.0.2.103240110.0.2.103127310.0.2.103015010.0.2.102903710.0.2.1027951hosts
wrote 574 bytes  read 36 bytes  174.29 bytes/sec
total size is 691  speedup is 1.13
wrote 45 bytes  read 20 bytes  14.44 bytes/sec
total size is 196  speedup is 3.02
building file list ... done
10.0.2.101411610.0.2.101290010.0.2.101169010.0.2.101048110.0.2.10928210.0.2.10809010.0.2.10691010.0.2.10572410.0.2.10454410.0.2.10337210.0.2.10223510.0.2.10106210.0.2.103240110.0.2.103127310.0.2.103015010.0.2.102903710.0.2.1027951hosts
cannot create  : No such file or directory
wrote 588 bytes  read 36 bytes  178.29 bytes/sec
total size is 691  speedup is 1.11
wrote 45 bytes  read 20 bytes  14.44 bytes/sec
total size is 196  speedup is 3.02
building file list ... done
link_stat 
/tmp/10.0.2.101534110.0.2.101411610.0.2.101290010.0.2.101169010.0.2.101048110.0.2.10928210.0.2.10809010.0.2.10691010.0.2.10572410.0.2.10454410.0.2.10337210.0.2.10223510.0.2.10106210.0.2.103240110.0.2.103127310.0.2.103015010.0.2.102903710.0.2.1027951hosts
 : No such file or directory
wrote 25 bytes  read 20 bytes  10.00 bytes/sec
total size is 0  speedup is 0.00
wrote 45 bytes  read 20 bytes  18.57 bytes/sec
total size is 196  speedup is 3.02
building file list ... done
link_stat 
/tmp/10.0.2.101656510.0.2.101534110.0.2.101411610.0.2.101290010.0.2.101169010.0.2.101048110.0.2.10928210.0.2.10809010.0.2.10691010.0.2.10572410.0.2.10454410.0.2.10337210.0.2.10223510.0.2.10106210.0.2.103240110.0.2.103127310.0.2.103015010.0.2.102903710.0.2.1027951hosts
 : File name too long
wrote 25 bytes  read 20 bytes  12.86 bytes/sec
total size is 0  speedup is 0.00
wrote 45 bytes  read 20 bytes  14.44 bytes/sec
total size is 196  speedup is 3.02
sh: error while loading shared libraries: libc.so.6: cannot open shared object file: 
Error 23
bash: error while loading shared libraries: libtermcap.so.2: cannot open shared object 
file: Error 23
Traceback (most recent call last):
  File "/opt/c3-3/cpush", line 401, in ?
    answer = sock.recieve()
  File "/opt/c3-3/c3_sock.py", line 77, in recieve
    raise 'time_out'
time_out
/bin/rm: cannot remove 
`/tmp/10.0.2.101779110.0.2.101656510.0.2.101534110.0.2.101411610.0.2.101290010.0.2.101169010.0.2.101048110.0.2.10928210.0.2.10809010.0.2.10691010.0.2.10572410.0.2.10454410.0.2.10337210.0.2.10223510.0.2.10106210.0.2.103240110.0.2.103127310.0.2.103015010.0.2.102903710.0.2.1027951hosts':
 File name too long
/bin/rm: cannot remove 
`/tmp/10.0.2.101656510.0.2.101534110.0.2.101411610.0.2.101290010.0.2.101169010.0.2.101048110.0.2.10928210.0.2.10809010.0.2.10691010.0.2.10572410.0.2.10454410.0.2.10337210.0.2.10223510.0.2.10106210.0.2.103240110.0.2.103127310.0.2.103015010.0.2.102903710.0.2.1027951hosts':
 File name too long
--> About to run /root/oscar/oscar-2.2.1/packages/pfilter/scripts/post_install for 
pfilter
(re)starting the pfilter firewall service on this server
/etc/init.d/pfilter restart
Restarting pfilter:/sbin/iptables is executable but not working yet.
Perhaps you need to rmmod ipchains and insmod iptables?
(pfilter will do this for you when it starts, so you can probably ignore this)
cat: /proc/net/ip_tables_names: No such file or directory
[  OK  ]
pushing out the clients pfilter firewall configuration file
. /etc/profile.d/c3.sh && cpush /etc/pfilter.conf.clients /etc/pfilter.conf
building file list ... done
pfilter.conf.clients
wrote 543 bytes  read 36 bytes  165.43 bytes/sec
total size is 916  speedup is 1.58
wrote 45 bytes  read 20 bytes  14.44 bytes/sec
total size is 196  speedup is 3.02
building file list ... done
10.0.2.1028861pfilter.conf.clients
wrote 557 bytes  read 36 bytes  131.78 bytes/sec
total size is 916  speedup is 1.54
wrote 45 bytes  read 20 bytes  18.57 bytes/sec
total size is 196  speedup is 3.02
building file list ... done
10.0.2.102995910.0.2.1028861pfilter.conf.clients
wrote 571 bytes  read 36 bytes  173.43 bytes/sec
total size is 916  speedup is 1.51
wrote 45 bytes  read 20 bytes  18.57 bytes/sec
total size is 196  speedup is 3.02
building file list ... done
10.0.2.103109310.0.2.102995910.0.2.1028861pfilter.conf.clients
wrote 585 bytes  read 36 bytes  138.00 bytes/sec
total size is 916  speedup is 1.48
wrote 45 bytes  read 20 bytes  18.57 bytes/sec
total size is 196  speedup is 3.02
building file list ... done
10.0.2.103223010.0.2.103109310.0.2.102995910.0.2.1028861pfilter.conf.clients
wrote 599 bytes  read 36 bytes  181.43 bytes/sec
total size is 916  speedup is 1.44
wrote 43 bytes  read 20 bytes  14.00 bytes/sec
total size is 196  speedup is 3.11
building file list ... done
10.0.2.1089510.0.2.103223010.0.2.103109310.0.2.102995910.0.2.1028861pfilter.conf.clients
wrote 611 bytes  read 36 bytes  184.86 bytes/sec
total size is 916  speedup is 1.42
wrote 44 bytes  read 20 bytes  18.29 bytes/sec
total size is 196  speedup is 3.06
building file list ... done
10.0.2.10208910.0.2.1089510.0.2.103223010.0.2.103109310.0.2.102995910.0.2.1028861pfilter.conf.clients
wrote 624 bytes  read 36 bytes  188.57 bytes/sec
total size is 916  speedup is 1.39
wrote 44 bytes  read 20 bytes  18.29 bytes/sec
total size is 196  speedup is 3.06
building file list ... done
10.0.2.10325110.0.2.10208910.0.2.1089510.0.2.103223010.0.2.103109310.0.2.102995910.0.2.1028861pfilter.conf.clients
wrote 637 bytes  read 36 bytes  192.29 bytes/sec
total size is 916  speedup is 1.36
wrote 44 bytes  read 20 bytes  14.22 bytes/sec
total size is 196  speedup is 3.06
building file list ... done
10.0.2.10446110.0.2.10325110.0.2.10208910.0.2.1089510.0.2.103223010.0.2.103109310.0.2.102995910.0.2.1028861pfilter.conf.clients
wrote 650 bytes  read 36 bytes  196.00 bytes/sec
total size is 916  speedup is 1.34
wrote 44 bytes  read 20 bytes  14.22 bytes/sec
total size is 196  speedup is 3.06
building file list ... done
10.0.2.10568410.0.2.10446110.0.2.10325110.0.2.10208910.0.2.1089510.0.2.103223010.0.2.103109310.0.2.102995910.0.2.1028861pfilter.conf.clients
wrote 663 bytes  read 36 bytes  155.33 bytes/sec
total size is 916  speedup is 1.31
wrote 44 bytes  read 20 bytes  18.29 bytes/sec
total size is 196  speedup is 3.06
building file list ... done
10.0.2.10691510.0.2.10568410.0.2.10446110.0.2.10325110.0.2.10208910.0.2.1089510.0.2.103223010.0.2.103109310.0.2.102995910.0.2.1028861pfilter.conf.clients
wrote 676 bytes  read 36 bytes  203.43 bytes/sec
total size is 916  speedup is 1.29
wrote 44 bytes  read 20 bytes  14.22 bytes/sec
total size is 196  speedup is 3.06
building file list ... done
10.0.2.10814310.0.2.10691510.0.2.10568410.0.2.10446110.0.2.10325110.0.2.10208910.0.2.1089510.0.2.103223010.0.2.103109310.0.2.102995910.0.2.1028861pfilter.conf.clients
wrote 689 bytes  read 36 bytes  161.11 bytes/sec
total size is 916  speedup is 1.26
wrote 44 bytes  read 20 bytes  18.29 bytes/sec
total size is 196  speedup is 3.06
building file list ... done
10.0.2.10938210.0.2.10814310.0.2.10691510.0.2.10568410.0.2.10446110.0.2.10325110.0.2.10208910.0.2.1089510.0.2.103223010.0.2.103109310.0.2.102995910.0.2.1028861pfilter.conf.clients
wrote 702 bytes  read 36 bytes  210.86 bytes/sec
total size is 916  speedup is 1.24
wrote 45 bytes  read 20 bytes  14.44 bytes/sec
total size is 196  speedup is 3.02
switcher/1.0.9(69):ERROR:102: Tcl command execution failed: if { $have_switcher && ! 
$am_removing } {
  set announce_output [exec switcher --announce]
  if { $announce_output != ""} {
    puts "$announce_output"
  }

  # Now invoke the switcher perl script to get a list of the modules
  # that need to be loaded.  If we get a non-empty string back, load
  # them.  Only do this if we're loading the module.

  set modules_to_load [exec switcher --show-exec]
  if { $modules_to_load != "" } {
    module load $modules_to_load
  }
}

ssh_askpass: pipe: Too many open files in system
unexpected EOF in read_timeout
ssh_askpass: pipe: Too many open files in system
unexpected EOF in read_timeout
sh: error while loading shared libraries: libtermcap.so.2: cannot open shared object 
file: Error 23
sh: error while loading shared libraries: libdl.so.2: cannot open shared object file: 
Error 23
bash: error while loading shared libraries: libc.so.6: cannot open shared object file: 
Error 23
Traceback (most recent call last):
  File "/opt/c3-3/cpush", line 439, in ?
    answer = sock.recieve()
  File "/opt/c3-3/c3_sock.py", line 77, in recieve
    raise 'time_out'
time_out
(re)starting the pfilter firewall service on the clients
. /etc/profile.d/c3.sh && cexec /etc/init.d/pfilter restart
bash: /bin/awk: Too many open files in system
/opt/modules/3.1.6/bin/modulecmd: error while loading shared libraries: libc.so.6: 
cannot open shared object file: Error 23
Traceback (most recent call last):
  File "/opt/c3-3/cget", line 27, in ?
    import os, c3_com_obj, c3_file_obj, socket, re, c3_sock
  File "/opt/c3-3/c3_sock.py", line 2, in ?
    from select import select
ImportError: /usr/lib/python2.1/lib-dynload/selectmodule.so: cannot open shared object 
file: Too many open files in system
*************************  oscar_cluster  *************************
Traceback (most recent call last):
  File "/opt/c3-3/cexec", line 354, in ?
    answer = sock.recieve()
  File "/opt/c3-3/c3_sock.py", line 77, in recieve
    raise 'time_out'
time_out
*************************  oscar_cluster  *************************
Traceback (most recent call last):
  File "/opt/c3-3/cexec", line 375, in ?
    os.unlink( filename ) # remove local temp file
OSError: [Errno 2] No such file or directory: '/tmp/10.0.2.1024893'
*************************  oscar_cluster  *************************
Traceback (most recent call last):
  File "/opt/c3-3/cexec", line 375, in ?
    os.unlink( filename ) # remove local temp file
OSError: [Errno 2] No such file or directory: '/tmp/10.0.2.1024150'
*************************  oscar_cluster  *************************
Traceback (most recent call last):
  File "/opt/c3-3/cexec", line 375, in ?
    os.unlink( filename ) # remove local temp file
OSError: [Errno 2] No such file or directory: '/tmp/10.0.2.1023417'
*************************  oscar_cluster  *************************
Traceback (most recent call last):
  File "/opt/c3-3/cexec", line 375, in ?
    os.unlink( filename ) # remove local temp file
OSError: [Errno 2] No such file or directory: '/tmp/10.0.2.1022695'
*************************  oscar_cluster  *************************
Traceback (most recent call last):
  File "/opt/c3-3/cexec", line 375, in ?
    os.unlink( filename ) # remove local temp file
OSError: [Errno 2] No such file or directory: '/tmp/10.0.2.1021972'
*************************  oscar_cluster  *************************
Traceback (most recent call last):
  File "/opt/c3-3/cexec", line 375, in ?
    os.unlink( filename ) # remove local temp file
OSError: [Errno 2] No such file or directory: '/tmp/10.0.2.1021262'
*************************  oscar_cluster  *************************
Traceback (most recent call last):
  File "/opt/c3-3/cexec", line 375, in ?
    os.unlink( filename ) # remove local temp file
OSError: [Errno 2] No such file or directory: '/tmp/10.0.2.1020566'
*************************  oscar_cluster  *************************
Traceback (most recent call last):
  File "/opt/c3-3/cexec", line 375, in ?
    os.unlink( filename ) # remove local temp file
OSError: [Errno 2] No such file or directory: '/tmp/10.0.2.1019873'
*************************  oscar_cluster  *************************
Traceback (most recent call last):
  File "/opt/c3-3/cexec", line 375, in ?
    os.unlink( filename ) # remove local temp file
OSError: [Errno 2] No such file or directory: '/tmp/10.0.2.1019190'
*************************  oscar_cluster  *************************
Traceback (most recent call last):
  File "/opt/c3-3/cexec", line 375, in ?
    os.unlink( filename ) # remove local temp file
OSError: [Errno 2] No such file or directory: '/tmp/10.0.2.1018536'
--> About to run /root/oscar/oscar-2.2.1/packages/ntpconfig/scripts/post_install for 
ntpconfig
switcher/1.0.9(69):ERROR:102: Tcl command execution failed: if { $have_switcher && ! 
$am_removing } {
  set announce_output [exec switcher --announce]
  if { $announce_output != ""} {
    puts "$announce_output"
  }

  # Now invoke the switcher perl script to get a list of the modules
  # that need to be loaded.  If we get a non-empty string back, load
  # them.  Only do this if we're loading the module.

  set modules_to_load [exec switcher --show-exec]
  if { $modules_to_load != "" } {
    module load $modules_to_load
  }
}

ssh_askpass: pipe: Too many open files in system
*************************  oscar_cluster  *************************
Traceback (most recent call last):
  File "/opt/c3-3/cexec", line 354, in ?
    answer = sock.recieve()
  File "/opt/c3-3/c3_sock.py", line 77, in recieve
    raise 'time_out'
time_out
*************************  oscar_cluster  *************************
Traceback (most recent call last):
  File "/opt/c3-3/cexec", line 375, in ?
    os.unlink( filename ) # remove local temp file
OSError: [Errno 2] No such file or directory: '/tmp/10.0.2.101689'
*************************  oscar_cluster  *************************
Traceback (most recent call last):
  File "/opt/c3-3/cexec", line 375, in ?
    os.unlink( filename ) # remove local temp file
OSError: [Errno 2] No such file or directory: '/tmp/10.0.2.10899'
*************************  oscar_cluster  *************************
Traceback (most recent call last):
  File "/opt/c3-3/cexec", line 375, in ?
    os.unlink( filename ) # remove local temp file
OSError: [Errno 2] No such file or directory: '/tmp/10.0.2.1032622'
*************************  oscar_cluster  *************************
Traceback (most recent call last):
  File "/opt/c3-3/cexec", line 375, in ?
    os.unlink( filename ) # remove local temp file
OSError: [Errno 2] No such file or directory: '/tmp/10.0.2.1031882'
*************************  oscar_cluster  *************************
Traceback (most recent call last):
  File "/opt/c3-3/cexec", line 375, in ?
    os.unlink( filename ) # remove local temp file
OSError: [Errno 2] No such file or directory: '/tmp/10.0.2.1031155'
*************************  oscar_cluster  *************************
Traceback (most recent call last):
  File "/opt/c3-3/cexec", line 375, in ?
    os.unlink( filename ) # remove local temp file
OSError: [Errno 2] No such file or directory: '/tmp/10.0.2.1030431'
*************************  oscar_cluster  *************************
Traceback (most recent call last):
  File "/opt/c3-3/cexec", line 375, in ?
    os.unlink( filename ) # remove local temp file
OSError: [Errno 2] No such file or directory: '/tmp/10.0.2.1029719'
*************************  oscar_cluster  *************************
Traceback (most recent call last):
  File "/opt/c3-3/cexec", line 375, in ?
    os.unlink( filename ) # remove local temp file
OSError: [Errno 2] No such file or directory: '/tmp/10.0.2.1029029'
*************************  oscar_cluster  *************************
Traceback (most recent call last):
  File "/opt/c3-3/cexec", line 375, in ?
    os.unlink( filename ) # remove local temp file
OSError: [Errno 2] No such file or directory: '/tmp/10.0.2.1028371'
Script /root/oscar/oscar-2.2.1/packages/ntpconfig/scripts/post_install exitted badly 
with exit code '1' at ./post_install line 42
Couldn't run 'post_install' script for ntpconfig at ./post_install line 43
--> About to run /root/oscar/oscar-2.2.1/packages/opium/scripts/post_install for opium
building file list ... done
passwd
wrote 703 bytes  read 36 bytes  211.14 bytes/sec
total size is 1535  speedup is 2.08
wrote 44 bytes  read 20 bytes  14.22 bytes/sec
total size is 196  speedup is 3.06
building file list ... done
10.0.2.104661passwd
wrote 716 bytes  read 36 bytes  214.86 bytes/sec
total size is 1535  speedup is 2.04
wrote 44 bytes  read 20 bytes  14.22 bytes/sec
total size is 196  speedup is 3.06
building file list ... done
10.0.2.10581410.0.2.104661passwd
wrote 729 bytes  read 36 bytes  218.57 bytes/sec
total size is 1535  speedup is 2.01
wrote 44 bytes  read 20 bytes  14.22 bytes/sec
total size is 196  speedup is 3.06
building file list ... done
10.0.2.10701910.0.2.10581410.0.2.104661passwd
wrote 742 bytes  read 36 bytes  172.89 bytes/sec
total size is 1535  speedup is 1.97
wrote 44 bytes  read 20 bytes  18.29 bytes/sec
total size is 196  speedup is 3.06
building file list ... done
10.0.2.10823210.0.2.10701910.0.2.10581410.0.2.104661passwd
wrote 755 bytes  read 36 bytes  226.00 bytes/sec
total size is 1535  speedup is 1.94
wrote 44 bytes  read 20 bytes  14.22 bytes/sec
total size is 196  speedup is 3.06
building file list ... done
10.0.2.10948110.0.2.10823210.0.2.10701910.0.2.10581410.0.2.104661passwd
wrote 768 bytes  read 36 bytes  229.71 bytes/sec
total size is 1535  speedup is 1.91
wrote 45 bytes  read 20 bytes  14.44 bytes/sec
total size is 196  speedup is 3.02
/usr/X11R6/bin/xauth: (stdin):1:  bad display name "ZEUS.oscardomain:237.0" in "add" 
command
bash: /usr/bin/id: Too many open files in system
bash: /usr/bin/id: Too many open files in system
bash: /usr/bin/id: Too many open files in system
bash: [: too many arguments
bash: /usr/bin/whoami: Too many open files in system
bash: pipe error: Too many open files in system
bash: /opt/modules/3.1.6/bin/modulecmd: Too many open files in system
building file list ... done
10.0.2.101075110.0.2.10948110.0.2.10823210.0.2.10701910.0.2.10581410.0.2.104661passwd
wrote 782 bytes  read 36 bytes  233.71 bytes/sec
total size is 1535  speedup is 1.88
/usr/X11R6/bin/xauth: (stdin):1:  bad display name "ZEUS.oscardomain:237.0" in "add" 
command
bash: /usr/bin/id: Too many open files in system
bash: /usr/bin/id: Too many open files in system
bash: /usr/bin/id: Too many open files in system
bash: [: too many arguments
bash: /usr/bin/whoami: Too many open files in system
bash: pipe error: Too many open files in system
bash: /opt/modules/3.1.6/bin/modulecmd: Too many open files in system
wrote 45 bytes  read 20 bytes  18.57 bytes/sec
total size is 196  speedup is 3.02
id: cannot find name for group ID 0
id: cannot find name for user ID 0
whoami: cannot find username for UID 0
bash: /bin/awk: Too many open files in system
sed: error while loading shared libraries: libc.so.6: cannot open shared object file: 
Error 23
/opt/modules/3.1.6/bin/modulecmd: error while loading shared libraries: libdl.so.2: 
cannot open shared object file: Error 23
'import site' failed; use -v for traceback
Traceback (most recent call last):
  File "/opt/c3-3/cpush", line 27, in ?
    import os, c3_com_obj, c3_file_obj, c3_sock, socket, re
  File "/opt/c3-3/c3_com_obj.py", line 1, in ?
    import re, sys
  File "/usr/lib/python2.1/re.py", line 28, in ?
    from sre import *
  File "/usr/lib/python2.1/sre.py", line 17, in ?
    import sre_compile
  File "/usr/lib/python2.1/sre_compile.py", line 13, in ?
    from sre_constants import *
ImportError: No module named sre_constants
Traceback (most recent call last):
  File "/opt/c3-3/cpush", line 439, in ?
    answer = sock.recieve()
  File "/opt/c3-3/c3_sock.py", line 77, in recieve
    raise 'time_out'
time_out
building file list ... done
group
wrote 404 bytes  read 36 bytes  97.78 bytes/sec
total size is 620  speedup is 1.41
wrote 45 bytes  read 20 bytes  18.57 bytes/sec
total size is 196  speedup is 3.02
building file list ... done
10.0.2.1015956group
wrote 418 bytes  read 36 bytes  129.71 bytes/sec
total size is 620  speedup is 1.37
wrote 45 bytes  read 20 bytes  14.44 bytes/sec
total size is 196  speedup is 3.02
building file list ... done
10.0.2.101708610.0.2.1015956group
wrote 432 bytes  read 36 bytes  104.00 bytes/sec
total size is 620  speedup is 1.32
wrote 45 bytes  read 20 bytes  18.57 bytes/sec
total size is 196  speedup is 3.02
building file list ... done
10.0.2.101828110.0.2.101708610.0.2.1015956group
wrote 446 bytes  read 36 bytes  137.71 bytes/sec
total size is 620  speedup is 1.29
wrote 45 bytes  read 20 bytes  14.44 bytes/sec
total size is 196  speedup is 3.02
id: error while loading shared libraries: libc.so.6: cannot open shared object file: 
Error 23
id: error while loading shared libraries: libc.so.6: cannot open shared object file: 
Error 23
building file list ... done
id: error while loading shared libraries: libc.so.6: cannot open shared object file: 
Error 23
bash: [: too many arguments
whoami: error while loading shared libraries: libc.so.6: cannot open shared object 
file: Error 23
bash: /bin/sed: Too many open files in system
bash: /bin/awk: Too many open files in system
/opt/modules/3.1.6/bin/modulecmd: error while loading shared libraries: libtcl.so.0: 
cannot open shared object file: Error 23
10.0.2.101950910.0.2.101828110.0.2.101708610.0.2.1015956group
wrote 460 bytes  read 36 bytes  141.71 bytes/sec
total size is 620  speedup is 1.25
id: error while loading shared libraries: libc.so.6: cannot open shared object file: 
Error 23
id: error while loading shared libraries: libc.so.6: cannot open shared object file: 
Error 23
id: error while loading shared libraries: libc.so.6: cannot open shared object file: 
Error 23
bash: [: too many arguments
whoami: error while loading shared libraries: libc.so.6: cannot open shared object 
file: Error 23
bash: /bin/sed: Too many open files in system
awk: error while loading shared libraries: libm.so.6: cannot open shared object file: 
Error 23
/opt/modules/3.1.6/bin/modulecmd: error while loading shared libraries: libtcl.so.0: 
cannot open shared object file: Error 23
wrote 45 bytes  read 20 bytes  18.57 bytes/sec
total size is 196  speedup is 3.02
sed: error while loading shared libraries: libc.so.6: cannot open shared object file: 
Error 23
awk: error while loading shared libraries: libc.so.6: cannot open shared object file: 
Error 23
/opt/modules/3.1.6/bin/modulecmd: error while loading shared libraries: libc.so.6: 
cannot open shared object file: Error 23
Traceback (most recent call last):
  File "/opt/c3-3/cpush", line 27, in ?
    import os, c3_com_obj, c3_file_obj, c3_sock, socket, re
  File "/usr/lib/python2.1/socket.py", line 41, in ?
    from _socket import *
ImportError: libssl.so.2: cannot open shared object file: Too many open files in system
Traceback (most recent call last):
  File "/opt/c3-3/cpush", line 439, in ?
    answer = sock.recieve()
  File "/opt/c3-3/c3_sock.py", line 77, in recieve
    raise 'time_out'
time_out
building file list ... done
shadow
wrote 405 bytes  read 36 bytes  98.00 bytes/sec
total size is 1084  speedup is 2.46
wrote 45 bytes  read 20 bytes  18.57 bytes/sec
total size is 196  speedup is 3.02
building file list ... done
10.0.2.1023736shadow
wrote 419 bytes  read 36 bytes  101.11 bytes/sec
total size is 1084  speedup is 2.38
wrote 45 bytes  read 20 bytes  18.57 bytes/sec
total size is 196  speedup is 3.02
building file list ... done
10.0.2.102490410.0.2.1023736shadow
wrote 433 bytes  read 36 bytes  104.22 bytes/sec
total size is 1084  speedup is 2.31
wrote 45 bytes  read 20 bytes  18.57 bytes/sec
total size is 196  speedup is 3.02
switcher/1.0.9(69):ERROR:102: Tcl command execution failed: if { $have_switcher && ! 
$am_removing } {
  set announce_output [exec switcher --announce]
  if { $announce_output != ""} {
    puts "$announce_output"
  }

  # Now invoke the switcher perl script to get a list of the modules
  # that need to be loaded.  If we get a non-empty string back, load
  # them.  Only do this if we're loading the module.

  set modules_to_load [exec switcher --show-exec]
  if { $modules_to_load != "" } {
    module load $modules_to_load
  }
}

ssh_askpass: pipe: Too many open files in system
unexpected EOF in read_timeout
ssh_askpass: pipe: Too many open files in system
unexpected EOF in read_timeout
ssh_askpass: exec(/usr/libexec/openssh/ssh-askpass): Too many open files in system
Write failed: Broken pipe
Traceback (most recent call last):
  File "/opt/c3-3/cpush", line 439, in ?
    answer = sock.recieve()
  File "/opt/c3-3/c3_sock.py", line 77, in recieve
    raise 'time_out'
time_out
building file list ... done
gshadow
wrote 316 bytes  read 36 bytes  100.57 bytes/sec
total size is 507  speedup is 1.44
wrote 45 bytes  read 20 bytes  18.57 bytes/sec
total size is 196  speedup is 3.02
building file list ... done
10.0.2.1029185gshadow
wrote 330 bytes  read 36 bytes  104.57 bytes/sec
total size is 507  speedup is 1.39
wrote 45 bytes  read 20 bytes  14.44 bytes/sec
total size is 196  speedup is 3.02
building file list ... done
10.0.2.103036910.0.2.1029185gshadow
wrote 344 bytes  read 36 bytes  108.57 bytes/sec
total size is 507  speedup is 1.33
wrote 45 bytes  read 20 bytes  14.44 bytes/sec
total size is 196  speedup is 3.02
ssh_askpass: pipe: Too many open files in system
Traceback (most recent call last):
  File "/opt/c3-3/cpush", line 401, in ?
    answer = sock.recieve()
  File "/opt/c3-3/c3_sock.py", line 77, in recieve
    raise 'time_out'
time_out
building file list ... done
switcher.ini
wrote 241 bytes  read 36 bytes  79.14 bytes/sec
total size is 193  speedup is 0.70
wrote 44 bytes  read 20 bytes  14.22 bytes/sec
total size is 196  speedup is 3.06
switcher/1.0.9(69):ERROR:102: Tcl command execution failed: if { $have_switcher && ! 
$am_removing } {
  set announce_output [exec switcher --announce]
  if { $announce_output != ""} {
    puts "$announce_output"
  }

  # Now invoke the switcher perl script to get a list of the modules
  # that need to be loaded.  If we get a non-empty string back, load
  # them.  Only do this if we're loading the module.

  set modules_to_load [exec switcher --show-exec]
  if { $modules_to_load != "" } {
    module load $modules_to_load
  }
}

building file list ... done
10.0.2.101904switcher.ini
wrote 254 bytes  read 36 bytes  82.86 bytes/sec
total size is 193  speedup is 0.67
switcher/1.0.9(69):ERROR:102: Tcl command execution failed: if { $have_switcher && ! 
$am_removing } {
  set announce_output [exec switcher --announce]
  if { $announce_output != ""} {
    puts "$announce_output"
  }

  # Now invoke the switcher perl script to get a list of the modules
  # that need to be loaded.  If we get a non-empty string back, load
  # them.  Only do this if we're loading the module.

  set modules_to_load [exec switcher --show-exec]
  if { $modules_to_load != "" } {
    module load $modules_to_load
  }
}

wrote 44 bytes  read 20 bytes  14.22 bytes/sec
total size is 196  speedup is 3.06
switcher/1.0.9(69):ERROR:102: Tcl command execution failed: if { $have_switcher && ! 
$am_removing } {
  set announce_output [exec switcher --announce]
  if { $announce_output != ""} {
    puts "$announce_output"
  }

  # Now invoke the switcher perl script to get a list of the modules
  # that need to be loaded.  If we get a non-empty string back, load
  # them.  Only do this if we're loading the module.

  set modules_to_load [exec switcher --show-exec]
  if { $modules_to_load != "" } {
    module load $modules_to_load
  }
}

Unknown user                                                                           
                          .
Traceback (most recent call last):
  File "/opt/c3-3/cpush", line 401, in ?
    answer = sock.recieve()
  File "/opt/c3-3/c3_sock.py", line 77, in recieve
    raise 'time_out'
time_out
--> About to run /root/oscar/oscar-2.2.1/packages/switcher/scripts/post_install for 
switcher
Setting default for tag mpi ("mpich-1.2.4")
Attribute successfully set; new attribute setting will be effective for
future shells
building file list ... done
switcher.ini
wrote 241 bytes  read 36 bytes  61.56 bytes/sec
total size is 193  speedup is 0.70
wrote 44 bytes  read 20 bytes  18.29 bytes/sec
total size is 196  speedup is 3.06
awk: error while loading shared libraries: libm.so.6: cannot open shared object file: 
Error 23
ModuleCmd_Load.c(199):ERROR:105: Unable to locate a modulefile for 'oscar-modules'
Unknown user                                                                           
                          .
unexpected EOF in read_timeout
Unknown user                                                                           
                          .
unexpected EOF in read_timeout
ssh_askpass: pipe: Too many open files in system
Traceback (most recent call last):
  File "/opt/c3-3/cpush", line 439, in ?
    answer = sock.recieve()
  File "/opt/c3-3/c3_sock.py", line 77, in recieve
    raise 'time_out'
time_out
--> About to run /root/oscar/oscar-2.2.1/packages/loghost/scripts/post_install for 
loghost
switcher/1.0.9(69):ERROR:102: Tcl command execution failed: if { $have_switcher && ! 
$am_removing } {
  set announce_output [exec switcher --announce]
  if { $announce_output != ""} {
    puts "$announce_output"
  }

  # Now invoke the switcher perl script to get a list of the modules
  # that need to be loaded.  If we get a non-empty string back, load
  # them.  Only do this if we're loading the module.

  set modules_to_load [exec switcher --show-exec]
  if { $modules_to_load != "" } {
    module load $modules_to_load
  }
}

ssh_askpass: pipe: Too many open files in system
*************************  oscar_cluster  *************************
Traceback (most recent call last):
  File "/opt/c3-3/cexec", line 354, in ?
    answer = sock.recieve()
  File "/opt/c3-3/c3_sock.py", line 77, in recieve
    raise 'time_out'
time_out
*************************  oscar_cluster  *************************
Traceback (most recent call last):
  File "/opt/c3-3/cexec", line 375, in ?
    os.unlink( filename ) # remove local temp file
OSError: [Errno 2] No such file or directory: '/tmp/10.0.2.107643'
Script /root/oscar/oscar-2.2.1/packages/loghost/scripts/post_install exitted badly 
with exit code '1' at ./post_install line 42
Couldn't run 'post_install' script for loghost at ./post_install line 43
--> About to run /root/oscar/oscar-2.2.1/packages/pbs/scripts/post_install for pbs
sh: /dev/null: Too many open files in system
sh: /usr/X11R6/bin/xauth: Too many open files in system
bash: /usr/bin/id: Too many open files in system
bash: /usr/bin/id: Too many open files in system
bash: /usr/bin/id: Too many open files in system
bash: [: too many arguments
bash: /usr/bin/whoami: Too many open files in system
bash: pipe error: Too many open files in system
bash: /opt/modules/3.1.6/bin/modulecmd: Too many open files in system
python2: error while loading shared libraries: libc.so.6: cannot open shared object 
file: Error 23
Traceback (most recent call last):
  File "/opt/c3-3/cpush", line 401, in ?
    answer = sock.recieve()
  File "/opt/c3-3/c3_sock.py", line 77, in recieve
    raise 'time_out'
time_out
sh: /dev/null: Too many open files in system
sh: /usr/X11R6/bin/xauth: Too many open files in system
bash: /usr/bin/id: Too many open files in system
bash: /usr/bin/id: Too many open files in system
bash: /usr/bin/id: Too many open files in system
bash: [: too many arguments
bash: /usr/bin/whoami: Too many open files in system
bash: pipe error: Too many open files in system
bash: /opt/modules/3.1.6/bin/modulecmd: Too many open files in system
python2: error while loading shared libraries: libc.so.6: cannot open shared object 
file: Error 23
Traceback (most recent call last):
  File "/opt/c3-3/cexec", line 354, in ?
    answer = sock.recieve()
  File "/opt/c3-3/c3_sock.py", line 77, in recieve
    raise 'time_out'
time_out
PBS mom config file updated with clienthost: ZEUS.oscardomain
Pushing config file to clients...
Sending SIGHUP to all moms...
*************************  oscar_cluster  *************************
Updating pbs_server nodes
/opt/pbs/bin/pbsnodes: Server has no node list
create node oscarnode2.oscardomain np = 2 , properties = all
create node oscarnode3.oscardomain np = 2 , properties = all
create node oscarnode4.oscardomain np = 2 , properties = all
create node oscarnode5.oscardomain np = 2 , properties = all
create node oscarnode6.oscardomain np = 2 , properties = all
create node oscarnode7.oscardomain np = 2 , properties = all
create node oscarnode8.oscardomain np = 2 , properties = all
Creating pbs workq queue...
Max open servers: 4
create queue workq
set queue workq queue_type = Execution
set queue workq resources_max.cput = 10000:00:00
set queue workq resources_max.walltime = 10000:00:00
set queue workq resources_min.cput = 00:00:01
set queue workq resources_min.ncpus = 1
set queue workq resources_min.nodect = 1
set queue workq resources_min.walltime = 00:00:01
set queue workq resources_default.cput = 10000:00:00
set queue workq resources_default.ncpus = 1
set queue workq resources_default.nodect = 1
set queue workq resources_default.walltime = 10000:00:00
set queue workq enabled = True
set queue workq started = True
set server scheduling = True
set server default_queue = workq
set server query_other_jobs = True
set queue workq resources_max.ncpus = 14
set queue workq resources_max.nodect = 7
set queue workq resources_available.nodect = 7
set server resources_available.ncpus = 14
set server resources_available.nodect = 7
set server resources_available.nodes = 7
set server resources_max.ncpus = 14
set server resources_max.nodes = 7
set server scheduler_iteration = 60
Some of the post install scripts failed, please check your logs for more info at 
./post_install line 48
--> Step 7: Failed to properly complete the cluster install; please check the logs

Reply via email to