Hi All,
We have some jobs that we'd like to run that need to open about 5000 files
simultaneously. When they're run outside the
grid they run fine but when run with qsub they fail. I've run ulimit -H -n
inside and outside to see why this might be.
On our head node (foxtrot):
$ cat test.sh
#!/bin/bash
ulimit -H -n
$ ./test.sh
65536
$ qsub -q longrun.q@foxtrot -cwd -S /bin/bash ./test.sh
Your job 215227 ("test.sh") has been submitted
$ cat test.sh.o215227
4096
$ grep nofile /etc/security/limits.conf
# - nofile - max number of open files
* soft nofile 16384
* hard nofile 65536
So the above shows that there is a limit of 4096 being set by GridEngine on the
max number of open files, but I haven't
been able to find where this is being set in order to change it. Can anyone
point me in the right direction? I'm
running Ubuntu 12.04 with 6.2u5-4 from the Ubuntu repos and the Open Grid
Scheduler hwloc drop-in upgrade[1].
Thanks,
Rob
[1] http://gridscheduler.sourceforge.net/projects/hwloc/GridEnginehwloc.html
--
Robert Hutton
Senior Systems and Database Administrator
Centre for Genomics and Global Health <http://cggh.org>
The Wellcome Trust Centre for Human Genetics
Roosevelt Drive
Oxford
OX3 7BN
United Kingdom
Tel: +44 (0)1865 287721
_______________________________________________
users mailing list
[email protected]
https://gridengine.org/mailman/listinfo/users
