Hi Globus team,
GT version: 5.0.4
jglobus version: 1.8.0
When I submit a job using jglobus' Gram API, the globus-job-manager
processes seem to accumulate open files.
It looks like, for each job, the job manager opens files for the stdout
and stderr params in the job description (or /dev/null if not specified)
and doesn't close them, even if the job is done, until the job manager
shuts down.
This becomes problematic if you have active users submitting a lot of jobs.
Any ideas what would cause the job manager to keep these files open?
NOTE: The job manager does not accumulate open files if I submit a job
using the C client globusrun.
I attached output from lsof as example after submitting 5 sequential
jobs. stdout and stderr params of the jobs were
/home/testuser/[out|err]_<UUID>. The jobs were simple /bin/hostname jobs
and done when I took the lsof snapshot.
Thanks!
Martin
[root@er161-40 tmp]# lsof | grep testuser | grep home
globus-jo 23152 testuser cwd DIR 253,0 4096 76117
/home/testuser
globus-jo 23153 testuser cwd DIR 253,0 4096 76117
/home/testuser
globus-jo 23153 testuser 6u unix 0xffff81000bc97980 5971386
/home/testuser/.globus/job/er161-40.ceres.auckland.ac.nz/fork.6bd321d6.sock
globus-jo 23153 testuser 8w REG 253,0 1801895 846923
/home/testuser/gram_20111209.log
globus-jo 23153 testuser 11uW REG 253,0 0 585356
/home/testuser/.globus/job/er161-40.ceres.auckland.ac.nz/fork.6bd321d6.lock
globus-jo 23153 testuser 17w REG 253,0 30 846966
/home/testuser/out_10f827cf-4f1b-4422-b745-40e8b200d524
globus-jo 23153 testuser 18w REG 253,0 0 846967
/home/testuser/err_10f827cf-4f1b-4422-b745-40e8b200d524
globus-jo 23153 testuser 22w REG 253,0 30 846968
/home/testuser/out_2cac8de0-2f2e-47df-8cab-eb26c9406334
globus-jo 23153 testuser 23w REG 253,0 0 846969
/home/testuser/err_2cac8de0-2f2e-47df-8cab-eb26c9406334
globus-jo 23153 testuser 24w REG 253,0 30 846971
/home/testuser/out_11f03168-5616-45b9-bd53-6436bc00b75e
globus-jo 23153 testuser 25w REG 253,0 0 846972
/home/testuser/err_11f03168-5616-45b9-bd53-6436bc00b75e
globus-jo 23153 testuser 26w REG 253,0 30 846973
/home/testuser/out_abb4c0d8-f1ea-4e04-88a9-b2ba1e7f5b05
globus-jo 23153 testuser 27w REG 253,0 0 846974
/home/testuser/err_abb4c0d8-f1ea-4e04-88a9-b2ba1e7f5b05
globus-jo 23153 testuser 28w REG 253,0 30 846976
/home/testuser/out_a8d9598b-7f2d-41f5-9fbb-929b62e302f3
globus-jo 23153 testuser 29w REG 253,0 0 846977
/home/testuser/err_a8d9598b-7f2d-41f5-9fbb-929b62e302f3
perl 23155 testuser cwd DIR 253,0 4096 76117
/home/testuser
perl 23155 testuser 8w REG 253,0 1801895 846923
/home/testuser/gram_20111209.log
perl 23155 testuser 17w REG 253,0 30 846966
/home/testuser/out_10f827cf-4f1b-4422-b745-40e8b200d524
perl 23155 testuser 18w REG 253,0 0 846967
/home/testuser/err_10f827cf-4f1b-4422-b745-40e8b200d524