Hi Globus team,

GT version: 5.0.4
jglobus version: 1.8.0

When I submit a job using jglobus' Gram API, the globus-job-manager processes seem to accumulate open files. It looks like, for each job, the job manager opens files for the stdout and stderr params in the job description (or /dev/null if not specified) and doesn't close them, even if the job is done, until the job manager shuts down.
This becomes problematic if you have active users submitting a lot of jobs.

Any ideas what would cause the job manager to keep these files open?

NOTE: The job manager does not accumulate open files if I submit a job using the C client globusrun.

I attached output from lsof as example after submitting 5 sequential jobs. stdout and stderr params of the jobs were /home/testuser/[out|err]_<UUID>. The jobs were simple /bin/hostname jobs and done when I took the lsof snapshot.

Thanks!

Martin


[root@er161-40 tmp]# lsof | grep testuser | grep home
globus-jo 23152  testuser  cwd       DIR              253,0     4096      76117 
/home/testuser
globus-jo 23153  testuser  cwd       DIR              253,0     4096      76117 
/home/testuser
globus-jo 23153  testuser    6u     unix 0xffff81000bc97980             5971386 
/home/testuser/.globus/job/er161-40.ceres.auckland.ac.nz/fork.6bd321d6.sock
globus-jo 23153  testuser    8w      REG              253,0  1801895     846923 
/home/testuser/gram_20111209.log
globus-jo 23153  testuser   11uW     REG              253,0        0     585356 
/home/testuser/.globus/job/er161-40.ceres.auckland.ac.nz/fork.6bd321d6.lock
globus-jo 23153  testuser   17w      REG              253,0       30     846966 
/home/testuser/out_10f827cf-4f1b-4422-b745-40e8b200d524
globus-jo 23153  testuser   18w      REG              253,0        0     846967 
/home/testuser/err_10f827cf-4f1b-4422-b745-40e8b200d524
globus-jo 23153  testuser   22w      REG              253,0       30     846968 
/home/testuser/out_2cac8de0-2f2e-47df-8cab-eb26c9406334
globus-jo 23153  testuser   23w      REG              253,0        0     846969 
/home/testuser/err_2cac8de0-2f2e-47df-8cab-eb26c9406334
globus-jo 23153  testuser   24w      REG              253,0       30     846971 
/home/testuser/out_11f03168-5616-45b9-bd53-6436bc00b75e
globus-jo 23153  testuser   25w      REG              253,0        0     846972 
/home/testuser/err_11f03168-5616-45b9-bd53-6436bc00b75e
globus-jo 23153  testuser   26w      REG              253,0       30     846973 
/home/testuser/out_abb4c0d8-f1ea-4e04-88a9-b2ba1e7f5b05
globus-jo 23153  testuser   27w      REG              253,0        0     846974 
/home/testuser/err_abb4c0d8-f1ea-4e04-88a9-b2ba1e7f5b05
globus-jo 23153  testuser   28w      REG              253,0       30     846976 
/home/testuser/out_a8d9598b-7f2d-41f5-9fbb-929b62e302f3
globus-jo 23153  testuser   29w      REG              253,0        0     846977 
/home/testuser/err_a8d9598b-7f2d-41f5-9fbb-929b62e302f3
perl      23155  testuser  cwd       DIR              253,0     4096      76117 
/home/testuser
perl      23155  testuser    8w      REG              253,0  1801895     846923 
/home/testuser/gram_20111209.log
perl      23155  testuser   17w      REG              253,0       30     846966 
/home/testuser/out_10f827cf-4f1b-4422-b745-40e8b200d524
perl      23155  testuser   18w      REG              253,0        0     846967 
/home/testuser/err_10f827cf-4f1b-4422-b745-40e8b200d524

Reply via email to