Hi Adam,
You are asking whether there is a way to report from GRAM
when the last array job SGE was done, right? We got around
this problem by some internal hacking to write out the SGE
environment variable JOBID and probing that. We could do
that because it was part of a workflow. Otherwise, it will
be difficult. We are mostly using latest GT 5 versions now.
Prakashan
Adam Bazinet wrote:
Hi everyone,
Was this issue ever resolved? It is affecting our Globus installation (4.2.1)
and SGE cluster as well. Specifically, the job seems to enter the StageOut
phase prematurely (say, when 6/8 jobs in a task array are completed). Any
assistance is greatly appreciated.
thanks,
Adam
On Tue, May 27, 2008 at 12:51 PM, Korambath, Prakashan
<[email protected]<mailto:[email protected]>> wrote:
Hi Martin,
I am using gt4.0.6 on the client node. I didn't try with Fork. Let me see
how Fork behaves. Thanks.
Prakashan
-----Original Message-----
From: Martin Feller [mailto:[email protected]]
Sent: Tue 5/27/2008 9:48 AM
To: Korambath, Prakashan
Cc: gt-user; Jin, Kejian; Korambath, Prakashan
Subject: Re: [gt-user] Globus GRAM reporting status for each task in a SGE
job-job array submission
Prakashan:
GRAM should send a Done notification if the last job is done, and not when
the first job is done. I tried it here and it works as expected for me.
What GT version are you using?
This is probably not at all SGE related, but does it behave in the same way
when you submit to, say, Fork instead of SGE?
Martin
----- Original Message -----
From: "Prakashan Korambath" <[email protected]<mailto:[email protected]>>
To: "gt-user" <[email protected]<mailto:[email protected]>>, "Kejian Jin"
<[email protected]<mailto:[email protected]>>, "Prakashan Korambath"
<[email protected]<mailto:[email protected]>>
Sent: Monday, May 26, 2008 4:10:46 PM GMT -06:00 US/Canada Central
Subject: [gt-user] Globus GRAM reporting status for each task in a SGE job-job
array submission
Hi,
We noticed that Globus GRAM status reporting service (eg: globusrun-ws -status
-j job_epr) reports status as 'Done' immediately when first few tasks in a
job-array (multi jobs) are completed. Is there a way to make it wait until the
last task in the job array is completed? It is ok if all tasks are completed
within few seconds apart, but in most cases they are not and globus reports the
entire job is finished based on perhaps the reading from
$SGE_ROOT/common/reporting file when there are still tasks waiting to be run.
If there is an option to query the status of the last task in a job array it
would be nice. Thanks.
Prakashan Korambath
