Hello,

It seems like job dependency on array jobs doesn't work quite as I
expected.

If I submit an array job with 10 elements to it, and then a separate
"collect my data" job with a dependency=afterok:array-job, that job
starts when any of the array jobs finishes, and thus collects just part
of the result.

However, if I query slurm for the actual JOBIDs of the array jobs, and
put that into the --dependency, it works. That presents another problem
with large array jobs though - there's a 1024 character limit for
--dependency, as we saw in messages:
slurmctld[9962]: job_create_request: strlen(dependency) too big (1402 >
1024)

So I'm wondering if it should work with having the parent array jobid as
dependency?

Can the dependency list use ranges, and if yes, is there a way to query
slurm for the proper jobid range for an array job? This is to try and
get around the 1024 character limit.

I have scripts that will reproduce the above, if it would be of
interest?

With best regards,
Andreas Loong

--------------------------------------------------------------------------
Confidentiality Notice: This message is private and may contain confidential 
and proprietary information. If you have received this message in error, please 
notify us and remove it from your system and note that you must not copy, 
distribute or take any action in reliance on it. Any unauthorized use or 
disclosure of the contents of this message is not permitted and may be unlawful.
 

Reply via email to