Job arrays are probably your best option. For documentation see:
http://slurm.schedmd.com/job_array.html
Moe Jette
SchedMD LLC
Quoting "Yoon, Jong Seo" <[email protected]>:
Hi everyone,
I have a script that I would like to run in parallel in a lot of directories.
For example, right now I am doing ./run.sh 001, ./run.sh 002 ...
where 001 and 002 is the name of the directory.
I have tried using srun -multi-prog option which does what I want by
running all directories simultaneously, but in squeue it shows as
one job, thus not allowing me to pause or stop individual processes
within the script.
I would like to have it so that it executes script in a parallel
fashion and shows it as different jobs in one single script.
How do I use array to achieve this? Is array the right choice?
Thank you!