Re: [slurm-users] srun jobfarming hassle question

2023-01-19 Thread Ohlerich, Martin
rs im Auftrag von Bjørn-Helge Mevik Gesendet: Donnerstag, 19. Januar 2023 08:23 An: slurm-us...@schedmd.com Betreff: Re: [slurm-users] srun jobfarming hassle question "Ohlerich, Martin" writes: > Hello Björn-Helge. > > > Sigh ... > > First of all, of course, many tha

Re: [slurm-users] srun jobfarming hassle question

2023-01-18 Thread Bjørn-Helge Mevik
"Ohlerich, Martin" writes: > Hello Björn-Helge. > > > Sigh ... > > First of all, of course, many thanks! This indeed helped a lot! Good! > b) This only works if I have to specify --mem for a task. Although > manageable, I wonder why one needs to be that restrictive. In > principle, in the use c

Re: [slurm-users] srun jobfarming hassle question

2023-01-18 Thread Ohlerich, Martin
Intel advertised it ... 😏 ). Maybe I should reconsider that. Thank you for this input! KR, Martin Von: slurm-users im Auftrag von Ward Poelmans Gesendet: Mittwoch, 18. Januar 2023 15:35 An: slurm-users@lists.schedmd.com Betreff: Re: [slurm-users] srun jobfar

Re: [slurm-users] srun jobfarming hassle question

2023-01-18 Thread Ward Poelmans
On 18/01/2023 15:22, Ohlerich, Martin wrote: But Magnus (Thanks for the Link!) is right. This is still far away from a feature rich job- or task-farming concept, where at least some overview of the passed/failed/missing task statistics is available etc. GNU parallel has log output and options

Re: [slurm-users] srun jobfarming hassle question

2023-01-18 Thread Ohlerich, Martin
ds, Martin ____ Von: slurm-users im Auftrag von Ward Poelmans Gesendet: Mittwoch, 18. Januar 2023 15:00 An: slurm-users@lists.schedmd.com Betreff: Re: [slurm-users] srun jobfarming hassle question Hi Martin, Just a tip: use gnu parallel instead of a for loop. Much easier and more powerful. Like: parallel -j $SLURM_NTASKS srun -N 1 -n 1 -c 1 --exact ::: *.input Ward

Re: [slurm-users] srun jobfarming hassle question

2023-01-18 Thread Ward Poelmans
Hi Martin, Just a tip: use gnu parallel instead of a for loop. Much easier and more powerful. Like: parallel -j $SLURM_NTASKS srun -N 1 -n 1 -c 1 --exact ::: *.input Ward smime.p7s Description: S/MIME Cryptographic Signature

Re: [slurm-users] srun jobfarming hassle question

2023-01-18 Thread Ohlerich, Martin
ttwoch, 18. Januar 2023 13:49 An: slurm-us...@schedmd.com Betreff: Re: [slurm-users] srun jobfarming hassle question "Ohlerich, Martin" writes: > Dear Colleagues, > > > already for quite some years now are we again and again facing issues on our > clusters with so-called job

Re: [slurm-users] srun jobfarming hassle question

2023-01-18 Thread Bjørn-Helge Mevik
"Ohlerich, Martin" writes: > Dear Colleagues, > > > already for quite some years now are we again and again facing issues on our > clusters with so-called job-farming (or task-farming) concepts in Slurm jobs > using srun. And it bothers me that we can hardly help users with requests in > this

[slurm-users] srun jobfarming hassle question

2023-01-18 Thread Ohlerich, Martin
Dear Colleagues, already for quite some years now are we again and again facing issues on our clusters with so-called job-farming (or task-farming) concepts in Slurm jobs using srun. And it bothers me that we can hardly help users with requests in this regard. >From the documentation (https: