[slurm-dev] Re: Question about -m cyclic and --exclusive options to slurm

2017-01-04 Thread Peter A Ruprecht
t;mailto:slurm-dev@schedmd.com>> Date: Tuesday, January 3, 2017 at 5:09 PM To: slurm-dev <slurm-dev@schedmd.com<mailto:slurm-dev@schedmd.com>> Cc: Shenglong Wang <s...@nyu.edu<mailto:s...@nyu.edu>> Subject: [slurm-dev] Re: Question about -m cyclic and --exclusive

[slurm-dev] Re: Question about -m cyclic and --exclusive options to slurm

2017-01-04 Thread Jeff Tan
[slurm-dev] Re: Question about -m cyclic and --exclusive options to slurm Does a job array launch separate slurm processes? Lucas From: Jeff Tan [mailto:jeffe...@au1.ibm.com] Sent: Tuesday, January 03, 2017 7:34 PM To: slurm-dev <slurm-dev@schedmd.com> Subject: [slurm-dev] Re

[slurm-dev] Re: Question about -m cyclic and --exclusive options to slurm

2017-01-04 Thread Koziol, Lucas
Does a job array launch separate slurm processes? Lucas From: Jeff Tan [mailto:jeffe...@au1.ibm.com] Sent: Tuesday, January 03, 2017 7:34 PM To: slurm-dev <slurm-dev@schedmd.com> Subject: [slurm-dev] Re: Question about -m cyclic and --exclusive options to slurm "Koziol, Lucas&q

[slurm-dev] Re: Question about -m cyclic and --exclusive options to slurm

2017-01-04 Thread Koziol, Lucas
:34 PM To: slurm-dev <slurm-dev@schedmd.com> Subject: [slurm-dev] Re: Question about -m cyclic and --exclusive options to slurm "Koziol, Lucas" <lucas.koz...@exxonmobil.com<mailto:lucas.koz...@exxonmobil.com>> wrote on 04/01/2017 10:28:14: > I want to have

[slurm-dev] Re: Question about -m cyclic and --exclusive options to slurm

2017-01-03 Thread Hendryk Bockelmann
Hey Lucas, the following script does the job (at least for my tests with 24 tasks per node and 2 nodes used) #!/bin/bash #SBATCH --partition=whatever #SBATCH --nodes=2 #SBATCH --exclusive for n in `scontrol show hostnames $SLURM_JOB_NODELIST`; do for i in `seq 1 24`; do srun -w $n -n1

[slurm-dev] Re: Question about -m cyclic and --exclusive options to slurm

2017-01-03 Thread Jeff Tan
"Koziol, Lucas" wrote on 04/01/2017 10:28:14: > I want to have 1 batch script, where I reserve a certain large > number of CPUs, and then run multiple 1-CPU tasks from within this > single script. The reason being that I do several cycles of these > tasks, and I need

[slurm-dev] Re: Question about -m cyclic and --exclusive options to slurm

2017-01-03 Thread Shenglong Wang
Maybe try to use GNU parallel https://www.gnu.org/software/parallel/ Best, Shenglong > On Jan 3, 2017, at 6:38 PM, Christopher Samuel wrote: > > > On 04/01/17 10:29, Koziol, Lucas wrote: > >> I want to have 1 batch script,

[slurm-dev] Re: Question about -m cyclic and --exclusive options to slurm

2017-01-03 Thread Christopher Samuel
On 04/01/17 10:29, Koziol, Lucas wrote: > I want to have 1 batch script, where I reserve a certain large number > of CPUs, and then run multiple 1-CPU tasks from within this single > script. The reason being that I do several cycles of these tasks, and > I need to process the outputs between

[slurm-dev] Re: Question about -m cyclic and --exclusive options to slurm

2017-01-03 Thread Christopher Samuel
On 04/01/17 10:19, Koziol, Lucas wrote: > Will Slurm read a local slurm.conf file or in my home directory? No, I'm afraid not, it's a global configuration thing. > The default slurm.conf file I can't modify. I can ask the admins here > to modify it I I have to though. I strongly believe that

[slurm-dev] Re: Question about -m cyclic and --exclusive options to slurm

2017-01-03 Thread Koziol, Lucas
ounds more complicated than it is... Thanks, Lucas -Original Message- From: Christopher Samuel [mailto:sam...@unimelb.edu.au] Sent: Tuesday, January 03, 2017 5:57 PM To: slurm-dev <slurm-dev@schedmd.com> Subject: [slurm-dev] Re: Question about -m cyclic and --exclusive options to

[slurm-dev] Re: Question about -m cyclic and --exclusive options to slurm

2017-01-03 Thread Koziol, Lucas
- From: Christopher Samuel [mailto:sam...@unimelb.edu.au] Sent: Tuesday, January 03, 2017 5:57 PM To: slurm-dev <slurm-dev@schedmd.com> Subject: [slurm-dev] Re: Question about -m cyclic and --exclusive options to slurm On 04/01/17 04:20, Koziol, Lucas wrote: > The hope was that all

[slurm-dev] Re: Question about -m cyclic and --exclusive options to slurm

2017-01-03 Thread Koziol, Lucas
<slurm-dev@schedmd.com> Subject: [slurm-dev] Re: Question about -m cyclic and --exclusive options to slurm On 04/01/17 04:20, Koziol, Lucas wrote: > The hope was that all 16 tasks would run on Node 1, and 16 tasks would > run on Node 2. Unfortunately what happens is that all 32 jobs ge

[slurm-dev] Re: Question about -m cyclic and --exclusive options to slurm

2017-01-03 Thread Christopher Samuel
On 04/01/17 04:20, Koziol, Lucas wrote: > The hope was that all 16 tasks would run on Node 1, and 16 tasks would > run on Node 2. Unfortunately what happens is that all 32 jobs get > assigned to Node 1. I thought –m cyclic was supposed to avoid this. You're only running a single task at a time,

[slurm-dev] Re: Question about -m cyclic and --exclusive options to slurm

2017-01-03 Thread Koziol, Lucas
, 2017 3:17 PM To: slurm-dev <slurm-dev@schedmd.com> Subject: [slurm-dev] Re: Question about -m cyclic and --exclusive options to slurm what behaviour do you get if you leave off the exclusive and cyclic options? which selecttype are you using? On Tue, Jan 3, 2017 at 12:19 PM, Koziol,

[slurm-dev] Re: Question about -m cyclic and --exclusive options to slurm

2017-01-03 Thread Michael Di Domenico
what behaviour do you get if you leave off the exclusive and cyclic options? which selecttype are you using? On Tue, Jan 3, 2017 at 12:19 PM, Koziol, Lucas wrote: > Dear Vendor, > > > > > > What I want to do is run a large number of single-CPU tasks, and have