Slurm’s default strategy is to fill entire nodes. That is why you are getting some nodes with 8 tasks and some idle nodes.
Try srun –n 100 –N22 –ntasks-per-node=5 –l hostname -n 100 means start 100 tasks, -N 22 means all 22 nodes --ntasks-per-node=5 distributes the tasks. -l appends task number to the output, so you can see the distribution. From: Marcin Stolarek [mailto:[email protected]] Sent: Monday, July 28, 2014 7:17 AM To: slurm-dev Subject: [slurm-dev] Re: even CPU load 2014-07-28 8:00 GMT+02:00 Леонид Коньков <[email protected]<mailto:[email protected]>>: Hi. I want my CPUs be loaded as even as possible. I have 22 nodes (motherboards) with 1 CPU each with 8 CPU cores each. ( My English is far from perfect, and I'm not shure what is what in you terminology.) I want to load 100 onethread tasks with 4-5 tasks on one CPU. But tasks always fill all 8 cores of CPU and leave some CPUs idle. you mean doesn't leave any idle cpu? You want node to be responsible and available for interactive work while tasks are running? <--distribution=cyclic> and <--hint=memory_bound> don't help. Leo. If I understood you correctly, you can limit the slurmd cpuset to a subset of your cores, so jobs running under this cpuset won't use more than whole cgroup/cpuset/slurm/. cheers, marcin
