Hello!
HAUTREUX Matthieu has written once (Tuesday, 6 December, 17:45):
>if not already done, you should probably consider the use of
>SchedulerParameters=defer in the controller slurm.conf. Without that,
>every submission involves an attempt of the scheduler logic which
>probably takes some time to manage the 20k jobs. With that option, you
>should no longer have this complexity, only the internal scheduling
>thread will do the scheduling part every 30 seconds or so and your job
>should be submitted more quickly. One problem that we experimented with
>that option, is that the -I parameter of srun was not working properly
>with defer mode and you can no longer use it. I do not know if it is
>still the case with later version of slurm.
Thank you for suggestion. We tried it but unfortunately submit rate
left the same ~3 job/s with 25k jobs in queue so probably something else
slows it down.
Andriy.
