I believe you have exceeded the MaxJobCount specified in your slurm.conf,
or have reached the default of 10000 jobs.
MaxJobCount
The maximum number of jobs SLURM can have in its active
database at one time. Set the values of MaxJobCount and MinJobAge
to insure the slurmctld daemon does not exhaust its memory
or other resources. Once this limit is reached, requests to
submit additional jobs will fail. The default value is
10000 jobs. This value may not be reset via "scontrol reconfig".
It only takes effect upon restart of the slurmctld daemon.
Phil Eckert
LLNL
On 8/9/13 9:08 AM, "Mario Kadastik" <[email protected]> wrote:
>
>Hi,
>
>lately we've started to see this:
>
>[2013-08-09T18:57:12+03:00] error: create_job_record: job_count exceeds
>limit
>[2013-08-09T18:57:13+03:00] error: create_job_record: job_count exceeds
>limit
>[2013-08-09T18:57:16+03:00] error: create_job_record: job_count exceeds
>limit
>
>and I can't quite understand where it comes from.
>
>Mario Kadastik, PhD
>Senior researcher
>
>---
> "Physics is like sex, sure it may have practical reasons, but that's
>not why we do it"
> -- Richard P. Feynman
