Today there was a state restore bug found that would render most pending jobs unrunnable when the slurmctld was restarted.
The patch is found here https://github.com/SchedMD/slurm/commit/d7a572c319cfa211e2839624755b176d6d4bade6 We have tagged a 2.3.0-2 which will fix the problem. The fix will also resolve the situation if you installed a 2.3 version where the bug exists, so after the patch is applied or a the new version is installed no jobs should be lost and things should be fine going forward. You can download the new version at the repos site http://www.schedmd.com/#repos If you are running a 2.3.0-0.rc1 -> 2.3.0-1 system it is highly recommended to install this patch. Danny
