It happens sometimes - in our case epilogue code got stuck. Either check the processes and kill whicehver ones belong to the user or simply reboot the nodes.
Cheers, Gene -- New Zealand eScience Infrastructure Centre for eResearch The University of Auckland e: g.soudlen...@auckland.ac.nz p: +64 9 3737599 ext 89834 c: +64 21 840 825 f: +64 9 373 7453 w: www.nesi.org.nz On 11/04/17 07:52, Tus wrote:
I have 2 nodes that have hardware issues and died with jobs running on them. I am not able to fix the nodes at the moment but want to delete the jobs that are stuck in completing state from slurm. I have set the nodes to DRAIN and tried scancel which did not work. How do I remove these jobs?
