Hello all,
This is my first post in the mailing list - nice to join the community!

I have a general question regarding slurm partition change:
If I move one node from one partition to the other, will it cause any impact to 
the jobs that are still running on other nodes, in both partitions?


I'm managing 1 cluster with 2 partitions:
- main partition for long jobs running
- the other, short job partition, dedicated to jobs that only run for less 2 
hours

Right now we are seeing our short job partition needs more resource and are 
planning to move 1 node from main partition to short job partition.
But we would like to do this without interrupting existing, running jobs.
What would be the safe way to do this?

And here's my plan:
(1) drain the node in main partition for the move, and only drain that node - 
keep other nodes available for job submission.
(2) move node from main partition to short job partition
(2.1) update slurm.conf on both control node and node to be moved, so that this 
node is listed under short job partition
(2.2) Run scontrol update on both control node and node just moved, to let 
slurm pick up configuration change.
(3) node should now be moved to short job partition, set the node back to 
normal / idle state.

Is "scontrol update" the right command to use in this case?
Does anyone see any impact / concern in above sequence?
I'm mostly worried mostly about whether such partition change could cause 
user's existing jobs to be killed or fail for some reason.

Thank you
TuoChen Peng


-----------------------------------------------------------------------------------
This email message is for the sole use of the intended recipient(s) and may 
contain
confidential information.  Any unauthorized review, use, disclosure or 
distribution
is prohibited.  If you are not the intended recipient, please contact the 
sender by
reply email and destroy all copies of the original message.
-----------------------------------------------------------------------------------

Reply via email to