Hi Fritz, On 27/05/2026 06:46, Ratnasamy, Fritz via slurm-users wrote:
We are noticing that some of the gpus on a specific node have "fallen of the bus". We would like to remove this specific gpu from the slurm scheduler. For example, let's say GPU0 has fallen off the bus, we would need the rest of the GPU1-8 to be available and make GPU0 not able to be allocated. How can we achieve that? I have read about blacklist on the slurm forum but it seems there is no satisfying solution.
We asked the same question recently. See: https://support.schedmd.com/show_bug.cgi?id=25180 and https://support.schedmd.com/show_bug.cgi?id=25181. Our current cumbersome method is to drop the 'broken' GPU of the pcie bus and reconfigure slurm with one less GPU. Ward
smime.p7s
Description: S/MIME Cryptographic Signature
-- slurm-users mailing list -- [email protected] To unsubscribe send an email to [email protected]
