Hi Michael, That's an interesting suggestion, and this works for you? I'm a bit confused then because the man-page for gres.conf states otherwise: https://slurm.schedmd.com/gres.conf.html, indicating the it mustmatch one of the GresTypes (gpu, mic, or nic).
Sincerely, Hans On 6 February 2017 at 16:28, Michael Di Domenico <mdidomeni...@gmail.com<mailto:mdidomeni...@gmail.com>> wrote: On Mon, Feb 6, 2017 at 10:17 AM, Hans-Nikolai Viessmann <h...@hw.ac.uk<mailto:h...@hw.ac.uk>> wrote: > > I had just added the DebugFlags setting to slurm.conf on the head node > and did not sychronise it with the nodes. I doubt that this could cause the > problem I described as it was occuring before I made the change to > slurm.conf. > > One thing I did notice is this error occuring every once and a while: > > [2016-12-30T17:36:50.963] error: gres_plugin_node_config_unpack: gres/gpu > lacks File parameter for node gpu07 > [2016-12-30T17:36:50.963] error: gres_plugin_node_config_unpack: gres/gpu > lacks File parameter for node gpu04 > [2016-12-30T17:36:50.963] error: gres_plugin_node_config_unpack: gres/gpu > lacks File parameter for node gpu01 > [2016-12-30T17:36:50.963] error: gres_plugin_node_config_unpack: gres/gpu > lacks File parameter for node gpu05 > [2016-12-30T17:36:50.963] error: gres_plugin_node_config_unpack: gres/gpu > lacks File parameter for node gpu02 > [2016-12-30T17:36:50.964] error: gres_plugin_node_config_unpack: gres/gpu > lacks File parameter for node gpu06 > [2016-12-30T17:36:50.966] error: gres_plugin_node_config_unpack: gres/gpu > lacks File parameter for node gpu03 > > Is it possible that I need to specify the Gres Type for the other nodes as > well, even though that > have only one GPU each? i'm not an expert, but i believe your gres.conf is incorrect. Ours looks like this name=hostname file=/dev/nvidia0 type=k10 i think the issue is that slurm is trying to match your hostname to the gres file to see what matches and can't ________________________________ Founded in 1821, Heriot-Watt is a leader in ideas and solutions. With campuses and students across the entire globe we span the world, delivering innovation and educational excellence in business, engineering, design and the physical, social and life sciences. The contents of this e-mail (including any attachments) are confidential. If you are not the intended recipient of this e-mail, any disclosure, copying, distribution or use of its contents is strictly prohibited, and you should please notify the sender immediately and then delete it (including any attachments) from your system.
