Some pointers appreciated please. I suspect this is a common error message. Slurm version 16.05.8 In the slurmd logs on compute nodes I am seeing this:
[2017-02-27T20:25:04.886] error: gres/mic unable to set OFFLOAD_DEVICES, no device files configured [2017-02-27T20:25:04.898] _run_prolog: run job script took usec=11995 [2017-02-27T20:25:04.898] _run_prolog: prolog with lock for job 714 ran for 0 seconds [2017-02-27T20:25:04.898] Launching batch job 714 for UID 1991667182 [2017-02-27T20:25:04.979] [714] error: gres/mic unable to set OFFLOAD_DEVICES, no device files configured [2017-02-27T23:42:17.732] [714] sending REQUEST_COMPLETE_BATCH_SCRIPT, error:0 status 0 [2017-02-27T23:42:17.734] [714] done with job These compute nodes have no GPUs or Xeon Phis, and there is no gres defined for them in the slurm.conf There ARE some GPU equipped nodes on this cluster, with a gres defined In slurm.conf, the comute nodes are gm-hpc-01 to 052 # Nodes NodeName=gm-hpc-[01-52] Procs=20 NodeName=gm-hpc-gpu-[01-05] Procs=20 Gres=gpu:4 PartitionName=stdcomp Default=YES MinNodes=1 MaxNodes=52 MaxTime=1-12:00:00 AllowGroups=ALL Priority=1 DisableRootJobs=YES RootOnly=NO Hidden=NO Shared=NO GraceTime=0 PreemptMode=OFF ReqResv=NO AllowAccounts=ALL AllowQos=ALL LLN=NO ExclusiveUser=NO PriorityJ obFactor=1 PriorityTier=1 OverSubscribe=NO State=UP MaxMemPerNode=102400 Nodes=gm-hpc-[01-32],gm-hpc-[37-52] Any views or opinions presented in this email are solely those of the author and do not necessarily represent those of the company. Employees of XMA Ltd are expressly required not to make defamatory statements and not to infringe or authorise any infringement of copyright or any other legal right by email communications. Any such communication is contrary to company policy and outside the scope of the employment of the individual concerned. The company will not accept any liability in respect of such communication, and the employee responsible will be personally liable for any damages or other liability arising. XMA Limited is registered in England and Wales (registered no. 2051703). Registered Office: Wilford Industrial Estate, Ruddington Lane, Wilford, Nottingham, NG11 7EP
