I've got the three other slurm workers "working", but my fourth can't find a network address?
- Munge is started - Can ssh from head to non working node using hostnames without a key - Non working node is in hosts file and .ssh/config (fwiw) All systems are Centos 7. All systems are fully up to date. All worker systems built with python-fabric from head node. What have I done wrong and/or what can I test next? [ec2-user@slurm-head slurm-administration]$ sudo scontrol show node slurm-w3 NodeName=slurm-w3 Arch=x86_64 CoresPerSocket=1 CPUAlloc=0 CPUErr=0 CPUTot=8 CPULoad=0.01 Features=(null) Gres=(null) NodeAddr=slurm-w3 NodeHostName=slurm-w3 Version=15.08 OS=Linux RealMemory=32014 AllocMem=0 FreeMem=31448 Sockets=8 Boards=1 State=IDLE*+DRAIN ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A BootTime=2015-12-16T03:36:30 SlurmdStartTime=2015-12-16T03:36:41 CapWatts=n/a CurrentWatts=0 LowestJoules=0 ConsumedJoules=0 ExtSensorsJoules=n/s ExtSensorsWatts=0 ExtSensorsTemp=n/s Reason=Low RealMemory [slurm@2015-12-16T04:07:47] [ec2-user@slurm-head slurm-administration]$ sudo scontrol show node slurm-w2 NodeName=slurm-w2 Arch=x86_64 CoresPerSocket=1 CPUAlloc=0 CPUErr=0 CPUTot=8 CPULoad=0.01 Features=(null) Gres=(null) NodeAddr=slurm-w2 NodeHostName=slurm-w2 Version=15.08 OS=Linux RealMemory=32014 AllocMem=0 FreeMem=31452 Sockets=8 Boards=1 State=IDLE*+DRAIN ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A BootTime=2015-12-16T03:36:27 SlurmdStartTime=2015-12-16T03:36:36 CapWatts=n/a CurrentWatts=0 LowestJoules=0 ConsumedJoules=0 ExtSensorsJoules=n/s ExtSensorsWatts=0 ExtSensorsTemp=n/s Reason=Low RealMemory [slurm@2015-12-16T04:07:46] [ec2-user@slurm-head slurm-administration]$ sudo scontrol show node slurm-w1 NodeName=slurm-w1 Arch=x86_64 CoresPerSocket=1 CPUAlloc=8 CPUErr=0 CPUTot=8 CPULoad=0.01 Features=(null) Gres=(null) NodeAddr=slurm-w1 NodeHostName=slurm-w1 Version=15.08 OS=Linux RealMemory=32014 AllocMem=0 FreeMem=31450 Sockets=8 Boards=1 State=IDLE+COMPLETING+DRAIN ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A BootTime=2015-12-16T03:36:27 SlurmdStartTime=2015-12-16T03:36:36 CapWatts=n/a CurrentWatts=0 LowestJoules=0 ConsumedJoules=0 ExtSensorsJoules=n/s ExtSensorsWatts=0 ExtSensorsTemp=n/s Reason=Low RealMemory [slurm@2015-12-16T04:07:46] [ec2-user@slurm-head slurm-administration]$ sudo scontrol show node slurm-test NodeName=slurm-test Arch=x86_64 CoresPerSocket=1 CPUAlloc=0 CPUErr=0 CPUTot=8 CPULoad=0.01 Features=(null) Gres=(null) NodeAddr=slurm-test NodeHostName=slurm-test Version=15.08 OS=Linux RealMemory=32014 AllocMem=0 FreeMem=31444 Sockets=8 Boards=1 State=DOWN ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A BootTime=2015-12-16T03:36:29 SlurmdStartTime=2015-12-16T03:36:40 CapWatts=n/a CurrentWatts=0 LowestJoules=0 ConsumedJoules=0 ExtSensorsJoules=n/s ExtSensorsWatts=0 ExtSensorsTemp=n/s Reason=NO NETWORK ADDRESS FOUND [root@2015-12-15T00:27:44] Cheers L. This email (including any attachments or links) may contain confidential and/or legally privileged information and is intended only to be read or used by the addressee. If you are not the intended addressee, any use, distribution, disclosure or copying of this email is strictly prohibited. Confidentiality and legal privilege attached to this email (including any attachments) are not waived or lost by reason of its mistaken delivery to you. If you have received this email in error, please delete it and notify us immediately by telephone or email. Peter MacCallum Cancer Centre provides no guarantee that this transmission is free of virus or that it has not been intercepted or altered and will not be liable for any delay in its receipt.
