Ok, I am still having trouble here and am not sure where to look.
Slurm is configured with:
SelectType = select/cons_res
SelectTypeParameters = CR_CORE_MEMORY,CR_ONE_TASK_PER_CORE
I have a node which has 64 cores:
NodeName=compute-2-1 Arch=x86_64 CoresPerSocket=8
CPUAlloc=0 CPUErr=0 CPUTot=64 CPULoad=0.06
AvailableFeatures=amd
ActiveFeatures=amd
Gres=(null)
NodeAddr=compute-2-1 NodeHostName=compute-2-1 Version=16.05
OS=Linux RealMemory=258307 AllocMem=0 FreeMem=254172 Sockets=8 Boards=1
State=IDLE ThreadsPerCore=1 TmpDisk=3903 Weight=1 Owner=N/A
MCS_label=N/A
BootTime=2016-08-05T09:48:40 SlurmdStartTime=2016-08-13T14:21:49
CapWatts=n/a
CurrentWatts=0 LowestJoules=0 ConsumedJoules=0
ExtSensorsJoules=n/s ExtSensorsWatts=0 ExtSensorsTemp=n/s
I am merely trying to start two interactive bash sessions on the same node.
I use
srun --ntasks=1 --share --nodelist=compute-2-1 --pty bash
and I get a command prompt right away.
In another session, I also do:
srun --nodelist=compute-2-1 --ntasks=1 --share --pty bash
which responds with:
srun: job 133888 queued and waiting for resources
When I check the running job it shows:
JobId=133887 JobName=bash
UserId=bdandrus(30274) GroupId=hamming(20) MCS_label=N/A
Priority=2 Nice=0 Account=admin QOS=normal
JobState=RUNNING Reason=None Dependency=(null)
Requeue=1 Restarts=0 BatchFlag=0 Reboot=0 ExitCode=0:0
RunTime=00:00:25 TimeLimit=01:00:00 TimeMin=N/A
SubmitTime=2016-08-15T16:38:58 EligibleTime=2016-08-15T16:38:58
StartTime=2016-08-15T16:38:58 EndTime=2016-08-15T17:38:58 Deadline=N/A
PreemptTime=None SuspendTime=None SecsPreSuspend=0
Partition=primary AllocNode:Sid=submit-0:25370
ReqNodeList=compute-2-1 ExcNodeList=(null)
NodeList=compute-2-1
BatchHost=compute-2-1
NumNodes=1 NumCPUs=1 NumTasks=1 CPUs/Task=1 ReqB:S:C:T=0:0:*:*
TRES=cpu=1,mem=258307M,node=1
Socks/Node=* NtasksPerN:B:S:C=0:0:*:1 CoreSpec=*
MinCPUsNode=1 MinMemoryNode=258307M MinTmpDiskNode=0
Features=(null) Gres=(null) Reservation=(null)
OverSubscribe=OK Contiguous=0 Licenses=(null) Network=(null)
Command=bash
WorkDir=/work/bdandrus/MPI/OPENMPI
Power=
It sits and waits until I end the first job, at which point it immediately
starts.
Any idea what am I missing here that is stopping my second job from running on
the same node at the same time?
Brian Andrus
ITACS/Research Computing
Naval Postgraduate School
Monterey, California
voice: 831-656-6238
