Hello,
I'm trying to get exclusive node access with the Maui + Torque installation
that I have.
I run
qsub -I -l walltime=1:00:00,select=10 -W x="NACCESSPOLICY:SINGLETASK"
but the tasks can end up all on the same machine. At least from what I read at
http://www.clusterresources.com/products/maui/docs/5.3nodeaccess.shtml
the tasks should be spread across nodes, one task from that job per node
exclusively. In my example, I'm looking to get 10 distinct nodes (from
select=10).
Running checkjob on this job shows that at least Maui recognizes the singletask
request, but somehow it is not honored when the resources are allocated. Do I
have something wrong with my Maui installation? I have Maui 3.2.6p21 and Torque
2.3.7. Any help/suggestions is appreciated.
This is what I run and get:
r...@logon ~$ qsub -I -l walltime=1:00:00,select=10 -W
x="NACCESSPOLICY:SINGLETASK"
qsub: waiting for job 1674361.ff-head.unl.edu to start
qsub: job 1674361.ff-head.unl.edu ready
r...@c1518 ~$ cat $PBS_NODEFILE
c1518
c1518
c1518
c1518
c1518
c1518
c1518
c1518
c1515
c1515
Then as root on the head node:
[r...@ff-head ~]# checkjob -v 1674361
checking job 1674361 (RM job '1674361.ff-head.unl.edu')
State: Running
Creds: user:rlim group:swanson class:default qos:high
WallTime: 00:00:00 of 1:00:00
SubmitTime: Fri Mar 5 10:16:42
(Time Queued Total: 00:00:06 Eligible: 00:00:06)
StartTime: Fri Mar 5 10:16:48
Total Tasks: 10
Req[0] TaskCount: 10 Partition: DEFAULT
Network: [NONE] Memory >= 0 Disk >= 0 Swap >= 0
Opsys: [NONE] Arch: [NONE] Features: [NONE]
Exec: '' ExecSize: 0 ImageSize: 0
Dedicated Resources Per Task: PROCS: 1
Utilized Resources Per Task: [NONE]
Avg Util Resources Per Task: [NONE]
Max Util Resources Per Task: [NONE]
NodeAccess: SINGLETASK
NodeCount: 0
Allocated Nodes:
[c1518:8][c1515:2]
Task Distribution: c1518,c1518,c1518,c1518,c1518,c1518,c1518,c1518,c1515,c1515
IWD: [NONE] Executable: [NONE]
Bypass: 0 StartCount: 1
PartitionMask: [DEFAULT][short][x8way][wrf]
Flags: NASINGLETASK
Reservation '1674361' (00:00:00 -> 1:00:00 Duration: 1:00:00)
PE: 10.00 StartPriority: 1010088
Regards,
- ryan
Ryan Lim
Systems Administrator
Holland Computing Center
University of Nebraska - Lincoln
email: [email protected] / voice: (402) 554-2323 / web: http://hcc.unl.edu/
_______________________________________________
mauiusers mailing list
[email protected]
http://www.supercluster.org/mailman/listinfo/mauiusers
