Hey everybody. I'm running Maui 3.2.6p14 with Torque 2.0.0p7. I'm
trying to set up a rather convoluted scheduling system, and I'm
completely lost in the world of all the paramters that I can set with
Maui.
I have 3 nodes, each with two processors, and many users. What I'd like
to be able to do is allow each user to run up to 6 jobs, one on each
processor. If that same user submits a seventh job, it waits for one of
the first six to finish.
But if another user comes along and submits jobs (up to 6), I want those
jobs to start running right away on some of the processors that the
first user is using. (So I want to be able to run multiple jobs on the
same processor). So far, I've only be able to spread 6 jobs out on 6
nodes, regardless of whose they are, and any more jobs wait until one of
those is finished.
Any help would be greatly appreciated. Here's the relevant
configuration information (I think...)
Michelangelo
qmgr -c 'p s':
#
# Create queues and set their attributes.
#
#
# Create and define queue batch
#
create queue batch
set queue batch queue_type = Execution
set queue batch resources_default.nodes = 1:ppn=1
set queue batch enabled = True
set queue batch started = True
#
# Set server attributes.
#
set server scheduling = True
set server operators = [EMAIL PROTECTED]
set server operators += [EMAIL PROTECTED]
set server default_queue = batch
set server log_events = 511
set server mail_from = adm
set server resources_default.nodes = 1
set server scheduler_iteration = 600
set server node_check_rate = 150
set server tcp_timeout = 6
set server default_node = 1
set server node_pack = False # maui.cfg 3.2.6p14
SERVERHOST icecube.berkeley.edu
# primary admin must be first in list
ADMIN1 root
# Resource Manager Definition
RMCFG[ICECUBE.BERKELEY.EDU] TYPE=PBS
# Allocation Manager Definition
AMCFG[bank] TYPE=NONE
# full parameter docs at
http://clusterresources.com/mauidocs/a.fparameters.html
# use the 'schedctl -l' command to display current configuration
RMPOLLINTERVAL 00:00:30
#SERVERPORT 42559
SERVERPORT 15004
SERVERMODE NORMAL
# Admin: http://clusterresources.com/mauidocs/a.esecurity.html
LOGFILE maui.log
LOGFILEMAXSIZE 10000000
LOGLEVEL 1
# Job Priority:
http://clusterresources.com/mauidocs/5.1jobprioritization.html
QUEUETIMEWEIGHT 0
USERWEIGHT 1
FSWEIGHT 1
FSUSERWEIGHT 1
# FairShare: http://clusterresources.com/mauidocs/6.3fairshare.html
FSPOLICY UTILIZEDPS
FSDEPTH 10
FSINTERVAL 01:00:00
FSDECAY 0.80
# Throttling Policies:
http://clusterresources.com/mauidocs/6.2throttlingpolicies.html
# NONE SPECIFIED
# Backfill: http://clusterresources.com/mauidocs/8.2backfill.html
BACKFILLPOLICY FIRSTFIT
RESERVATIONPOLICY CURRENTHIGHEST
# Node Allocation:
http://clusterresources.com/mauidocs/5.2nodeallocation.html
NODEALLOCATIONPOLICY MINRESOURCE
NODEACCESSPOLICY SHARED
# QOS: http://clusterresources.com/mauidocs/7.3qos.html
# QOSCFG[hi] PRIORITY=100 XFTARGET=100 FLAGS=PREEMPTOR:IGNMAXJOB
# QOSCFG[low] PRIORITY=-1000 FLAGS=PREEMPTEE
# Standing Reservations:
http://clusterresources.com/mauidocs/7.1.3standingreservations.html
# SRSTARTTIME[test] 8:00:00
# SRENDTIME[test] 17:00:00
# SRDAYS[test] MON TUE WED THU FRI
# SRTASKCOUNT[test] 20
# SRMAXTIME[test] 0:30:00
# Creds: http://clusterresources.com/mauidocs/6.1fairnessoverview.html
# USERCFG[DEFAULT] FSTARGET=25.0
USERCFG[mdagost] FSTARGET=50.0+
# Backfill: http://clusterresources.com/mauidocs/8.2backfill.html
BACKFILLPOLICY FIRSTFIT
RESERVATIONPOLICY CURRENTHIGHEST
# Node Allocation:
http://clusterresources.com/mauidocs/5.2nodeallocation.html
NODEALLOCATIONPOLICY MINRESOURCE
NODEACCESSPOLICY SHARED
# QOS: http://clusterresources.com/mauidocs/7.3qos.html
# QOSCFG[hi] PRIORITY=100 XFTARGET=100 FLAGS=PREEMPTOR:IGNMAXJOB
# QOSCFG[low] PRIORITY=-1000 FLAGS=PREEMPTEE
# Standing Reservations:
http://clusterresources.com/mauidocs/7.1.3standingreservations.html
# SRSTARTTIME[test] 8:00:00
# SRENDTIME[test] 17:00:00
# SRDAYS[test] MON TUE WED THU FRI
# SRTASKCOUNT[test] 20
# SRMAXTIME[test] 0:30:00
# Creds: http://clusterresources.com/mauidocs/6.1fairnessoverview.html
# USERCFG[DEFAULT] FSTARGET=25.0
USERCFG[mdagost] FSTARGET=50.0+
USERCFG[mdagost] MAXPROC=6
USERCFG[hardtke] FSTARGET=50.0+
USERCFG[hardtke] MAXPROC=6
USERCFG[amorey] FSTARGET=50.0+
USERCFG[amorey] MAXPROC=6
# USERCFG[john] PRIORITY=100 FSTARGET=10.0-
# GROUPCFG[staff] PRIORITY=1000 QLIST=hi:low QDEF=hi
# CLASSCFG[batch] FLAGS=PREEMPTEE
# CLASSCFG[interactive] FLAGS=PREEMPTOR
set server pbs_version = 2.0.0p7
nodes:
cold1:ts np=2
cold2:ts np=2
cold3:ts np=2
_______________________________________________
mauiusers mailing list
[email protected]
http://www.supercluster.org/mailman/listinfo/mauiusers
