Henrik, I think I am not clear on what you have and have not tried yet.  Did 
you try the complementary reservation, similar to the following?

SRCFG[regular_usage] HOSTLIST=node0,node100 CLASSLIST=!nightly_queue 
STARTTIME=5:00:00 ENDTIME=21:00:00

The above should in principle never interfere with any job but a nightly build 
for reservation boundaries, though it does still allow nightly builds to 
withhold resources from regular jobs.  To prevent this completely, I believe 
you would also need a RESERVATIONPOLICY of CURRENTHIGHEST (the default) and a 
higher priority on the default queue, as in

CLASSCFG[default_queue] PRIORITY=500

See 'mdiag -p' for guidance on an appropriate priority adjustment (somewhere 
below but reasonably close to the total priority of a typical job at the top 
may be a good start); make sure 'Cred(...)' appears in the header with 'Class' 
somewhere inside the parentheses, since otherwise class priorities will have no 
effect.  Once you are certain nightly_queue jobs are never at the top of the 
queue when regular jobs are active, you should always see a nightly build job 
reservation being cancelled in favor of regular jobs (backfill, I believe, will 
also favor regular jobs with such a configuration; if you want nightly builds 
to run only on a backfill basis you may be able to use a default QOS with the 
NORESERVATION flag).  You can use RESERVATIONDEPTH and RESERVATIONQOSLIST 
settings to balance the two queues, but the configurations and effects can be 
subtle and complicated.

The following should still work to avoid boundary issues, but the priority 
issues may remain; with the policy settings above, this should be largely 
equivalent:

SRCFG[nightly_build_pm] HOSTLIST=node0,node100 
CLASSLIST=nightly_queue,default_queue STARTTIME=9:00:00 ACCESS=SHARED
SRCFG[nightly_build_am] HOSTLIST=node0,node100 
CLASSLIST=nightly_queue,default_queue ENDTIME=5:00:00 ACCESS=SHARED

I hope I am addressing the right issues here.  If I am not, sample output from 
'showq -i' or 'showres -n' may help to explain the problem.

Good luck!

Phil


----- Original Message -----
From: "Dr. Henrik Schulz" <[email protected]>
To: "Phil Regier" <[email protected]>
Cc: [email protected]
Sent: Monday, March 24, 2014 8:16:18 AM
Subject: Re: [Mauiusers] queue for nightly builds

Dear Phil,

thanks a lot for Your help! I tried to configure shared access on the 
reservations, but it does not work, i.e. whenever there is a job wating in the 
nightly queue and I submit a job into the regular queue, it is getting queued 
and showstart tells me that this job is getting startet after the next nightly 
time frame. It seems that shared access is not properly working when there a 
jobs waiting, because these jobs are generating reservations on the nodes.

Actually I´d like to prefer a solution based on reservations, because backfill 
should be working then. In the solution Jim suggested (based on qmgr and cron) 
there is a time period when there is no job getting started anymore, even if he 
walltime is very short.

Thanks again!
Henrik


Am 21.03.2014 um 20:07 schrieb Phil Regier <[email protected]>:
_______________________________________________
mauiusers mailing list
[email protected]
http://www.supercluster.org/mailman/listinfo/mauiusers

Reply via email to