I'm inclined to agree with Axel. You are proposing and trying to get advice on a configuration that does not fit nicely with the current capability of torque and maui.
There are lots of creative people reading who might give you good suggestions (like virtualize or run multiple torque instances), but perhaps you would get a more useful response if you were to describe the problem you are trying to solve rather than the proposed solution you are trying to implement. ie. What are you trying to achieve? - Why do you want to 'split CPUs on each nodes between different queues'? Regards, Gareth > -----Original Message----- > From: [email protected] [mailto:[email protected]] > Sent: Friday, 14 May 2010 9:46 PM > To: [email protected] > Cc: [email protected] > Subject: [Mauiusers] Fw: Re: make queues with defferent # of CPU in them > > > Hi Alex, > > > > it is asked sometimes but there is no solutions. > > > > > > I want to split CPUs on each nodes between different queues. > > > I need a queue which has only one CPU on each node. > > > > well, first and foremost, i would like to point out that trying to > > configure this kind of node access pattern will probably > > generate more headaches through inconsistent performance > > than benefits. when managing a machine, one has to decide > > whether the additional utilization is worth the time and grief and > > slowing down the "special" jobs. we are avoiding this issue > > completely, but always requiring to use complete nodes. > in our case we don't need complete nodes for jobs. Main purpose is always > have > free 1 CPU per node for "special" jobs. And use other for any jobs. > > > that all being said, it appears to me, that it would be far too > > complex and too complicated to make the queue resource > > manager realize what it has to do. but that you could very > > easily split your node into two, but using a virtualization > > software like xen, or kvm and the n configure the two parts > > are individual resources on different ip numbers with 1 > > and 7 processing units available. > in this case it is more sample to install 2 batch system which will > operate 7 and 1 CPUs per node. > > I still hope it is possible to configure batch system with one torque and > maui scheduler. > > Bye. > > > cheers, > > axel. > > > > > Other CPUs shared between other queues. > > > > > > For example there are 3 queues: ONE, TWO & THREE > > > Each node has 8 CPUs. > > > > > > The queue ONE should use only 1 CPU on each node > > > The queues TWO & THREE can use other CPUs on each node (in my case > 7 CPUs) and always keep 1CPUs free. > > > > > > I did not find any solutions with my experiments with maui scheduler. > > > I use torque 2.1.8 & 2.3.6, maui 3.26p21 > > > > > > One of the solutions in case of only 2 queues is to use NODECFG option > like this: > > > NODECFG[DEFAULT] MAXPROC[CLASS:ONE]=1 MAXPORC[CLASS:TWO]=7 > MAXNODE[CLASS:ONE]=1 MAXJOB[CLASS:ONE]=1 > > > > > > But it works only if I submit at first jobs to ONE queues. If I submit > at first jobs to TWO queue these jobs start to occupy all 8 CPUs per node. > > > Or if I submit to TWO queue one job with for example 4 CPUs per nodes > and > > > then I submit job to ONE queue it start to occupy all CPUs on one node > then other CPUs on other nodes > > > > > > In torque config I also tried to change node_pack to False & True. > It did not help. > > > > > > Thanx. > > > > > > _______________________________________________ > > > mauiusers mailing list > > > [email protected] > > > http://www.supercluster.org/mailman/listinfo/mauiusers > > > > > > > > > > > -- > > Dr. Axel Kohlmeyer [email protected] > > http://sites.google.com/site/akohlmey/ > > > > Institute for Computational Molecular Science > > Temple University, Philadelphia PA, USA. > > > > > > _______________________________________________ mauiusers mailing list [email protected] http://www.supercluster.org/mailman/listinfo/mauiusers
