For more fine grandular control of your runtime resource limits, look
into Univa
Grid Engine specifically their cgroups integration...
There's a patch floating around to get cgroups integration for limiting
physical memory. I am currently trying to apply this patch with 8.1.4 or
8.1.8, but I ran into weird problems that I do not have the knowledge to
debug. It seems that this issue might be related to some problem with
our configuration; at least, other people on this mailing list reported
this patch to be working fine. If someone else is interested in testing
it, I can send you this patch for 8.1.8 stable.
Regards,
Arne
-----Original Message-----
*From:* Mishkin Derakhshan [mailto:[email protected]]
*Sent:* Monday, February 23, 2015 07:07 PM
*To:* [email protected]
*Subject:* [gridengine users] How to set up h_vmem as a consumable
resource
Hi,
We have some jobs that require significant amounts of memory so we
want to try and setup h_vmem as a consumable resource to manage this.
This is what we have setup:
$ qconf -sq dev.q | grep h_vmem
h_vmem 3.7G
$ qconf -sc | grep h_vmem
h_vmem h_vmem MEMORY <= YES
YES 0 0
And if we submit jobs like this then we don't have any problems,
$ qsub -b y -j y -l h_vmem=1G -q dev.q sleep 100
But if we submit jobs without explicitly requesting h_vmem (i.e.,
we don't use -l h_vmem=X) then the jobs die on startup saying it
can't allocate memory:
error reason 1: 02/19/2015 14:13:39 [0:14840]: can't set
additional group id (uid=0, euid=0): Cannot allocate memory
We _think_ this has to do with setting a default h_vmem (on a queue
basis? host basis?) so jobs that don't explicitly request the
resource will use something by default, but we've been unable to
figure out how to set this up.
We are using 6.1u3.
thanks
_______________________________________________
users mailing list
[email protected]
https://gridengine.org/mailman/listinfo/users
--
Arne Brutschy, PhD Email arne.brutschy(AT)ulb.ac.be
IRIDIA CP 194/6 Web iridia.ulb.ac.be/~abrutschy
Universite' Libre de Bruxelles Tel +32 2 650 2273
Avenue Franklin Roosevelt 50 Fax +32 2 650 2715
1050 Bruxelles, Belgium (Tel and Fax both IRIDIA secretary)
_______________________________________________
users mailing list
[email protected]
https://gridengine.org/mailman/listinfo/users
