Re: [gridengine users] preventing certain jobs from being suspended (subordinated)

We had this problem lots, and I can't quite remember how I solved it - I think it might've been either a JSV or a qsub wrapper that shoves all GPU jobs into the superordinate queue. Now that I'm thinking about this again - does the subordinate queue setting accept 'queueu@@hostgroup' syntax

Re: [gridengine users] Multi-GPU setup

Hello, from a kernel/mechanism point of view, it is perfectly possible to restrict device access using cgroups. I use that on my current cluster, works really well (both for things like CPU cores and GPUs - you only see what you request, even using something like 'nvidia-smi'). Sadly, my

Re: [gridengine users] Accessing qacct accounting file from login/compute nodes

I was about to ask that :) $SGE_ROOT ought to be accessible from (the) submit host(s), at least. So in general, you should be able to access it from there? (Note that you can also tell qacct where the accounting file lives - it assumes a default location, but the file does not have be in that

Re: [gridengine users] starting a new gridengine accounting file

...or one can just use logrotate (rather than run an extra cron job). It's surprisingly good at that sort of thing ;) Tina On 29/01/2019 16:21, Reuti wrote: > Hi, > >> Am 29.01.2019 um 17:09 schrieb John Young : >> >> The gridengine accounting file on our cluster has gotten >> rather large. I

Re: [gridengine users] Alternatives to Son of GridEngine

fancy new things like mesos that have a different > > programming model or are too new. > > > > Dan > > ___ > > users mailing list > > users@gridengine.org > > https://gridengine.org/mailman/listinfo/users

Re: [gridengine users] Distributed NFS file system for master/slave

> > Thanks for sharing, > > Paul. > ___ > users mailing list > users@gridengine.org > https://gridengine.org/mailman/listinfo/users -- Tina Friedrich, Snr HPC Systems Administrator, Advanced Research Computing Research Computing and Support Serv

Re: [gridengine users] Writing Monthly CPU Usage Reports

> > Douglas Duckworth, MSc, LFCS > HPC System Administrator > Scientific Computing Unit > Weill Cornell Medicine > E: d...@med.cornell.edu > O: 212-746-6305 > F: 212-746-8690 -- Tina Friedrich, Snr HPC Systems Administrator, Advanced Research Computing Research Comp

Re: [gridengine users] SGE accounting file getting too big...

ounting" ? > > Thanks for any help. > > > > > > -Noel Benitez, Salk iT Dept. -- Tina Friedrich, Snr HPC Systems Administrator, Advanced Research Computing Research Computing and Support Services, Academic IT IT Services, University of Oxford http://www.arc.ox.ac.uk ___

Re: [gridengine users] case-insensitive user names?

I dealt with a similar problem by way of using the pam-regex[1] module to simply transform all entered usernames to lower case... as long as your user names (on the Linux side) are all *supposed* to be lower case, that should do the trick :) (Had the bonus of also solving all sorts of other

Re: [gridengine users] GE 6.2u5 Duplicate Job IDs

Only time I ever had problems with duplicate IDs it was simply because they rolled over - been a while ago though (might've been SGE6.2, actually - I think that might've hit max job ID at 99 ). You'd have to run through a very large amount of jobs to hit that monthly, though. Tina On

Re: [gridengine users] firewall on submit host

My trick won't work for the random port on the submit host. William ___ users mailing list users@gridengine.org https://gridengine.org/mailman/listinfo/users -- Tina Friedrich, Computer Systems Administrator, Diamond Light Source Ltd Diamond House, Harwell Sc

Re: [gridengine users] Hardware thoughts?

gles ___ users mailing list users@gridengine.org https://gridengine.org/mailman/listinfo/users -- Tina Friedrich, Computer Systems Administrator, Diamond Light Source Ltd Diamond House, Harwell Science and Innovation Campus - 01235 77 8442 -- This e-mail and any attachments

Re: [gridengine users] Tailoring the output using the qacct command

___ users mailing list users@gridengine.org <mailto:users@gridengine.org> https://gridengine.org/mailman/listinfo/users ___ users mailing list users@gridengine.org https://gridengine.org/mailman

Re: [gridengine users] alias for queue

e does the verification. Would spare me rather a lot of helpdesk calls :) Tina -- Tina Friedrich, Computer Systems Administrator, Diamond Light Source Ltd Diamond House, Harwell Science and Innovation Campus - 01235 77 8442 -- This e-mail and any attachments may contain confidential, copyright and or priv

Re: [gridengine users] subordinating running jobs in favor of queued jobs

___ users mailing list users@gridengine.org https://gridengine.org/mailman/listinfo/users -- Tina Friedrich, Computer Systems Administrator, Diamond Light Source Ltd Diamond House, Harwell Science and Innovation Campus - 01235 77 8442 -- This e-mail and any attachments may contain confidential

Re: [gridengine users] Grid queue goes into an error state due to one job

://gridengine.org/mailman/listinfo/users -- Tina Friedrich, Computer Systems Administrator, Diamond Light Source Ltd Diamond House, Harwell Science and Innovation Campus - 01235 77 8442 -- This e-mail and any attachments may contain confidential, copyright and or privileged material

Re: [gridengine users] Grid queue goes into an error state due to one job

@gridengine.org https://gridengine.org/mailman/listinfo/users ___ users mailing list users@gridengine.org https://gridengine.org/mailman/listinfo/users -- Tina Friedrich, Computer Systems Administrator, Diamond Light Source Ltd Diamond House, Harwell Science

Re: [gridengine users] grid jobs not visible with qstat output

mailing list users@gridengine.org https://gridengine.org/mailman/listinfo/users -- Tina Friedrich, Computer Systems Administrator, Diamond Light Source Ltd Diamond House, Harwell Science and Innovation Campus - 01235 77 8442 -- This e-mail and any attachments may contain confidential, copyright

Re: [gridengine users] Anyone using S-GAE reporting app with Univa grid engine?

how people have made XDMoD and other variants work with Grid Engine(s) -- can we get a little thread going on best practices and recommendations for 3rd party reporting/metrics tools? Suspect there would be decent interest in this ... -Chris Tina Friedrich mailto:tina.friedr...@diamond.ac.uk

Re: [gridengine users] Using ssh with qrsh and qlogin but disable users direct ssh

connecting to other nodes though; I simply needed a X forwarding capable qlogin :) Tina On 13/10/14 22:45, Prentice Bisbal wrote: Is that ssh conf dynamically generated to limit access only to nodes that SGE has assigned to that user? Prentice On 10/13/2014 12:44 PM, Tina Friedrich wrote: We

Re: [gridengine users] Using ssh with qrsh and qlogin but disable users direct ssh

qrsh and qlogin but don't expose SSH directly to the users? Regards, Derrick ___ users mailing list users@gridengine.org https://gridengine.org/mailman/listinfo/users -- Tina Friedrich, Computer Systems Administrator, Diamond Light Source Ltd

Re: [gridengine users] setting up a shadow master

mailing list users@gridengine.org https://gridengine.org/mailman/listinfo/users -- Tina Friedrich, Computer Systems Administrator, Diamond Light Source Ltd Diamond House, Harwell Science and Innovation Campus - 01235 77 8442 -- This e-mail and any attachments may contain confidential, copyright

Re: [gridengine users] jobs not starting - need quick reminder how to debug

run in queue' stanzas, so unfortunately I'm not much wiser. (qstat -F for a queue instance that would fit does give me 'qc:slots=8'). Tina On 07/07/14 17:24, Tina Friedrich wrote: Okay, I checked. All jobs in the queue have the same priority. They all request the same resources. There aren't

Re: [gridengine users] jobs not starting - need quick reminder how to debug

Hi William, On 07/07/14 15:22, William Hay wrote: On Fri, 4 Jul 2014 10:37:56 + Tina Friedrich tina.friedr...@diamond.ac.uk wrote: Hello list, I have a couple of jobs sitting in the queue (been there for ages) that never seem to start (they're in qw). qalter -w p #JOBNO says

Re: [gridengine users] jobs not starting - need quick reminder how to debug

Friedrich wrote: Hi William, On 07/07/14 15:22, William Hay wrote: On Fri, 4 Jul 2014 10:37:56 + Tina Friedrich tina.friedr...@diamond.ac.uk wrote: Hello list, I have a couple of jobs sitting in the queue (been there for ages) that never seem to start (they're in qw). qalter -w p #JOBNO says

[gridengine users] sudden (relatively) strange problem with python job

the python script starts (and should print something), in the runs where it works a 'write' is called and if it fails it doesn't. Anyone has any idea? Tina -- Tina Friedrich, Computer Systems Administrator, Diamond Light Source Ltd Diamond House, Harwell Science and Innovation Campus - 01235 77

Re: [gridengine users] Python bindings for sge lib

| ___ users mailing list users@gridengine.org https://gridengine.org/mailman/listinfo/users -- Tina Friedrich, Computer Systems Administrator, Diamond Light Source Ltd Diamond House, Harwell Science and Innovation Campus - 01235 77 8442 -- This e-mail and any attachments may

Re: [gridengine users] Phantom job

https://gridengine.org/mailman/listinfo/users -- Tina Friedrich, Computer Systems Administrator, Diamond Light Source Ltd Diamond House, Harwell Science and Innovation Campus - 01235 77 8442 -- This e-mail and any attachments may contain confidential, copyright and or privileged material

Re: [gridengine users] The state of a queue

___ users mailing list users@gridengine.org https://gridengine.org/mailman/listinfo/users -- Tina Friedrich, Computer Systems Administrator, Diamond Light Source Ltd Diamond House, Harwell Science and Innovation Campus - 01235 77 8442 -- This e-mail and any attachments may contain

Re: [gridengine users] Details on some terminologies of Sun Grid Engine cluster

/users -- Tina Friedrich, Computer Systems Administrator, Diamond Light Source Ltd Diamond House, Harwell Science and Innovation Campus - 01235 77 8442 -- This e-mail and any attachments may contain confidential, copyright and or privileged material, and are for the use of the intended

Re: [gridengine users] sge_qmaster uses too much memory and becomes unresponsive

___ users mailing list users@gridengine.org https://gridengine.org/mailman/listinfo/users -- Tina Friedrich, Computer Systems Administrator, Diamond Light Source Ltd Diamond House, Harwell Science and Innovation Campus - 01235 77 8442 -- This e-mail and any attachments may contain confidential

Re: [gridengine users] array job / node allocation / 'spread' question

, and will simply have to not use MPI. Such hardship :) Tina -- Tina Friedrich, Computer Systems Administrator, Diamond Light Source Ltd Diamond House, Harwell Science and Innovation Campus - 01235 77 8442 -- This e-mail and any attachments may contain confidential, copyright and or privileged material

[gridengine users] array job / node allocation / 'spread' question

this? Tina -- Tina Friedrich, Computer Systems Administrator, Diamond Light Source Ltd Diamond House, Harwell Science and Innovation Campus - 01235 77 8442 -- This e-mail and any attachments may contain confidential, copyright and or privileged material, and are for the use of the intended

Re: [gridengine users] array job / node allocation / 'spread' question

On 02/04/14 16:04, Skylar Thompson wrote: An exclusive host consumable is the right way to approach the problem. If the task elements might be part of a parallel environment, then you'll want to set the scaling to JOB as well. On Wed, Apr 02, 2014 at 03:39:03PM +0100, Tina Friedrich wrote

Re: [gridengine users] array job / node allocation / 'spread' question

) with 'slots 1'. -Hugh -Original Message- From: users-boun...@gridengine.org [mailto:users-boun...@gridengine.org] On Behalf Of Skylar Thompson Sent: Wednesday, April 02, 2014 11:04 AM To: Tina Friedrich Cc: users@gridengine.org Subject: Re: [gridengine users] array job / node allocation

[gridengine users] unix groups

Hello All, just double checking - there still is no way to use anything but a user's primary group for ACLs etc? (Directly use, I mean. Without resorting to duplicating information in SGE setup, or using a JSV, or wrapping qsub, or ...) Tina -- Tina Friedrich, Computer Systems

Re: [gridengine users] unix groups

Hi Reuti, On 31/03/14 12:47, Reuti wrote: Hi, Am 31.03.2014 um 12:22 schrieb Tina Friedrich: just double checking - there still is no way to use anything but a user's primary group for ACLs etc? (Directly use, I mean. Without resorting to duplicating information in SGE setup, or using

Re: [gridengine users] unix groups

Hi Reuti, On 31/03/14 15:05, Reuti wrote: Am 31.03.2014 um 14:14 schrieb Tina Friedrich: On 31/03/14 12:47, Reuti wrote: Hi, Am 31.03.2014 um 12:22 schrieb Tina Friedrich: just double checking - there still is no way to use anything but a user's primary group for ACLs etc? (Directly use

Re: [gridengine users] Moving/Migrating a qmaster between hosts

I was about to say, that sounds like something got missed. Glad it all worked! Tina On 28/03/14 01:11, Kevin Buckley wrote: On 28 March 2014 13:48, Kevin Buckley kevin.buckley.ecs.vuw.ac...@gmail.com wrote: On 28 March 2014 00:37, Tina Friedrich tina.friedr...@diamond.ac.uk wrote: (Sorry I

Re: [gridengine users] Moving/Migrating a qmaster between hosts

On 27/03/14 05:18, Kevin Buckley wrote: On 26 March 2014 23:34, Tina Friedrich tina.friedr...@diamond.ac.uk wrote: It does sound as if you need to move the SGE_ROOT file system from one host to the next as well, Yes, we do. I'd say stopping everything simply syncing it should work. Yes

Re: [gridengine users] Moving/Migrating a qmaster between hosts

___ users mailing list users@gridengine.org https://gridengine.org/mailman/listinfo/users -- Tina Friedrich, Computer Systems Administrator, Diamond Light Source Ltd Diamond House, Harwell Science and Innovation Campus - 01235 77 8442 -- This e-mail and any

Re: [gridengine users] Moving/Migrating a qmaster between hosts

to bother with the IP - changing 'act_qmaster' ought to do the trick. Tina On 26/03/14 09:57, Tina Friedrich wrote: Can't you just install the new one, make it one of the shadow masters, and call a migrate? I've never done this across OSs (all my qmasters are Linux hosts), but I quite often migrate

Re: [gridengine users] Subordinate queue suspended jobs not restarting

___ users mailing list users@gridengine.org https://gridengine.org/mailman/listinfo/users -- Tina Friedrich, Computer Systems Administrator, Diamond Light Source Ltd Diamond House, Harwell Science and Innovation Campus - 01235 77 8442 -- This e-mail and any attachments may

Re: [gridengine users] Subordinate queue suspended jobs not restarting

of a problem (likely simply more noticeable with higher cluster load). Tina On 03/03/14 12:46, Reuti wrote: Am 03.03.2014 um 12:59 schrieb Tina Friedrich: I was about to ask a similar question; we have the same sort of setup - high, medium and low priority queues - and run into the same problem

Re: [gridengine users] anyone using arco

useful information yet. Any recommendations on a source for info on installing / configuring arco Or another alternative ? Isaac Jessop ___ users mailing list users@gridengine.org https://gridengine.org/mailman/listinfo/users -- Tina Friedrich

Re: [gridengine users] qlogin with ssh

___ users mailing list users@gridengine.org https://gridengine.org/mailman/listinfo/users ___ users mailing list users@gridengine.org https://gridengine.org/mailman/listinfo/users -- Tina Friedrich, Computer

[gridengine users] high memory usage of qmaster process

in SGE8.1.3? Tina -- Tina Friedrich, Computer Systems Administrator, Diamond Light Source Ltd Diamond House, Harwell Science and Innovation Campus - 01235 77 8442 -- This e-mail and any attachments may contain confidential, copyright and or privileged material, and are for the use of the intended

Re: [gridengine users] Documentation about adding orte parallel environment

___ users mailing list users@gridengine.org https://gridengine.org/mailman/listinfo/users -- Tina Friedrich, Computer Systems Administrator, Diamond Light Source Ltd Diamond House, Harwell Science and Innovation Campus - 01235 77 8442 -- This e-mail and any attachments may contain

Re: [gridengine users] How to manage grid nodes

to configuration management - hence CFEngine. I'd second Dave's requirement 4 - I wouldn't really go for anything that's coupled to the OS. Tina -- Tina Friedrich, Computer Systems Administrator, Diamond Light Source Ltd Diamond House, Harwell Science and Innovation Campus - 01235 77 8442

Re: [gridengine users] How to manage grid nodes

'. I would consider a combination of PXE, kickstart (or whatever installation scripting system you are using) and Puppet/Chef/CFEngine/... satisfy my 'OS independence' requirement, really. I was more thinking of things like Rocks. Tina -- Tina Friedrich, Computer Systems Administrator, Diamond

Re: [gridengine users] How to manage grid nodes

___ users mailing list users@gridengine.org https://gridengine.org/mailman/listinfo/users -- Tina Friedrich, Computer Systems Administrator, Diamond Light Source Ltd Diamond House, Harwell Science and Innovation Campus - 01235 77 8442 -- This e-mail and any

Re: [gridengine users] Upgrading form SGE to OGE

, but as I couldn't manage to detect the current jobs I reverted back to SGE. Txema El 10/09/13 11:40, Tina Friedrich escribió: Hi Txema, I recently upgrades our Grid Engine from SGE6.2u4 (I think it was) to OGE8.1.3. No rocks though, so I don't know any details on that. What I basically did was: 1

Re: [gridengine users] Upgrading form SGE to OGE

___ users mailing list users@gridengine.org https://gridengine.org/mailman/listinfo/users -- Tina Friedrich, Computer Systems Administrator, Diamond Light Source Ltd Diamond House, Harwell Science and Innovation Campus - 01235 77 8442 -- This e-mail and any attachments

Re: [gridengine users] adaptive computing spam?

: +49.9471.200.195 | Mobile: +49.170.819.7390 Where Grid Engine lives ___ users mailing list users@gridengine.org https://gridengine.org/mailman/listinfo/users -- Tina Friedrich, Computer Systems Administrator, Diamond Light Source Ltd Diamond

Re: [gridengine users] [SGE-discuss] [SGE] Does SGE filter the reboot command

://arc.liv.ac.uk/mailman/listinfo/sge-discuss ___ users mailing list users@gridengine.org https://gridengine.org/mailman/listinfo/users -- Tina Friedrich, Computer Systems Administrator, Diamond Light Source Ltd Diamond House, Harwell

Re: [gridengine users] building Son of Grid Engine

use ssh per remote_startup(5). -- Tina Friedrich, Computer Systems Administrator, Diamond Light Source Ltd Diamond House, Harwell Science and Innovation Campus - 01235 77 8442 -- This e-mail and any attachments may contain confidential, copyright and or privileged material, and are for the use

Re: [gridengine users] building Son of Grid Engine

it has those symptoms, but there appears to be a race in the threading of the builtin startup that appears on recent Ubuntu, for instance, but doesn't on RHEL5 or 6 in our experience. You can still use ssh per remote_startup(5). -- Tina Friedrich, Computer Systems Administrator, Diamond Light

[gridengine users] Son of Grid Engine / builtin interactive problem (split from 'building Sun of Grid Engine)

require non-authenticated qrsh (if I'm not mistaken). Tina -- Tina Friedrich, Computer Systems Administrator, Diamond Light Source Ltd Diamond House, Harwell Science and Innovation Campus - 01235 77 8442 -- This e-mail and any attachments may contain confidential, copyright and or privileged

Re: [gridengine users] building Son of Grid Engine

, cluster nodes get upgraded along with the rest of the estate. -- Tina Friedrich, Computer Systems Administrator, Diamond Light Source Ltd Diamond House, Harwell Science and Innovation Campus - 01235 77 8442 -- This e-mail and any attachments may contain confidential, copyright

Re: [gridengine users] building Son of Grid Engine

) with the standard workstation setup (and hence, things that work on workstations not working on the cluster or vice versa) is - to us - much more of a concern. So, cluster nodes get upgraded along with the rest of the estate. Tina -- Tina Friedrich, Computer Systems Administrator, Diamond Light

[gridengine users] building Son of Grid Engine

installed hwlock in a non-standard location (and currently have to tell the execd process where it is). Is there an option for aimk to build statically linked binaries? (I'm sort of guessing that that's what the difference is here.). Apologies for the very long post. Tina -- Tina Friedrich

Re: [gridengine users] suspension / load balancing problem

haven't got an obvious bug somewhere. Tina -- Tina Friedrich, Computer Systems Administrator, Diamond Light Source Ltd Diamond House, Harwell Science and Innovation Campus - 01235 77 8442 -- This e-mail and any attachments may contain confidential, copyright and or privileged material

[gridengine users] suspension / load balancing problem

decision. I have tried a load sensor - basically counting the number of jobs in the queue on a machine - but that didn't seem to make a difference; which might be due to the weighting, I suppose. Anyone got any bright ideas? Tina -- Tina Friedrich, Computer Systems Administrator, Diamond Light

Re: [gridengine users] restrict queue access by complex resource?

Hi Reuti, On 08/04/13 13:12, Reuti wrote: Hi Tina, Am 08.04.2013 um 11:16 schrieb Tina Friedrich: is it possible to restrict access to a queue by anything but ACL or project? A complex/resource would be a favourite. A forced boolean complex attached to a queue? Ah, no. Thought

Re: [gridengine users] restrict queue access by complex resource?

Hi Reuti, discussion veering off a bit :) On 08/04/13 13:33, Reuti wrote: Am 08.04.2013 um 14:28 schrieb Tina Friedrich: Hi Reuti, On 08/04/13 13:12, Reuti wrote: Hi Tina, Am 08.04.2013 um 11:16 schrieb Tina Friedrich: is it possible to restrict access to a queue by anything but ACL

[gridengine users] restrict queue access by complex resource?

priority queue (might be the easiest). I could introduce a project for this I suppose; however, if there was a way to solve it with a resource I'd prefer that. Any suggestions? Tina -- Tina Friedrich, Computer Systems Administrator, Diamond Light Source Ltd Diamond House, Harwell Science

Re: [gridengine users] automatically use of scratch area on compute node

/listinfo/users -- Tina Friedrich, Computer Systems Administrator, Diamond Light Source Ltd Diamond House, Harwell Science and Innovation Campus - 01235 77 8442 -- This e-mail and any attachments may contain confidential, copyright and or privileged material, and are for the use of the intended

Re: [gridengine users] disaster recovery of grid engine setup..

deadline - so time is not on our side. -paul ___ users mailing list users@gridengine.org https://gridengine.org/mailman/listinfo/users -- Tina Friedrich, Computer Systems Administrator, Diamond Light Source Ltd Diamond House, Harwell Science

Re: [gridengine users] PE Job Suspend / Resume

(and had forgotten about). Can anyone cast more light on it? -- Tina Friedrich, Computer Systems Administrator, Diamond Light Source Ltd Diamond House, Harwell Science and Innovation Campus - 01235 77 8442 -- This e-mail and any attachments may contain confidential, copyright and or privileged

Re: [gridengine users] A couple of basic questions on compatability

https://gridengine.org/mailman/listinfo/users ___ users mailing list users@gridengine.org https://gridengine.org/mailman/listinfo/users -- Tina Friedrich, Computer Systems Administrator, Diamond Light Source Ltd Diamond House, Harwell Science