Re: [gridengine users] /common/accounting

2012-07-16 Thread Simon Matthews
On Mon, Jul 16, 2012 at 10:06 PM, Mark Day wrote: > This should help you out > http://arc.liv.ac.uk/SGE/howto/rotatelogs.html#logrotate > Do you use the file for keeping track of jobs etc? > I don't need to keep track of jobs. Our gridengine is used to run nightly (plus on-demand) regressions o

Re: [gridengine users] /common/accounting

2012-07-16 Thread Mark Day
This should help you out http://arc.liv.ac.uk/SGE/howto/rotatelogs.html#logrotate Do you use the file for keeping track of jobs etc? Mark - Original Message - From: "Simon Matthews" To: users@gridengine.org Sent: Tuesday, 17 July, 2012 2:25:54 PM Subject: [gridengine users] /com

[gridengine users] /common/accounting

2012-07-16 Thread Simon Matthews
What is in this file and how is it maintained? In my installation it is currently about 2GB and has over 6 million records. Can I just delete it and have the system re-create it? Also the "messages" file? We currently run about 25k to 75k jobs per day (7 days per week) in our little cluster (most

Re: [gridengine users] Saving OGE Configuration

2012-07-16 Thread Joseph Farran
I do have a "host_aliases" set for our Rocks login-1-1 node which had to be done in order to install OGE on our login node. Thanks, I can work around this. Joseph On 07/16/2012 03:59 PM, Reuti wrote: Do you have a host_aliases file in use? Unfortunately it's not honored (but saved). In the

Re: [gridengine users] Saving OGE Configuration

2012-07-16 Thread Reuti
Do you have a host_aliases file in use? Unfortunately it's not honored (but saved). In the script you can try to change gethostname -name to -aname. -- Reuti Am 17.07.2012 um 00:41 schrieb Joseph Farran : > On 07/16/2012 01:51 PM, Reuti wrote: >> There is a script in $SGE_ROOT/util/upgrade_mod

Re: [gridengine users] Saving OGE Configuration

2012-07-16 Thread Joseph Farran
On 07/16/2012 01:51 PM, Reuti wrote: There is a script in $SGE_ROOT/util/upgrade_modules/save_sge_config.sh -- Reuti Running the command where the sge_qmaster is running (the admin host), it says: # mkdir /root/oge-backup-test # ./util/upgrade_modules/save_sge_config.sh /root/oge-backup-te

Re: [gridengine users] Use SGE for cluster stats

2012-07-16 Thread Gowtham
I'm in the process of writing step by step instructions for different phases involved in this process and will keep the list informed as & when they are posted online. Best, g -- Gowtham Information Technology Services Michigan Technological University (906) 487/3593 http://www.it.mtu.edu/ On

Re: [gridengine users] Saving OGE Configuration

2012-07-16 Thread Reuti
There is a script in $SGE_ROOT/util/upgrade_modules/save_sge_config.sh -- Reuti Am 16.07.2012 um 22:37 schrieb Joseph Farran : > Howdy. > > Is there a way to save the entire Open Grid Engine configuration to a file ( > text hopefully )? > > In Torque one can save the entire Torque configurati

Re: [gridengine users] Saving OGE Configuration

2012-07-16 Thread Jesse Becker
I use the attached script. It's loosly based on something found packaged with SGE a while back, but didn't fit my needs. On Mon, Jul 16, 2012 at 04:37:03PM -0400, Joseph Farran wrote: Howdy. Is there a way to save the entire Open Grid Engine configuration to a file ( text hopefully )? In Tor

Re: [gridengine users] Use SGE for cluster stats

2012-07-16 Thread Gowtham
I use this on a Rocks cluster as well, but I do parsing of data (and storing them in MySQL) is done on a local work station - this was done so just not to mess with anything Rocks was doing. Best, g -- Gowtham Information Technology Services Michigan Technological University (906) 487/3593 http

Re: [gridengine users] Use SGE for cluster stats

2012-07-16 Thread Martin Flemming
Hi, Gowtham ! Great stuff, i think i (we) will be very interested :-) cheers, Martin __ Martin Flemming DESY / IT office : Building 2b / 008a Notkestr. 85 phone : 040 - 8998 - 4667 22603 Hamburg mail : martin.f

[gridengine users] Saving OGE Configuration

2012-07-16 Thread Joseph Farran
Howdy. Is there a way to save the entire Open Grid Engine configuration to a file ( text hopefully )? In Torque one can save the entire Torque configuration with a: qmgr -c 'p s' > file Is there such a command in OGE? If not, what is the recommended way to backup the configuration files

Re: [gridengine users] Use SGE for cluster stats

2012-07-16 Thread Joseph Farran
Hi Gowtham. The charts are indeed very nice - Thank you for sharing your work. For those of us who are using Rocks Cluster software which has it's own MySQL setup, will this conflict? Or will it run side-by-side with no interference? Best, Joseph On 07/16/2012 01:26 PM, Gowtham wrote: I have

Re: [gridengine users] Use SGE for cluster stats

2012-07-16 Thread Gowtham
I have written a collection of scripts (BASH, MySQL and PHP) that parse the SGE accounting file and present the resulting data in an eye-candy way (using HighCharts) - for our researchers as well as university administrators who fund the cluster. You may check their working on our prototype/tes

Re: [gridengine users] Use SGE for cluster stats

2012-07-16 Thread Hung-Sheng Tsao Ph.D.
try these links http://ubmod.sourceforge.net/ and http://rdlab.lsi.upc.edu/index.php/serveis/s-gae.html May be these should be in HOWTO regards On 7/16/2012 3:04 PM, Rayson Ho wrote: qacct, ACRo, etc?? In fact, many people write their own scripts to parse data in the accounting & reporting file

Re: [gridengine users] Use SGE for cluster stats

2012-07-16 Thread Rayson Ho
qacct, ACRo, etc?? In fact, many people write their own scripts to parse data in the accounting & reporting files: http://gridscheduler.sourceforge.net/htmlman/htmlman5/accounting.html http://gridscheduler.sourceforge.net/htmlman/htmlman5/reporting.html Rayson On Mon, Jul 16, 2012 at 2:58 PM,

[gridengine users] Use SGE for cluster stats

2012-07-16 Thread Joe Borġ
Is it possible to get the stats from finished jobs so I can look at total cluster usage over a period of time? Regards, Joseph David Borġ http://www.jdborg.com ___ users mailing list users@gridengine.org https://gridengine.org/mailman/listinfo/users

Re: [gridengine users] export of environment variables from start_proc_args

2012-07-16 Thread Mark Dixon
On Thu, 12 Jul 2012, Dave Love wrote: ... The advantage of doing PE_HOSTFILE rewriting in the starter_method is that we can modify the job's PE_HOSTFILE variable to point to the new file. This is useful for the MPIs and parallel applications that already understand gridengine and directly read th

Re: [gridengine users] export of environment variables from start_proc_args

2012-07-16 Thread Mark Dixon
On Thu, 12 Jul 2012, Dave Love wrote: Mark Dixon writes: Things I think we've used starter_methods for in the past: Gosh. You live in interesting times^Wclusters. I've certainly had some interesting problems to tackle. Something's got to keep me busy in funding droughts ... * Tr

Re: [gridengine users] export of environment variables from start_proc_args

2012-07-16 Thread Mark Dixon
On Thu, 12 Jul 2012, Dave Love wrote: ... I think the right thing to do is to write a customizable skeleton in something like Python or Lua without the shell pitfalls and following the builtin method exactly, but someone will doubtless do it in Perl to confound me. Is there some gotcha doing tha