Re: [galaxy-dev] Galaxy not killing split cluster jobs

2012-07-10 Thread Peter Cock
On Tue, May 1, 2012 at 3:46 PM, Dannon Baker dannonba...@me.com wrote: I'll take care of it. Thanks for reminding me about the TODO! This seems to have reached galaxy-central now: https://bitbucket.org/galaxy/galaxy-central/changeset/dc20a7b5b6ce i.e. When Galaxy creates sub-jobs from tools

Re: [galaxy-dev] Galaxy not killing split cluster jobs

2012-07-10 Thread Scott McManus
A suggested change will be coming down the pipe shortly, but it's good to hear that it will be useful! -Scott - Original Message - On Tue, May 1, 2012 at 3:46 PM, Dannon Baker dannonba...@me.com wrote: I'll take care of it. Thanks for reminding me about the TODO! This seems to

Re: [galaxy-dev] Galaxy not killing split cluster jobs

2012-05-31 Thread Peter Cock
On Tue, May 1, 2012 at 3:46 PM, Dannon Baker dannonba...@me.com wrote: On Tue, May 1, 2012 at 3:10 PM, Peter Cock p.j.a.c...@googlemail.com wrote: On May 1, 2012, at 10:03 AM, Dannon Baker dannonba...@me.com wrote: On May 1, 2012, at 9:51 AM, Peter Cock wrote: I'm a little confused about

Re: [galaxy-dev] Galaxy not killing split cluster jobs

2012-05-03 Thread Peter Cock
On Tue, May 1, 2012 at 3:46 PM, Dannon Baker dannonba...@me.com wrote: I'll take care of it.  Thanks for reminding me about the TODO! On a related point, I've noticed sometimes one child job from a split task can fail, yet the rest of the child jobs continue to run on the cluster wasting CPU

Re: [galaxy-dev] Galaxy not killing split cluster jobs

2012-05-03 Thread Dannon Baker
On a related point, I've noticed sometimes one child job from a split task can fail, yet the rest of the child jobs continue to run on the cluster wasting CPU time. As soon as one child job dies (assuming there are no plans for attempting a retry), I would like the parent task to kill all

Re: [galaxy-dev] Galaxy not killing split cluster jobs

2012-05-03 Thread Peter Cock
On Thu, May 3, 2012 at 3:54 PM, Dannon Baker dannonba...@me.com wrote: On a related point, I've noticed sometimes one child job from a split task can fail, yet the rest of the child jobs continue to run on the cluster wasting CPU time. As soon as one child job dies (assuming there are no

[galaxy-dev] Galaxy not killing split cluster jobs

2012-05-01 Thread Peter Cock
Hi all, We're running our Galaxy with an SGE cluster, using the DRMAA support in Galaxy, and job splitting. I've noticed if the user cancels a job (that was running or queued on the cluster) while the job is shows as deleted in Galaxy, looking at the queue on the cluster with qstat shows it

Re: [galaxy-dev] Galaxy not killing split cluster jobs

2012-05-01 Thread Dannon Baker
I'll take care of it. Thanks for reminding me about the TODO! On May 1, 2012, at 10:03 AM, Dannon Baker dannonba...@me.com wrote: On May 1, 2012, at 9:51 AM, Peter Cock wrote: I'm a little confused about tasks.py vs drmaa.py but that TODO comment looks pertinent. Is that the problem