Re: [Bioc-devel] BatchJobs and BiocParallel

2014-02-19 Thread Michel Lang
> - BatchJobs: is there support, or are there any plans to support the > HTCondor infrastructure [1], and will this back-end be supported in > BiocParallel? We don't have access to a system running condor, otherwise we would have implemented support already. I'd either need a temporary account

Re: [Bioc-devel] BatchJobs and BiocParallel

2014-02-19 Thread Laurent Gatto
Thank you all for your replies. I will experiment with the list of BiocParallelParam objects and BatchJobs package. Best wishes, Laurent > We discussed with Michael Lang at the Cambridge meeting and he agreed > to think about potential abstractions for nested parallelization > requests in Batc

Re: [Bioc-devel] BatchJobs and BiocParallel

2014-02-18 Thread Hahne, Florian
We discussed with Michael Lang at the Cambridge meeting and he agreed to think about potential abstractions for nested parallelization requests in BatchJobs. Not sure whether that ever took off. Ideally one would be able to infer the number of requested nodes AND cpus directly from the BiocParallel

Re: [Bioc-devel] BatchJobs and BiocParallel

2014-02-14 Thread Martin Morgan
On 02/14/2014 09:20 AM, Laurent Gatto wrote: Dear all, Looking back in my (sparse) notes from the last European Bioc meeting, I saw two points that were mentioned during the BatchJobs and BiocParallel talk that are of particular interest to me. - BatchJobs: is there support, or are there any p

Re: [Bioc-devel] BatchJobs and BiocParallel

2014-02-14 Thread Vincent Carey
I've done quite a bit of this nested parallelism with BatchJobs/SGE over multicore. I daresay I haven't looked at BiocParallel as the solutions seemed pretty obvious with standard calls. Should BiocParallel have a vignette that indicates added value? I would like us to have a worked demonstratio

Re: [Bioc-devel] BatchJobs and BiocParallel

2014-02-14 Thread Michael Lawrence
On Fri, Feb 14, 2014 at 9:20 AM, Laurent Gatto wrote: > > Dear all, > > Looking back in my (sparse) notes from the last European Bioc meeting, I > saw two points that were mentioned during the BatchJobs and BiocParallel > talk that are of particular interest to me. > > - BatchJobs: is there suppo

[Bioc-devel] BatchJobs and BiocParallel

2014-02-14 Thread Laurent Gatto
Dear all, Looking back in my (sparse) notes from the last European Bioc meeting, I saw two points that were mentioned during the BatchJobs and BiocParallel talk that are of particular interest to me. - BatchJobs: is there support, or are there any plans to support the HTCondor infrastructure