Hi Miguel, all, On 8 August 2014 12:41, Miguel Bernabeu Diaz <[email protected]> wrote: > I'm not sure if all or at least the most common schedulers' CLI could be > abstracted in this manner as I've only worked with Slurm and LSF. Either > way, would the community be interested in this kind of abstraction? Also, > has someone worked on something similar or a port to Slurm or LSF we could > extend or reuse?
We too would probably be interested in batch-system independence, although we're in no hurry. (This would fit in the framework of a project that will only start later on this year.) Actually, if I am allowed a shameless self-plug, we already have a Python framework that can submit and manage jobs on different batch-queuing systems, see http://gc3pie.googlecode.com/ I am not familiar with EasyBuild internals, but GC3Pie's job control reduces to a few lines that should be relatively quick to plug in: from gc3libs import Application from gc3libs.core import Engine task = Application(['some', '-unix', '+command', 'here'], ...) engine = Engine(...) engine.add(task) # run task and wait for it to finish engine.progress() If there is interest, I can look at the sources and try to estimate how much work it would be to integrate GC3Pie and EasyBuild. Kind regards, Riccardo -- Riccardo Murri http://www.s3it.uzh.ch/about/team/ S3IT: Services and Support for Science IT University of Zurich Winterthurerstrasse 190, CH-8057 Zürich (Switzerland) Tel: +41 44 635 4222 Fax: +41 44 635 6888
