> How hard do you think it would be to make the PBS api generic to >multipleschedulers, to support SGE and LL as well?
Not so hard I think. I used an existing API [1] as reference (first contacted the author to see if we could re-use his library), and had a look at the Python API too [2]. If we want to have a generic API to multiple schedulers, ideally I think we must first look at DRMAA spec [3] and the python drmaa module [4] (used in Galaxy for scheduling jobs in batch servers). What do you think if we move the API discussion to the biouno mailing list, code a new API and release it to Maven central? Bruno [1] https://code.google.com/p/pbs4java/ [2] http://freecode.com/projects/pbs_python [3] http://www.drmaa.org/ [4] http://drmaa-python.github.io/ >________________________________ > From: "Hetherington, James" <[email protected]> >To: Bruno P. Kinoshita <[email protected]>; >"[email protected]" <[email protected]> >Cc: "Hetherington, James" <[email protected]> >Sent: Thursday, June 12, 2014 8:04 AM >Subject: Re: Jenkins plugin for HPC job systems > > >Thanks Bruno, that’s really interesting, especially the PBS java api at >https://github.com/biouno/pbs-java-api > >How hard do you think it would be to make the PBS api generic to multiple >schedulers, to support SGE and LL as well? > >-- > > Dr James Hetherington, > >Team Leader, Honorary Lecturer >Research Software Development Department of Computer Science >Research IT Services >Information Services Division Faculty of Engineering > > University College London > >Tel: 02035495164 (Int. 65164) >Mobile: 07946868834 >Skype: ucgajhe >Twitter: @uclrcsoftdev >Blog: blogs.ucl.ac.uk/research-software-development/ >Site: development.rc.ucl.ac.uk > > > > >On 11/06/2014 15:52, "Bruno P. Kinoshita" <[email protected]> >wrote: > >> >>Hi James >> >>We have developed a pbs plugin, but it needs more work to be ready to >>production use. >> >>Maybe we can collaborate? We have a pbs java api too. >> >>http://biouno.org >> >>Bruno >>------------------------------ >>Em qua, 11 de jun de 2014 11:05 BRT James Hetherington escreveu: >> >>>I am considering starting to write a Jenkins plugin to support the use >>>of >>>HPC job scheduler systems like SGE, LL and PBS. >>> >>>Jobs currently queued in the batch system would show as pending jobs in >>>the >>>Jenkins UI. >>>Jobs would be qsubbed when they are requested to be built, and the job >>>would transition to currently running when it runs on the scheduler >>> >>>Configuration for the scheduler-based slave would specify the commands >>>to >>>be used for job submission, termination and status monitoring, with >>>standard options for common queue systems, >>>as well as SSH connection details to the login node of an HPC system. >>> >>>I have two questions: >>> >>>1. Is anyone aware of a plugin which already does this? >>>2. Would anyone be interested in collaborating on such a project? >>> >>>-- >>> >>> Dr James Hetherington, >>> >>>Team Leader, Honorary Lecturer >>>Research Software Development Department of Computer Science >>>Research IT Services >>>Information Services Division Faculty of Engineering >>> >>> University College London >>> >>>Tel: 02035495164 (Int. 65164) >>>Mobile: 07946868834 >>>Skype: ucgajhe >>>Twitter: @uclrcsoftdev >>>Blog: blogs.ucl.ac.uk/research-software-development/ >>>Site: development.rc.ucl.ac.uk >>> >>>-- >>>You received this message because you are subscribed to the Google >>>Groups "Jenkins Developers" group. >>>To unsubscribe from this group and stop receiving emails from it, send >>>an email to [email protected]. >>>For more options, visit https://groups.google.com/d/optout. >> >> > > > > -- You received this message because you are subscribed to the Google Groups "Jenkins Developers" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. For more options, visit https://groups.google.com/d/optout.
