Re: Debconf10: Batch Queuing Systems BoF -- revisited
HI Michael, On Thu, May 10, 2012 at 09:49:11AM +0200, Michael Hanke wrote: Right now the Condor package only builds a fraction of the built-in functionality (although what is built is already quite comprehensive for the task of a batch queuing system). I'm working on enabling build-time testing and the kFreeBSD port needs some love. But overall it looks like we are going to have Debian wheezy ship Condor. I have some experience with Condor, if you want I would be pleased to help. I always desired to package Condor but, since I'm not using it lately I have missed their license switch. What is the status of similar software in Debian (GridEngine, Slurm, ...)? Slurm have been included in Debian since long time now: the slurm-llnl package reached stable with lenny. I'm the maintainer. Best regards -- Gennaro Oliva -- To UNSUBSCRIBE, email to debian-science-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org Archive: http://lists.debian.org/20120511192928.GA12281@cavani
Debconf10: Batch Queuing Systems BoF -- revisited
Hi, some of you might still remember the Batch Queuing Systems BoF at Debconf10, where we briefly discussed the past/present/future of this software in Debian. We talked about the lack of maintainers, and possible strategies to consolidate our efforts. During this meeting I've learned about Condor [0], and my personal conclusion was that it could be the one solution covering most variety of use cases we could think of at this point. Unfortunately, it wasn't available in Debian at all, and upstream had only recently moved to a proper FOSS licensing scheme. In the meantime, however, things have improved a lot. Red Hat is investing into the project (its Grid-computing infrastructure is based on it [1]). I have attended their project conference CondorWeek in 2011 and gave a talk proposing a collaboration to integrate Condor into Debian [2] -- which was well perceived. And as of very very recently we have an official package in Debian unstable [3]. Upstream has promised long-term commitment to help Debian ship a high-quality package. The experience of the past year has shown that problems, once reported, are addressed quickly by upstream, making the current official package ship with almost no necessary patches. Right now the Condor package only builds a fraction of the built-in functionality (although what is built is already quite comprehensive for the task of a batch queuing system). I'm working on enabling build-time testing and the kFreeBSD port needs some love. But overall it looks like we are going to have Debian wheezy ship Condor. Unfortunately, I can't attend Debconf this year, but maybe there are enough people interested in the topic to have a follow-up BoF to revisit the issue. What is the status of similar software in Debian (GridEngine, Slurm, ...)? Michael [0] http://research.cs.wisc.edu/condor/ [1] http://redhat.com/products/mrg/grid/ [2] http://research.cs.wisc.edu/condor/CondorWeek2011/presentations/hanke-condor-debian.pdf [3] http://packages.debian.org/sid/condor -- Michael Hanke http://mih.voxindeserto.de -- To UNSUBSCRIBE, email to debian-science-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org Archive: http://lists.debian.org/20120510074911.GD26197@meiner
Re: Debconf10: Batch Queuing Systems BoF -- revisited
Hi, On Thu, May 10, 2012 at 09:49:11AM +0200, Michael Hanke wrote: Unfortunately, I can't attend Debconf this year, but maybe there are enough people interested in the topic to have a follow-up BoF to revisit the issue. I won't be there, either. Note that the Grenoble workshop draft agenda has an item about batch queueing systems. I might see if I can make it there, if it makes sense. What is the status of similar software in Debian (GridEngine, Slurm, ...)? Mark Hymers recently said that he will not have time to maintain Gridengine anymore. AIUI, Gridengine has been abondoned as a FLOSS project by Oracle after the Sun acquisition, but there is a community fork, http://gridscheduler.sourceforge.net I will see whether I get/have time to keep maintaining gridengine/gridscheduler. I don't know about Slurm, AIUI it is rather mature both upstream and in Debian, but I never used it (the Leibniz Rechenzentrum is migrating from Gridengine to Slurm at the moment, though, so I might get to use it soon :) ) Finally, we now have Torque in Debian, http://packages.qa.debian.org/t/torque.html Torque is a PBS/OpenPBS fork, quite mature upstream (and used by lots of research groups I know), but I am not certain on the Debian status. So having Condor certainly makes sense, but I think we have several mature (from a upstream POV) batch queueing systems in Debian now, but might lack maintenance personell. Michael -- To UNSUBSCRIBE, email to debian-science-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org Archive: http://lists.debian.org/20120510103857.ga32...@nighthawk.chemicalconnection.dyndns.org
Re: Debconf10: Batch Queuing Systems BoF -- revisited
On Thu, May 10, 2012 at 12:38:57PM +0200, Michael Banck wrote: So having Condor certainly makes sense, but I think we have several mature (from a upstream POV) batch queueing systems in Debian now, but might lack maintenance personell. For Condor the situation is very nice in the respect. They have a fairly large group of developers, a couple of Red Hat-paid developers that are also working on distribution integration. The Debian-specific bits are quite minimalistic. Eventually, the Condor group wants to take over the helm of Debian packaging themselves -- once the have acquired the necessary skills. Michael -- Michael Hanke http://mih.voxindeserto.de -- To UNSUBSCRIBE, email to debian-science-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org Archive: http://lists.debian.org/20120510113440.GB8506@meiner
Re: Debconf10: Batch Queuing Systems BoF -- revisited
On Thu, 10 May 2012 09:49:11 +0200 Michael Hanke m...@debian.org wrote: Unfortunately, I can't attend Debconf this year, but maybe there are enough people interested in the topic to have a follow-up BoF to revisit the issue. What is the status of similar software in Debian (GridEngine, Slurm, ...)? Hello, ESRF moved away from Condor to OAR a year ago. We aim at pushing OAR (developed in INRIA Grenoble) to Debian. Maybe we could even have an OAR developer for the Sprint[1]. Cheers, -- Jérôme Kieffer On-Line Data analysis / Software Group ISDD / ESRF tel +33 476 882 445 [1] http://wiki.debian.org/Sprints/2012/ScienceSprint -- To UNSUBSCRIBE, email to debian-science-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org Archive: http://lists.debian.org/20120510144735.ffea7a01.jerome.kief...@esrf.fr
Re: Debconf10: Batch Queuing Systems BoF -- revisited
Michael Hanke m...@debian.org writes: Unfortunately, I can't attend Debconf this year, but maybe there are enough people interested in the topic to have a follow-up BoF to revisit the issue. I'll be at debconf in Managua, and I would certainly attend such a BoF. I also have some interest in the continuing existence of gridengine in Debian, since that is what our local clusters use. If there is some interest I can put an entry into penta (or somebody else is welcome to, of course). d -- To UNSUBSCRIBE, email to debian-science-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org Archive: http://lists.debian.org/87ehqsw31b.fsf@zancas.localnet
