queue management algorithms

2013-04-07 Thread ik
Hello, I have a very complex queue management requirements, I need to calculate task weight, time restrictions for execution, number of possible execution at given time, changes of the data when it is inside the queue and even disabling specific task. some tasks have very short time to live, and

Re: queue management algorithms

2013-04-07 Thread Orna Agmon Ben-Yehuda
If you are not in the kernel, you might with to consider slurm or the lesser ones ((open)PBS, torque), condor, boinc. If you need really complex things (dependencies), you need a scientific flow manager such as kepler. On Sun, Apr 7, 2013 at 2:27 PM, ik ido...@gmail.com wrote: Hello, I have

Re: queue management algorithms

2013-04-07 Thread ik
On Sun, Apr 7, 2013 at 2:39 PM, Orna Agmon Ben-Yehuda ladyp...@gmail.comwrote: If you are not in the kernel, Userspace all the way. Actually never touched the Kernel. you might with to consider slurm or the lesser ones ((open)PBS, torque), condor, boinc. If you need really complex

Re: queue management algorithms

2013-04-07 Thread Oleg Goldshmidt
On Sun, Apr 7, 2013 at 2:27 PM, ik ido...@gmail.com wrote: Hello, I have a very complex queue management requirements, I need to calculate task weight, time restrictions for execution, number of possible execution at given time, changes of the data when it is inside the queue and even

Re: queue management algorithms

2013-04-07 Thread ik
On Sun, Apr 7, 2013 at 3:51 PM, Oleg Goldshmidt p...@goldshmidt.org wrote: On Sun, Apr 7, 2013 at 2:27 PM, ik ido...@gmail.com wrote: Hello, I have a very complex queue management requirements, I need to calculate task weight, time restrictions for execution, number of possible execution

Re: queue management algorithms

2013-04-07 Thread Orna Agmon Ben-Yehuda
If you are looking for something reliable for many tasks scheduled at a time (e.g., one user may send a hundred tasks within one second) go for slurm. openPBS, torque, condor cannot take the heat. I heard that PBS (not open) can, too. On Sun, Apr 7, 2013 at 5:30 PM, ik ido...@gmail.com wrote:

Re: queue management algorithms

2013-04-07 Thread ik
On Sun, Apr 7, 2013 at 6:36 PM, Orna Agmon Ben-Yehuda ladyp...@gmail.comwrote: If you are looking for something reliable for many tasks scheduled at a time (e.g., one user may send a hundred tasks within one second) go for slurm. openPBS, torque, condor cannot take the heat. I heard that PBS

Re: queue management algorithms

2013-04-07 Thread Orna Agmon Ben-Yehuda
On Sun, Apr 7, 2013 at 7:21 PM, ik ido...@gmail.com wrote: On Sun, Apr 7, 2013 at 6:36 PM, Orna Agmon Ben-Yehuda ladyp...@gmail.comwrote: If you are looking for something reliable for many tasks scheduled at a time (e.g., one user may send a hundred tasks within one second) go for