[OMPI users] Open MPI task scheduler

Hi, all: I need to design a task scheduler (not PBS job scheduler) on Open MPI cluster. I need to parallelize an algorithm so that a big problem is decomposed into small tasks, which can be distributed to other worker nodes by the Scheduler and after being solved, the results of these tasks

Re: [OMPI users] Open MPI task scheduler

Hi Jack, What you are seeking is the client/server pattern. Have one node act as a server. It will create a list of tasks or even a graph of tasks if you have dependencies, and then create clients that will connect to the server with an RPC protocol (I've done this with a SOAP+TCP protocol, the

Re: [OMPI users] Open MPI task scheduler

Hi, Matthieu: Thanks for your help. Most of your ideas show that what I want to do. My scheduler should be able to be called from any C++ program, which can put a list of tasks to the scheduler and then the scheduler distributes the tasks to other client nodes. It may work like in this way:

Re: [OMPI users] Open MPI task scheduler

2010/6/20 Jack Bryan : > Hi, Matthieu: > Thanks for your help. > Most of your ideas show that what I want to do. > My scheduler should be able to be called from any C++ program, which can > put > a list of tasks to the scheduler and then the scheduler distributes the >

Re: [OMPI users] Open MPI task scheduler

On Jun 20, 2010, at 1:49 PM, Jack Bryan wrote: Hi, all: I need to design a task scheduler (not PBS job scheduler) on Open MPI cluster. Quick question - why *not* PBS? Using shell scripts with the Job Array and Dependent Jobs features of PBS Pro (not sure about Maui/Torque nor SGE) you can

Re: [OMPI users] Open MPI task scheduler

Thanks for your reply. My task scheduler is application program level not OS level. PBS is to ask OS to do the job scheduling. My scheduler needs to be called by any C++ program to out tasks in to the scheduler and then distribute tasks to worker nodes. After the tasks are done, the manager

Re: [OMPI users] Open MPI task scheduler

Hi, thank you very much for your help. What is the meaning of " must find a system so that every task can be serialized in the same form." What is the meaning of "serize " ? I have no experience of programming with python and XML. I have studied your blog. Where can I find a simple example

Re: [hwloc-users] FW: Problem with hwloc_set_thread_cpubind() and pthread_barrier_wait() on new debianj

Αλέξανδρος Παπαδογιαννάκης, le Sun 20 Jun 2010 17:31:09 +0300, a écrit : > Thanks a lot for your help. Seems like the problem is > only in 2.6.32 kernel, 2.6.33 and 2.6.34 ara working > fine. I used git bisect like you suggested and the > problem is on a commit: > > sched: Fix a race between