Hi all,

I'm relatively new to sge, however I have the task of making optimal use of 7 multi-core VM nodes (5 in a cluster and 2 individual) for a set of tasks. The grid engine is installed in one of the individual VMs which is serving as the master node.

I have a set of independent jobs (in hundreds or thousands) which each have 3 subtasks that have to be run in sequence). I would like a node to be assigned to the chunk of 3 jobs so that they can share the data between them.

Reading the sge manual suggests that a resource is really a queue. Should I create many queues, each with the 3 subtasks so that the data and task dependencies could be dealt with?

Also I hear that array task dependencies could be good for such tasks but not sure if I should use them.

Any advice or suggestions would be much appreciated.


Many Thanks,
Gaya


--
The University of Edinburgh is a charitable body, registered in
Scotland, with registration number SC005336.


_______________________________________________
users mailing list
[email protected]
https://gridengine.org/mailman/listinfo/users

Reply via email to