Hi all,
I'm relatively new to sge, however I have the task of making optimal
use of 7 multi-core VM nodes (5 in a cluster and 2 individual) for a
set of tasks. The grid engine is installed in one of the individual
VMs which is serving as the master node.
I have a set of independent jobs (in hundreds or thousands) which each
have 3 subtasks that have to be run in sequence). I would like a node
to be assigned to the chunk of 3 jobs so that they can share the data
between them.
Reading the sge manual suggests that a resource is really a queue.
Should I create many queues, each with the 3 subtasks so that the data
and task dependencies could be dealt with?
Also I hear that array task dependencies could be good for such tasks
but not sure if I should use them.
Any advice or suggestions would be much appreciated.
Many Thanks,
Gaya
--
The University of Edinburgh is a charitable body, registered in
Scotland, with registration number SC005336.
_______________________________________________
users mailing list
[email protected]
https://gridengine.org/mailman/listinfo/users