Hello
Working on a grid architecture spread across 9 geographical sites (and
counting), we (Lucas and me) would like to know if it's possible to
make a "self-modifying workflow".
Let me explain : a server on each site is a frontend to the clusters.
Each clusters contains a number of "nodes". On the frontend, you have
a set of software to reserve nodes (i.e computers) and deploy your
working environment on it.
Quick example :
|------------|
|frontend|------- cluster1 (50 nodes)
|------------|\
\---- cluster2 (50 nodes)
Since we do not know in advance in how many sites we will launch our
experiments, nor how many engine we would need to have, we'd like to
know if it is possible to create engines and register them in the
master engine dynamically.
What I've done so far :
<------------------------------------>
Fetch the number of sites (done with a web API)
foreach site do
master.register_participant( slave-x, ..... )
Open a slave.rb template, modify it with sed command and copy it to
the site frontend
end
pdef = Ruote.define_process do
#As many subprocess as needed, each of one them launched on the
correct slave engine
end
<------------------------------------>
All of that with the redis storage on the master frontend.
We could also think of more slaves being "deployed" on nodes for any
experiment purpose.
frontend-master ---> frontend-slave-1 ---> node-slave-1
\---> frontend-slave-2 ---> node-slave-1 [...]
Thank you in advance.
--
you received this message because you are subscribed to the "ruote users" group.
to post : send email to [email protected]
to unsubscribe : send email to [email protected]
more options : http://groups.google.com/group/openwferu-users?hl=en
