Thank you for your answers,
The slurm starcluster plugin seems really interesting for us. However,
our cloud is Eucalpytus based, and they use the "boto" lib v2.3 to
communicate with AWS-EC2, but this version compatible with Eucalyptus
2.0.x, and we are not sure it is with the 3.0.x.
But this is not really your stuff there, but if you have some
information, it would be nice.
--
Léo Unbekandt
Team ICPS in the LSIIT Labs
Strasbourg — France
On 06/20/2012 03:19 PM, Jharrod W. LaFon wrote:
Hi Léo,
You may want to look at StarCluster (http://web.mit.edu/star/cluster/)
and a fork of it that features a slurm load balancer:
https://github.com/jlafon/StarCluster
Getting started:
https://github.com/jlafon/StarCluster/wiki/Getting-Started-with-SLURM-on-Amazon-EC2
--
Jharrod LaFon
On Wed, Jun 20, 2012 at 4:35 AM, Léo Unbekandt <[email protected]
<mailto:[email protected]>> wrote:
Hi,
I'm doing an internship in a research team and we are working on
interfacing slurm with some cloud platforms
(EC2/OpenStack/Eucalyptus,�).
Our goal is to optimize the number of virtual machines that are
computing our jobs (finally to reduce the price which is about
0.08cts/core/hour). So we need to implement different scheduling
algorithms which must dynamically ask our IaaS controller to boot
one or
several virtual machines (which, once have booted become available
slurm
nodes, waiting for jobs)
The question is, how do you think we must implement these algorithms ?
Which kind of plugin must we create ? We first start a new �
select �
plugin (functions select_p_job_test mainly), but we are not sure
that's
the good way to do it.
Furthermore, in an elastic cloud like Amazon's, we pay per hour,
so when
the workload decrease we need to shutdown virtual machines. We
have seen
that the scheduler job is called really often, do you think it's a
good
idea to check at that time ? (ie. A node is up since 58min and doesn't
have anything to do right now so we shutdown it.)
Thanks for your answers
--
L�o Unbekandt
Team ICPS in the LSIIT Labs
Strasbourg � France
--
--
Jharrod LaFon
