Hi Léo, You may want to look at StarCluster (http://web.mit.edu/star/cluster/) and a fork of it that features a slurm load balancer: https://github.com/jlafon/StarCluster
Getting started: https://github.com/jlafon/StarCluster/wiki/Getting-Started-with-SLURM-on-Amazon-EC2 -- Jharrod LaFon On Wed, Jun 20, 2012 at 4:35 AM, Léo Unbekandt <[email protected]> wrote: > > Hi, > > I'm doing an internship in a research team and we are working on > interfacing slurm with some cloud platforms (EC2/OpenStack/Eucalyptus,�). > > Our goal is to optimize the number of virtual machines that are > computing our jobs (finally to reduce the price which is about > 0.08cts/core/hour). So we need to implement different scheduling > algorithms which must dynamically ask our IaaS controller to boot one or > several virtual machines (which, once have booted become available slurm > nodes, waiting for jobs) > > The question is, how do you think we must implement these algorithms ? > Which kind of plugin must we create ? We first start a new � select � > plugin (functions select_p_job_test mainly), but we are not sure that's > the good way to do it. > > Furthermore, in an elastic cloud like Amazon's, we pay per hour, so when > the workload decrease we need to shutdown virtual machines. We have seen > that the scheduler job is called really often, do you think it's a good > idea to check at that time ? (ie. A node is up since 58min and doesn't > have anything to do right now so we shutdown it.) > > Thanks for your answers > > -- > L�o Unbekandt > Team ICPS in the LSIIT Labs > Strasbourg � France > -- -- Jharrod LaFon
