Re: [Openstack] A blueprint on dynamic consolidation of virtual machines

2012-08-17 Thread Anton Beloglazov 
Hi Diego,

Thanks for your interest! My algorithms are based on analyzing historical
data on the CPU utilization by VMs. The idea is to abstract from the
application-specific details and make the system applicable to any kinds of
workloads. The CPU utilization data are used to decide when VMs can be
consolidated, and also to deconsolidate VMs when there is a high risk of
performance degradation. If you are interested in the details of the
algorithms, they are given in the following two papers:

[1] Anton Beloglazov and Rajkumar Buyya, "Optimal Online Deterministic
Algorithms and Adaptive Heuristics for Energy and Performance Efficient
Dynamic Consolidation of Virtual Machines in Cloud Data Centers",
Concurrency and Computation: Practice and Experience (CCPE), Wiley Press,
New York, USA, 2012 (in press, accepted on September 2, 2011).
http://beloglazov.info/papers/2012-optimal-algorithms-ccpe.pdf

[2] Anton Beloglazov and Rajkumar Buyya, "Managing Overloaded Hosts for
Dynamic Consolidation of Virtual Machines in Cloud Data Centers Under
Quality of Service Constraints", IEEE Transactions on Parallel and
Distributed Systems (TPDS), IEEE CS Press, USA, 2012 (in press, accepted on
August 2, 2012).
http://beloglazov.info/papers/2012-host-overload-detection-tpds.pdf

Thanks,
Anton



On Fri, Aug 17, 2012 at 9:24 PM, Diego Parrilla Santamaría <
diego.parrilla.santama...@gmail.com> wrote:

> Hi Anton,
>
> really interesting stuff. We are also in very early stages in a research
> project to automate VM consolidation.
>
> Most of the studies focus on information taken from power supplies and
> physical devices. We are more interested in looking for patterns of
> applications usage (database hits, IOPs,  files used...)
>
> What inputs are you using in your algorithms?
> Regards
> Diego
>
> --
> Diego Parrilla
> *CEO*
> *www.stackops.com | * diego.parri...@stackops.com** | +34 649 94 43 29 |
> skype:diegoparrilla*
> * 
> *
>
> *
>
>
>
>
> On Fri, Aug 17, 2012 at 10:22 AM, Anton Beloglazov <
> anton.belogla...@gmail.com> wrote:
>
>> Hi All,
>>
>> I've recently submitted a blueprint describing my project of a framework
>> for dynamic consolidation of virtual machines for OpenStack:
>>
>>
>> https://blueprints.launchpad.net/nova/+spec/dynamic-consolidation-of-virtual-mforachines
>>
>> If anyone is interested in this topic, it would be great to get any
>> feedback or suggestions.
>>
>> Thanks,
>> Anton Beloglazov
>>
>> ___
>> Mailing list: https://launchpad.net/~openstack
>> Post to : openstack@lists.launchpad.net
>> Unsubscribe : https://launchpad.net/~openstack
>> More help   : https://help.launchpad.net/ListHelp
>>
>>
>
___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp

Re: [Openstack] A blueprint on dynamic consolidation of virtual machines

2012-08-17 Thread Ravi Jagannathan 
Interesting stuff Diego. We have rolled out a local ( very basic
consolidation process ) in our internal cloud. We detect the load and move
it acorss data stores betwen high and low capacities and also so Load
balancing of new Vms vs Datastore when provisioning new systems.

Ravi.

On Fri, Aug 17, 2012 at 7:24 AM, Diego Parrilla Santamaría <
diego.parrilla.santama...@gmail.com> wrote:

> Hi Anton,
>
> really interesting stuff. We are also in very early stages in a research
> project to automate VM consolidation.
>
> Most of the studies focus on information taken from power supplies and
> physical devices. We are more interested in looking for patterns of
> applications usage (database hits, IOPs,  files used...)
>
> What inputs are you using in your algorithms?
> Regards
> Diego
>
> --
> Diego Parrilla
> *CEO*
> *www.stackops.com | * diego.parri...@stackops.com** | +34 649 94 43 29 |
> skype:diegoparrilla*
> * 
> *
>
> *
>
>
>
>
> On Fri, Aug 17, 2012 at 10:22 AM, Anton Beloglazov <
> anton.belogla...@gmail.com> wrote:
>
>> Hi All,
>>
>> I've recently submitted a blueprint describing my project of a framework
>> for dynamic consolidation of virtual machines for OpenStack:
>>
>>
>> https://blueprints.launchpad.net/nova/+spec/dynamic-consolidation-of-virtual-mforachines
>>
>> If anyone is interested in this topic, it would be great to get any
>> feedback or suggestions.
>>
>> Thanks,
>> Anton Beloglazov
>>
>> ___
>> Mailing list: https://launchpad.net/~openstack
>> Post to : openstack@lists.launchpad.net
>> Unsubscribe : https://launchpad.net/~openstack
>> More help   : https://help.launchpad.net/ListHelp
>>
>>
>
> ___
> Mailing list: https://launchpad.net/~openstack
> Post to : openstack@lists.launchpad.net
> Unsubscribe : https://launchpad.net/~openstack
> More help   : https://help.launchpad.net/ListHelp
>
>
___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp

Re: [Openstack] A blueprint on dynamic consolidation of virtual machines

2012-08-17 Thread Diego Parrilla Santamaría 
Hi Anton,

really interesting stuff. We are also in very early stages in a research
project to automate VM consolidation.

Most of the studies focus on information taken from power supplies and
physical devices. We are more interested in looking for patterns of
applications usage (database hits, IOPs,  files used...)

What inputs are you using in your algorithms?
Regards
Diego

-- 
Diego Parrilla
*CEO*
*www.stackops.com | * diego.parri...@stackops.com** | +34 649 94 43 29 |
skype:diegoparrilla*
* 
*

*




On Fri, Aug 17, 2012 at 10:22 AM, Anton Beloglazov <
anton.belogla...@gmail.com> wrote:

> Hi All,
>
> I've recently submitted a blueprint describing my project of a framework
> for dynamic consolidation of virtual machines for OpenStack:
>
>
> https://blueprints.launchpad.net/nova/+spec/dynamic-consolidation-of-virtual-mforachines
>
> If anyone is interested in this topic, it would be great to get any
> feedback or suggestions.
>
> Thanks,
> Anton Beloglazov
>
> ___
> Mailing list: https://launchpad.net/~openstack
> Post to : openstack@lists.launchpad.net
> Unsubscribe : https://launchpad.net/~openstack
> More help   : https://help.launchpad.net/ListHelp
>
>
___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp

Re: [Openstack] A blueprint on dynamic consolidation of virtual machines

2012-08-17 Thread Anton Beloglazov 
The development is still in its early stages, but the source code is
already available on github: https://github.com/beloglazov/openstack-neat

Best regards,
Anton

On Fri, Aug 17, 2012 at 6:25 PM, Anton Beloglazov <
anton.belogla...@gmail.com> wrote:

> Sorry, the link got corrupted, here is the correct one:
>
>
> https://blueprints.launchpad.net/nova/+spec/dynamic-consolidation-of-virtual-machines
>
> Best regards,
> Anton Beloglazov
>
>
> On Fri, Aug 17, 2012 at 6:22 PM, Anton Beloglazov <
> anton.belogla...@gmail.com> wrote:
>
>> Hi All,
>>
>> I've recently submitted a blueprint describing my project of a framework
>> for dynamic consolidation of virtual machines for OpenStack:
>>
>>
>> https://blueprints.launchpad.net/nova/+spec/dynamic-consolidation-of-virtual-mforachines
>>
>> If anyone is interested in this topic, it would be great to get any
>> feedback or suggestions.
>>
>> Thanks,
>> Anton Beloglazov
>>
>
>
___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp

Re: [Openstack] A blueprint on dynamic consolidation of virtual machines

2012-08-17 Thread Anton Beloglazov 
Sorry, the link got corrupted, here is the correct one:

https://blueprints.launchpad.net/nova/+spec/dynamic-consolidation-of-virtual-machines

Best regards,
Anton Beloglazov

On Fri, Aug 17, 2012 at 6:22 PM, Anton Beloglazov <
anton.belogla...@gmail.com> wrote:

> Hi All,
>
> I've recently submitted a blueprint describing my project of a framework
> for dynamic consolidation of virtual machines for OpenStack:
>
>
> https://blueprints.launchpad.net/nova/+spec/dynamic-consolidation-of-virtual-mforachines
>
> If anyone is interested in this topic, it would be great to get any
> feedback or suggestions.
>
> Thanks,
> Anton Beloglazov
>
___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp