Re: [openstack-dev] [nova] Proposal: Move CPU and memory allocation ratio out of scheduler

2014-06-12 Thread Day, Phil
> -Original Message- > From: Jay Pipes [mailto:jaypi...@gmail.com] > Sent: 09 June 2014 19:03 > To: openstack-dev@lists.openstack.org > Subject: Re: [openstack-dev] [nova] Proposal: Move CPU and memory > allocation ratio out of scheduler > > On 06/09/2014 12:32

Re: [openstack-dev] [nova] Proposal: Move CPU and memory allocation ratio out of scheduler

2014-06-11 Thread Andy Hill
> Pray tell, what is that valid use case? The valid use cases I've seen are mostly around testing. As an administrator/operator, a scheduler hint to boot directly to a host is useful to fully QC new compute hosts coming online. It's also useful for testing some networking flow cases, a specific

Re: [openstack-dev] [nova] Proposal: Move CPU and memory allocation ratio out of scheduler

2014-06-10 Thread Solly Ross
Response inline - Original Message - > From: "Alex Glikson" > To: "OpenStack Development Mailing List (not for usage questions)" > > Sent: Monday, June 9, 2014 3:13:52 PM > Subject: Re: [openstack-dev] [nova] Proposal: Move CPU and memory allocation

Re: [openstack-dev] [nova] Proposal: Move CPU and memory allocation ratio out of scheduler

2014-06-09 Thread Alex Glikson
va] Proposal: Move CPU and memory allocation ratio out of scheduler From: Scott Devoid [mailto:dev...@anl.gov] Sent: 04 June 2014 17:36 To: OpenStack Development Mailing List (not for usage questions) Subject: Re: [openstack-dev] [nova] Proposal: Move CPU and memory allocation ratio out of

Re: [openstack-dev] [nova] Proposal: Move CPU and memory allocation ratio out of scheduler

2014-06-09 Thread Jay Pipes
On 06/09/2014 12:47 PM, Joe Cropper wrote: There may also be specific software entitlement issues that make it useful to deterministically know which host your VM will be placed on. This can be quite common in large organizations that have certain software that can be tied to certain hardware or

Re: [openstack-dev] [nova] Proposal: Move CPU and memory allocation ratio out of scheduler

2014-06-09 Thread Jay Pipes
On 06/09/2014 12:32 PM, Chris Friesen wrote: On 06/09/2014 07:59 AM, Jay Pipes wrote: On 06/06/2014 08:07 AM, Murray, Paul (HP Cloud) wrote: Forcing an instance to a specific host is very useful for the operator - it fulfills a valid use case for monitoring and testing purposes. Pray tell, wh

Re: [openstack-dev] [nova] Proposal: Move CPU and memory allocation ratio out of scheduler

2014-06-09 Thread Joe Cropper
There may also be specific software entitlement issues that make it useful to deterministically know which host your VM will be placed on. This can be quite common in large organizations that have certain software that can be tied to certain hardware or hardware with certain # of CPU capacity, etc

Re: [openstack-dev] [nova] Proposal: Move CPU and memory allocation ratio out of scheduler

2014-06-09 Thread Chris Friesen
On 06/09/2014 07:59 AM, Jay Pipes wrote: On 06/06/2014 08:07 AM, Murray, Paul (HP Cloud) wrote: Forcing an instance to a specific host is very useful for the operator - it fulfills a valid use case for monitoring and testing purposes. Pray tell, what is that valid use case? I find it useful

Re: [openstack-dev] [nova] Proposal: Move CPU and memory allocation ratio out of scheduler

2014-06-09 Thread Jay Pipes
On 06/05/2014 09:54 AM, Day, Phil wrote: -Original Message- From: Jay Pipes [mailto:jaypi...@gmail.com] Sent: 04 June 2014 19:23 To: openstack-dev@lists.openstack.org Subject: Re: [openstack-dev] [nova] Proposal: Move CPU and memory allocation ratio out of scheduler On 06/04/2014 11:56

Re: [openstack-dev] [nova] Proposal: Move CPU and memory allocation ratio out of scheduler

2014-06-09 Thread Jay Pipes
Subject: Re: [openstack-dev] [nova] Proposal: Move CPU and memory allocation ratio out of scheduler On 06/04/2014 06:10 AM, Murray, Paul (HP Cloud) wrote: Hi Jay, This sounds good to me. You left out the part of limits from the discussion - these filters set the limits used at the resource

Re: [openstack-dev] [nova] Proposal: Move CPU and memory allocation ratio out of scheduler

2014-06-06 Thread Murray, Paul (HP Cloud)
pment Mailing List (not for usage questions) > *Subject:* Re: [openstack-dev] [nova] Proposal: Move CPU and memory > allocation ratio out of scheduler > > Does there is any blueprint related to this? Thanks. > > 2014-06-03 21:29 GMT+08:00 Jay Pipes <mailto:jaypi...@gmai

Re: [openstack-dev] [nova] Proposal: Move CPU and memory allocation ratio out of scheduler

2014-06-06 Thread Day, Phil
From: Scott Devoid [mailto:dev...@anl.gov] Sent: 04 June 2014 17:36 To: OpenStack Development Mailing List (not for usage questions) Subject: Re: [openstack-dev] [nova] Proposal: Move CPU and memory allocation ratio out of scheduler Not only live upgrades but also dynamic reconfiguration

Re: [openstack-dev] [nova] Proposal: Move CPU and memory allocation ratio out of scheduler

2014-06-06 Thread Day, Phil
From: Scott Devoid [mailto:dev...@anl.gov] Sent: 04 June 2014 17:36 To: OpenStack Development Mailing List (not for usage questions) Subject: Re: [openstack-dev] [nova] Proposal: Move CPU and memory allocation ratio out of scheduler Not only live upgrades but also dynamic reconfiguration

Re: [openstack-dev] [nova] Proposal: Move CPU and memory allocation ratio out of scheduler

2014-06-05 Thread Day, Phil
> -Original Message- > From: Jay Pipes [mailto:jaypi...@gmail.com] > Sent: 04 June 2014 19:23 > To: openstack-dev@lists.openstack.org > Subject: Re: [openstack-dev] [nova] Proposal: Move CPU and memory > allocation ratio out of scheduler > > On 06/04/2014 1

Re: [openstack-dev] [nova] Proposal: Move CPU and memory allocation ratio out of scheduler

2014-06-04 Thread Steve Gordon
- Original Message - > From: "ChangBo Guo" > To: "OpenStack Development Mailing List (not for usage questions)" > > Sent: Tuesday, June 3, 2014 10:40:19 PM > Subject: Re: [openstack-dev] [nova] Proposal: Move CPU and memory allocation > ratio

Re: [openstack-dev] [nova] Proposal: Move CPU and memory allocation ratio out of scheduler

2014-06-04 Thread Jay Pipes
spec... Best, -jay -Original Message- From: Jay Pipes [mailto:jaypi...@gmail.com] Sent: 03 June 2014 14:29 To: OpenStack Development Mailing List Subject: [openstack-dev] [nova] Proposal: Move CPU and memory allocation ratio out of scheduler Hi Stackers, tl;dr = Move CPU and RAM allocat

Re: [openstack-dev] [nova] Proposal: Move CPU and memory allocation ratio out of scheduler

2014-06-04 Thread Jay Pipes
enstack-dev] [nova] Proposal: Move CPU and memory allocation ratio out of scheduler Does there is any blueprint related to this? Thanks. 2014-06-03 21:29 GMT+08:00 Jay Pipes mailto:jaypi...@gmail.com>>: Hi Stackers, tl;dr = Move CPU and RAM allocation ratio definition out of the Nov

Re: [openstack-dev] [nova] Proposal: Move CPU and memory allocation ratio out of scheduler

2014-06-04 Thread Jay Pipes
On 06/04/2014 12:19 PM, Mike Spreitzer wrote: John Garbutt wrote on 06/04/2014 04:29:36 AM: > On 3 June 2014 14:29, Jay Pipes wrote: > > tl;dr > > = > > > > Move CPU and RAM allocation ratio definition out of the Nova scheduler and > > into the resource tracker. Remove the calculatio

Re: [openstack-dev] [nova] Proposal: Move CPU and memory allocation ratio out of scheduler

2014-06-04 Thread Jay Pipes
On 06/04/2014 03:08 AM, Yingjun Li wrote: +1, if doing so, a related bug related bug may be solved as well: https://bugs.launchpad.net/nova/+bug/1323538 Yep, I agree that the above bug would be addressed. Best, -jay On Jun 3, 2014, at 21:29, Jay Pipes mailto:jaypi...@gmail.com>> wrote: Hi

Re: [openstack-dev] [nova] Proposal: Move CPU and memory allocation ratio out of scheduler

2014-06-04 Thread Jay Pipes
On 06/03/2014 10:40 PM, ChangBo Guo wrote: Jay, thanks for raising this up . +1 for this . A related question about the CPU and RAM allocation ratio, shall we apply them when get hypervisor information with command "nova hypervisor-show ${hypervisor-name}" The output shows like | memory_mb

Re: [openstack-dev] [nova] Proposal: Move CPU and memory allocation ratio out of scheduler

2014-06-04 Thread Qin Zhao
On Thu, Jun 5, 2014 at 12:19 AM, Mike Spreitzer wrote: > > Overcommitting affects the quality of service delivered to the cloud user. > In this situation in particular, as in many situations in general, I think > we want to enable the service provider to offer multiple qualities of > service. T

Re: [openstack-dev] [nova] Proposal: Move CPU and memory allocation ratio out of scheduler

2014-06-04 Thread Scott Devoid
> > Not only live upgrades but also dynamic reconfiguration. > > Overcommitting affects the quality of service delivered to the cloud user. > In this situation in particular, as in many situations in general, I think > we want to enable the service provider to offer multiple qualities of > service

Re: [openstack-dev] [nova] Proposal: Move CPU and memory allocation ratio out of scheduler

2014-06-04 Thread Mike Spreitzer
John Garbutt wrote on 06/04/2014 04:29:36 AM: > On 3 June 2014 14:29, Jay Pipes wrote: > > tl;dr > > = > > > > Move CPU and RAM allocation ratio definition out of the Nova scheduler and > > into the resource tracker. Remove the calculations for overcommit out of the > > core_filter and ram

Re: [openstack-dev] [nova] Proposal: Move CPU and memory allocation ratio out of scheduler

2014-06-04 Thread Day, Phil
June 2014 14:29 > To: OpenStack Development Mailing List > Subject: [openstack-dev] [nova] Proposal: Move CPU and memory allocation > ratio out of scheduler > > Hi Stackers, > > tl;dr > = > > Move CPU and RAM allocation ratio definition out of the Nova sch

Re: [openstack-dev] [nova] Proposal: Move CPU and memory allocation ratio out of scheduler

2014-06-04 Thread Murray, Paul (HP Cloud)
extensible resource tracker is the right way to do it ☺ Paul. From: Jay Lau [mailto:jay.lau@gmail.com] Sent: 04 June 2014 10:04 To: OpenStack Development Mailing List (not for usage questions) Subject: Re: [openstack-dev] [nova] Proposal: Move CPU and memory allocation ratio out of scheduler

Re: [openstack-dev] [nova] Proposal: Move CPU and memory allocation ratio out of scheduler

2014-06-04 Thread Jay Lau
Does there is any blueprint related to this? Thanks. 2014-06-03 21:29 GMT+08:00 Jay Pipes : > Hi Stackers, > > tl;dr > = > > Move CPU and RAM allocation ratio definition out of the Nova scheduler and > into the resource tracker. Remove the calculations for overcommit out of > the core_filter

Re: [openstack-dev] [nova] Proposal: Move CPU and memory allocation ratio out of scheduler

2014-06-04 Thread Jaesuk Ahn
+1 for this proposal. We are highly interested in this one. Jaesuk Ahn, Ph.D. Team Lead, Next Generation Cloud Platform Dev. Project KT … active member of openstack community On Jun 4, 2014, 5:29:36 PM, John Garbutt wrote: On 3 June 2014 14:29, Jay Pipes

Re: [openstack-dev] [nova] Proposal: Move CPU and memory allocation ratio out of scheduler

2014-06-04 Thread Zhenguo Niu
+1, makes sense to me. On Wed, Jun 4, 2014 at 3:08 PM, Yingjun Li wrote: > +1, if doing so, a related bug related bug may be solved as well: > https://bugs.launchpad.net/nova/+bug/1323538 > > On Jun 3, 2014, at 21:29, Jay Pipes wrote: > > Hi Stackers, > > tl;dr > = > > Move CPU and RAM all

Re: [openstack-dev] [nova] Proposal: Move CPU and memory allocation ratio out of scheduler

2014-06-04 Thread John Garbutt
On 3 June 2014 14:29, Jay Pipes wrote: > tl;dr > = > > Move CPU and RAM allocation ratio definition out of the Nova scheduler and > into the resource tracker. Remove the calculations for overcommit out of the > core_filter and ram_filter scheduler pieces. +1 I hope to see us send more specif

Re: [openstack-dev] [nova] Proposal: Move CPU and memory allocation ratio out of scheduler

2014-06-04 Thread Yingjun Li
+1, if doing so, a related bug related bug may be solved as well: https://bugs.launchpad.net/nova/+bug/1323538 On Jun 3, 2014, at 21:29, Jay Pipes wrote: > Hi Stackers, > > tl;dr > = > > Move CPU and RAM allocation ratio definition out of the Nova scheduler and > into the resource tracke

Re: [openstack-dev] [nova] Proposal: Move CPU and memory allocation ratio out of scheduler

2014-06-03 Thread ChangBo Guo
Jay, thanks for raising this up . +1 for this . A related question about the CPU and RAM allocation ratio, shall we apply them when get hypervisor information with command "nova hypervisor-show ${hypervisor-name}" The output shows like | memory_mb | 15824 | | memory_mb_used

Re: [openstack-dev] [nova] Proposal: Move CPU and memory allocation ratio out of scheduler

2014-06-03 Thread Chris Friesen
On 06/03/2014 07:29 AM, Jay Pipes wrote: Hi Stackers, tl;dr = Move CPU and RAM allocation ratio definition out of the Nova scheduler and into the resource tracker. Remove the calculations for overcommit out of the core_filter and ram_filter scheduler pieces. Makes sense to me. Chris __

Re: [openstack-dev] [nova] Proposal: Move CPU and memory allocation ratio out of scheduler

2014-06-03 Thread Scott Devoid
> > It may be useful to have an API query which tells you all the numbers you > may need - real hardware values, values after using the configured > overcommit ratios and currently used values. > +1 to an exposed admin-API for host resource state and calculations, especially if this allowed you to

Re: [openstack-dev] [nova] Proposal: Move CPU and memory allocation ratio out of scheduler

2014-06-03 Thread Jesse Pretorius
On 3 June 2014 15:29, Jay Pipes wrote: > Move CPU and RAM allocation ratio definition out of the Nova scheduler and > into the resource tracker. Remove the calculations for overcommit out of > the core_filter and ram_filter scheduler pieces. Makes sense to me. I especially like the idea of bei

[openstack-dev] [nova] Proposal: Move CPU and memory allocation ratio out of scheduler

2014-06-03 Thread Jay Pipes
Hi Stackers, tl;dr = Move CPU and RAM allocation ratio definition out of the Nova scheduler and into the resource tracker. Remove the calculations for overcommit out of the core_filter and ram_filter scheduler pieces. Details === Currently, in the Nova code base, the thing that cont