Re: [openstack-dev] [nova][cinder] Schedule Instances according to Local disk based Volume?

2017-02-26 Thread John Griffith
On Thu, Feb 23, 2017 at 7:18 PM, Zhenyu Zheng wrote: > Matt, > > Thanks for the information, I will check that; But still I think the user > demand here is to use local disk from > compute node as block device, as the data can be remained if the old vm > got deleted,

Re: [openstack-dev] [nova][cinder] Schedule Instances according to Local disk based Volume?

2017-02-25 Thread Matt Riedemann
On 2/23/2017 9:27 PM, Zhenyu Zheng wrote: BTW, I think this can be done using new placement service, using the custom resource provider? correct? This came up briefly on Friday at the PTG but unfortunately jaypipes and cdent had already left. You should talk to them about this for more

Re: [openstack-dev] [nova][cinder] Schedule Instances according to Local disk based Volume?

2017-02-23 Thread Zhenyu Zheng
BTW, I think this can be done using new placement service, using the custom resource provider? correct? On Fri, Feb 24, 2017 at 10:18 AM, Zhenyu Zheng wrote: > Matt, > > Thanks for the information, I will check that; But still I think the user > demand here is to use

Re: [openstack-dev] [nova][cinder] Schedule Instances according to Local disk based Volume?

2017-02-23 Thread Zhenyu Zheng
Matt, Thanks for the information, I will check that; But still I think the user demand here is to use local disk from compute node as block device, as the data can be remained if the old vm got deleted, and we can start a new one with the data and having the performance they wanted. Kevin Zheng

Re: [openstack-dev] [nova][cinder] Schedule Instances according to Local disk based Volume?

2017-02-23 Thread Matt Riedemann
On 9/26/2016 9:21 PM, Zhenyu Zheng wrote: Hi, Thanks for the reply, actually approach one is not we are looking for, our demands is to attach the real physical volume from compute node to VMs, by this way we can achieve the performance we need for usecases such as big data, this can be done by

Re: [openstack-dev] [nova][cinder] Schedule Instances according to Local disk based Volume?

2016-10-10 Thread Erlon Cruz
Kevin, Now that you had a first feedback about the idea, as Jay said, the next steps is to write a blueprint/spec so other folks in Cinder can better understand/suggest/vote on what you are proposing. Erlon On Sat, Oct 8, 2016 at 12:14 AM, Zhenyu Zheng wrote: > So

Re: [openstack-dev] [nova][cinder] Schedule Instances according to Local disk based Volume?

2016-10-07 Thread Zhenyu Zheng
So do we like the idea of "volume based scheduling?" On Tue, Sep 27, 2016 at 11:39 AM, Joshua Harlow wrote: > Huang Zhiteng wrote: > >> >> >> On Tue, Sep 27, 2016 at 12:00 AM, Joshua Harlow > > wrote: >> >> Huang

Re: [openstack-dev] [nova][cinder] Schedule Instances according to Local disk based Volume?

2016-09-26 Thread Joshua Harlow
Huang Zhiteng wrote: On Tue, Sep 27, 2016 at 12:00 AM, Joshua Harlow > wrote: Huang Zhiteng wrote: On Mon, Sep 26, 2016 at 12:05 PM, Joshua Harlow

Re: [openstack-dev] [nova][cinder] Schedule Instances according to Local disk based Volume?

2016-09-26 Thread Huang Zhiteng
On Tue, Sep 27, 2016 at 9:21 AM, Zhenyu Zheng wrote: > Hi, > > Thanks for the reply, actually approach one is not we are looking for, our > demands is to attach the real physical volume from compute node to VMs, > by this way we can achieve the performance we need for

Re: [openstack-dev] [nova][cinder] Schedule Instances according to Local disk based Volume?

2016-09-26 Thread Huang Zhiteng
On Tue, Sep 27, 2016 at 12:00 AM, Joshua Harlow wrote: > Huang Zhiteng wrote: > >> >> On Mon, Sep 26, 2016 at 12:05 PM, Joshua Harlow > > wrote: >> >> Huang Zhiteng wrote: >> >> In eBay, we did some inhouse

Re: [openstack-dev] [nova][cinder] Schedule Instances according to Local disk based Volume?

2016-09-26 Thread Zhenyu Zheng
Hi, Thanks for the reply, actually approach one is not we are looking for, our demands is to attach the real physical volume from compute node to VMs, by this way we can achieve the performance we need for usecases such as big data, this can be done by cinder using BlockDeviceDriver, it is quite

Re: [openstack-dev] [nova][cinder] Schedule Instances according to Local disk based Volume?

2016-09-26 Thread Joshua Harlow
Huang Zhiteng wrote: On Mon, Sep 26, 2016 at 12:05 PM, Joshua Harlow > wrote: Huang Zhiteng wrote: In eBay, we did some inhouse change to Nova so that our big data type of use case can have physical disks as

Re: [openstack-dev] [nova][cinder] Schedule Instances according to Local disk based Volume?

2016-09-26 Thread Erlon Cruz
On Fri, Sep 23, 2016 at 10:19 PM, Zhenyu Zheng wrote: > Hi, > > Thanks all for the information, as for the filter Erlon( > InstanceLocalityFilter) mentioned, this only solves a part of the problem, > we can create new volumes for existing instances using this filter

Re: [openstack-dev] [nova][cinder] Schedule Instances according to Local disk based Volume?

2016-09-25 Thread Huang Zhiteng
On Mon, Sep 26, 2016 at 12:05 PM, Joshua Harlow wrote: > Huang Zhiteng wrote: > >> In eBay, we did some inhouse change to Nova so that our big data type of >> use case can have physical disks as ephemeral disk for this type of >> flavors. It works well so far. My 2

Re: [openstack-dev] [nova][cinder] Schedule Instances according to Local disk based Volume?

2016-09-25 Thread Joshua Harlow
Huang Zhiteng wrote: In eBay, we did some inhouse change to Nova so that our big data type of use case can have physical disks as ephemeral disk for this type of flavors. It works well so far. My 2 cents. Is there a published patch (or patchset) anywhere that people can look at for said

Re: [openstack-dev] [nova][cinder] Schedule Instances according to Local disk based Volume?

2016-09-25 Thread Huang Zhiteng
Hi Zhenyu and all, If you look at the problem from a different angle, for example, treating local disks on hypervisors same resource like GPU/NIC, your requirement doesn't necessarily need to involve Cinder. Local disks become a resource type associated with certain group of hypervisors,

Re: [openstack-dev] [nova][cinder] Schedule Instances according to Local disk based Volume?

2016-09-25 Thread Zhenyu Zheng
Hi Matt, Yes, we can only do this using 1:1 AZs mapped for each compute node in the deployment, which is not very feasible in commercial deployment, we can either pass some hints to Cinder(for current code, cinder "InstanceLocalityFilter" uses instance uuid as parameter so it will be impossible

Re: [openstack-dev] [nova][cinder] Schedule Instances according to Local disk based Volume?

2016-09-24 Thread Matt Riedemann
On 9/23/2016 8:19 PM, Zhenyu Zheng wrote: Hi, Thanks all for the information, as for the filter Erlon(InstanceLocalityFilter) mentioned, this only solves a part of the problem, we can create new volumes for existing instances using this filter and then attach to it, but the root volume still

Re: [openstack-dev] [nova][cinder] Schedule Instances according to Local disk based Volume?

2016-09-24 Thread Jay S. Bryant
Erlon, Thanks for pointing this out. I didn't know we had this filter! Jay On 09/23/2016 01:05 PM, Erlon Cruz wrote: Not sure exactly what you mean, but in Cinder using the InstanceLocalityFilter[1], you can schedule a volume to the same compute node the instance is located. Is this what

Re: [openstack-dev] [nova][cinder] Schedule Instances according to Local disk based Volume?

2016-09-23 Thread Zhenyu Zheng
Hi, Thanks all for the information, as for the filter Erlon( InstanceLocalityFilter) mentioned, this only solves a part of the problem, we can create new volumes for existing instances using this filter and then attach to it, but the root volume still cannot be guranteed to be on the same host as

Re: [openstack-dev] [nova][cinder] Schedule Instances according to Local disk based Volume?

2016-09-23 Thread Erlon Cruz
Not sure exactly what you mean, but in Cinder using the InstanceLocalityFilter[1], you can schedule a volume to the same compute node the instance is located. Is this what you need? [1] http://docs.openstack.org/developer/cinder/scheduler-filters.html#instancelocalityfilter On Fri, Sep 23, 2016

Re: [openstack-dev] [nova][cinder] Schedule Instances according to Local disk based Volume?

2016-09-23 Thread Jay S. Bryant
Kevin, This is functionality that has been requested in the past but has never been implemented. The best way to proceed would likely be to propose a blueprint/spec for this and start working this through that. -Jay On 09/23/2016 02:51 AM, Zhenyu Zheng wrote: Hi Novaers and Cinders: