Re: [Openstack] [metering] ceilometer dev docs on readthedocs.org

2012-07-03 Thread Loic Dachary
On 07/03/2012 07:46 PM, Doug Hellmann wrote: I've set up the ceilometer development documentation build on RTD at http://ceilometer.readthedocs.org/en/latest/index.html Hi, I've updated https://launchpad.net/ceilometer to list this link. Cheers

Re: [Openstack] [metering] delta vs. cumulative meters

2012-05-29 Thread Loic Dachary
On 05/29/2012 05:42 PM, Doug Hellmann wrote: IIRC, the meters discussed in the wiki [1] are supposed to show delta values (usage since the last time an event was generated), although the Alternate Gauge Design section discusses cumulative meters instead. The libvirt pollsters we have now

Re: [Openstack] [metering] delta vs. cumulative meters

2012-05-29 Thread Loic Dachary
On 05/29/2012 07:58 PM, Doug Hellmann wrote: On Tue, May 29, 2012 at 12:30 PM, Loic Dachary l...@enovance.com mailto:l...@enovance.com wrote: On 05/29/2012 05:42 PM, Doug Hellmann wrote: IIRC, the meters discussed in the wiki [1] are supposed to show delta values (usage since

Re: [Openstack] [metering] Do we need an API and storage?

2012-05-17 Thread Loic Dachary
On 05/16/2012 11:00 PM, Francis J. Lacoste wrote: I'm now of the opinion that we exclude storage and API from the metering project scope. Let's just focus on defining a metering message format, bus, and maybe a client-library to make it easy to write metering consumers. That way we avoid

Re: [Openstack] [metering] resources metadata

2012-05-15 Thread Loic Dachary
On 05/15/2012 12:05 PM, Julien Danjou wrote: OTOH I find the metadata proposal in another table too much complicated. Why not storing what metadata in the meter.payload field in the same table (e.g. as a JSON string)? I would be much simpler to store the metadata in the resource_id field which

Re: [Openstack] [metering] licensing

2012-05-14 Thread Loic Dachary
On 05/12/2012 01:30 AM, Doug Hellmann wrote: On Fri, May 11, 2012 at 5:27 PM, Loic Dachary l...@enovance.com mailto:l...@enovance.com wrote: On 05/11/2012 10:01 PM, Doug Hellmann wrote: I was very surprised to see the change to license ceilometer as AGPL [1]. Why are we

Re: [Openstack] [metering] public API design

2012-05-14 Thread Loic Dachary
On 05/11/2012 10:21 PM, Doug Hellmann wrote: On Fri, May 11, 2012 at 3:40 PM, Loic Dachary l...@enovance.com mailto:l...@enovance.com wrote: On 05/11/2012 05:55 PM, Doug Hellmann wrote: While thinking about this use case I also had a simple idea to optimize the storage

Re: [Openstack] [metering] need +2 reviews/approvals

2012-05-14 Thread Loic Dachary
On 05/14/2012 05:05 PM, Doug Hellmann wrote: Julien has done a good bit of work bootstrapping the server implementation, but we need to have more +2 reviews (and approvals) of the code [1] before it will make it into the public repository. Are we holding off on doing those reviews on

Re: [Openstack] [metering] resources metadata

2012-05-14 Thread Loic Dachary
On 05/14/2012 04:15 PM, Doug Hellmann wrote: On Fri, May 11, 2012 at 3:55 PM, Loic Dachary l...@enovance.com mailto:l...@enovance.com wrote: - The interesting metadata for a resource may depend on the type of resource. Do we need separate tables for that or can we normalize

Re: [Openstack] [Metering] API Extensibility

2012-05-14 Thread Loic Dachary
On 05/10/2012 05:54 PM, Doug Hellmann wrote: On Thu, May 10, 2012 at 9:22 AM, Loic Dachary l...@enovance.com mailto:l...@enovance.com wrote: Another item that we need to discuss is extensibility of this API. Hi, Here is a proposal, which we could discuss further during

Re: [Openstack] [Metering] Meeting agenda for today 16:00 UTC (May 10th, 2012)

2012-05-11 Thread Loic Dachary
On 05/10/2012 02:14 PM, Loic Dachary wrote: Hi, The metering project team holds a meeting in #openstack-meeting, Thursdays at 1600 UTC http://www.timeanddate.com/worldclock/fixedtime.html?hour=16min=0sec=0. Everyone is welcome. I propose an agenda based on the discussions we had

Re: [Openstack] [metering] public API design

2012-05-11 Thread Loic Dachary
On 05/11/2012 05:55 PM, Doug Hellmann wrote: During yesterday's meeting we discussed the API proposal at http://wiki.openstack.org/EfficientMetering#API and came up with a few missing items and other points for discussion. We should try to work out those details on the list before the meeting

Re: [Openstack] [metering] resources metadata (was: public API design)

2012-05-11 Thread Loic Dachary
- The interesting metadata for a resource may depend on the type of resource. Do we need separate tables for that or can we normalize somehow? - How do we map a resource to the correct version of its metadata at any given time? Timestamps seem brittle. - Do we need to reflect the metadata

Re: [Openstack] [Metering] schema and counter definitions

2012-05-10 Thread Loic Dachary
On 05/09/2012 11:11 PM, Doug Hellmann wrote: On Wed, May 9, 2012 at 3:07 PM, Tomasz Paszkowski ss7...@gmail.com mailto:ss7...@gmail.com wrote: On Wed, May 9, 2012 at 8:02 PM, Doug Hellmann doug.hellm...@dreamhost.com mailto:doug.hellm...@dreamhost.com wrote: Nice!

[Openstack] [Metering] Meeting agenda for today 16:00 UTC (May 10th, 2012)

2012-05-10 Thread Loic Dachary
Hi, The metering project team holds a meeting in #openstack-meeting, Thursdays at 1600 UTC http://www.timeanddate.com/worldclock/fixedtime.html?hour=16min=0sec=0. Everyone is welcome. I propose an agenda based on the discussions we had on this list.

Re: [Openstack] [Metering] Meeting agenda for today 16:00 UTC (May 10th, 2012)

2012-05-10 Thread Loic Dachary
On 05/10/2012 02:14 PM, Loic Dachary wrote: Hi, The metering project team holds a meeting in #openstack-meeting, Thursdays at 1600 UTC http://www.timeanddate.com/worldclock/fixedtime.html?hour=16min=0sec=0. Everyone is welcome. I propose an agenda based on the discussions we had

Re: [Openstack] [Metering] API Extensibility (was: External API definition)

2012-05-10 Thread Loic Dachary
Another item that we need to discuss is extensibility of this API. Hi, Here is a proposal, which we could discuss further during the meeting. GET extension=param1=fooparam2=bar The API looks up /usr/share/ceilometer/extensions/.py and loads it. The module defines a query

Re: [Openstack] [Metering] Bootstrapping, first counter implementation

2012-05-09 Thread Loic Dachary
On 05/09/2012 05:38 PM, Doug Hellmann wrote: What is the difference between review.stackforge.org http://review.stackforge.org and review.openstack.org http://review.openstack.org and why aren't we using the latter? There is no technical difference (to my knowledge ;-). Only

Re: [Openstack] [Metering] schema and counter definitions

2012-05-04 Thread Loic Dachary
On 05/04/2012 11:50 AM, Thierry Carrez wrote: Robert Collins wrote: On Fri, May 4, 2012 at 5:27 AM, Turner, Whit (Cloud Services) whit.tur...@hp.com wrote: Hi - I think a flexible aggregation scheme is needed; the levels of aggregation available should be definable in the meter independent of

Re: [Openstack] [Metering] how should it be done ? ( Was: schema and counter definitions)

2012-05-03 Thread Loic Dachary
On 05/03/2012 05:25 AM, Andrew Clay Shafer wrote: Integrating the metering agents as part of the core component, much in the same way it's currently done in nova. What specifically is done? If metering is not integrated in the beginning it will likely never be. Hi, I'm refering to

[Openstack] [Metering] Meeting agenda for today 16:00 UTC (May 3rd, 2012)

2012-05-03 Thread Loic Dachary
Hi, The metering project team holds a meeting in #openstack-meeting, Thursdays at 1600 UTC http://www.timeanddate.com/worldclock/fixedtime.html?hour=16min=0sec=0. Everyone is welcome. I propose an agenda based on the discussions we had on this list.

Re: [Openstack] [Metering] how should it be done ? ( Was: schema and counter definitions)

2012-05-03 Thread Loic Dachary
On 05/03/2012 09:58 AM, Robert Collins wrote: On Wed, May 2, 2012 at 10:28 AM, Loic Dachary l...@enovance.com wrote: As I wrote in a previous mail, once we manage to provide an implementation that proves useful, we will be in a position to approach the core OpenStack components. Integrating

Re: [Openstack] [Metering] schema and counter definitions

2012-05-02 Thread Loic Dachary
On 05/02/2012 07:19 AM, Mark McLoughlin wrote: Hey, On Tue, 2012-05-01 at 23:05 +0200, Loic Dachary wrote: On 05/01/2012 06:13 PM, Mark McLoughlin wrote: Hi Loic, On Mon, 2012-04-30 at 12:15 +0200, Loic Dachary wrote: - I agree that we don't want to go too far with aggregation and lose

Re: [Openstack] [Metering] schema and counter definitions

2012-05-02 Thread Loic Dachary
On 05/02/2012 07:39 AM, Mark McLoughlin wrote: On Tue, 2012-05-01 at 23:05 +0200, Loic Dachary wrote: On 05/01/2012 06:13 PM, Mark McLoughlin wrote: Hi Loic, On Mon, 2012-04-30 at 12:15 +0200, Loic Dachary wrote: To prepare for the next meeting ( thursday 3rd, may 2012 http

Re: [Openstack] [Metering] schema and counter definitions

2012-05-01 Thread Loic Dachary
On 04/30/2012 11:39 PM, Doug Hellmann wrote: On Mon, Apr 30, 2012 at 3:43 PM, Loic Dachary l...@enovance.com mailto:l...@enovance.com wrote: On 04/30/2012 08:03 PM, Doug Hellmann wrote: On Mon, Apr 30, 2012 at 11:43 AM, Loic Dachary l...@enovance.com mailto:l...@enovance.com

Re: [Openstack] [Metering] schema and counter definitions

2012-05-01 Thread Loic Dachary
On 05/01/2012 04:38 PM, Nick Barcet wrote: On 05/01/2012 02:23 AM, Loic Dachary wrote: On 04/30/2012 11:39 PM, Doug Hellmann wrote: On Mon, Apr 30, 2012 at 3:43 PM, Loic Dachary l...@enovance.com mailto:l...@enovance.com wrote: On 04/30/2012 08:03 PM, Doug Hellmann wrote: On Mon

Re: [Openstack] [Metering] schema and counter definitions

2012-05-01 Thread Loic Dachary
On 05/01/2012 05:49 PM, Doug Hellmann wrote: On Tue, May 1, 2012 at 10:38 AM, Nick Barcet nick.bar...@canonical.com mailto:nick.bar...@canonical.com wrote: On 05/01/2012 02:23 AM, Loic Dachary wrote: On 04/30/2012 11:39 PM, Doug Hellmann wrote: On Mon, Apr 30

Re: [Openstack] [Metering] schema and counter definitions

2012-05-01 Thread Loic Dachary
On 05/01/2012 06:13 PM, Mark McLoughlin wrote: Hi Loic, On Mon, 2012-04-30 at 12:15 +0200, Loic Dachary wrote: To prepare for the next meeting ( thursday 3rd, may 2012 http://wiki.openstack.org/Meetings/MeteringAgenda ) I cleaned up and reorganized the Metering blueprint so

Re: [Openstack] [Metering] how should it be done ? ( Was: schema and counter definitions)

2012-05-01 Thread Loic Dachary
On 05/01/2012 09:57 PM, Andrew Clay Shafer wrote: I'm glad to see people championing the effort to implement metering. Is there someway to refocus the enthusiasm for solving the metering problem into engineering a general solution in OpenStack? I'm just going to apologize in advance, but I

[Openstack] [Metering] schema and counter definitions

2012-04-30 Thread Loic Dachary
Hi, To prepare for the next meeting ( thursday 3rd, may 2012 http://wiki.openstack.org/Meetings/MeteringAgenda ) I cleaned up and reorganized the Metering blueprint so that it ( hopefully ) incorporates all the information temporarily stored in the etherpad (

Re: [Openstack] [Metering] schema and counter definitions

2012-04-30 Thread Loic Dachary
On 04/30/2012 12:15 PM, Loic Dachary wrote: We could start a discussion from the content of the following sections: http://wiki.openstack.org/EfficientMetering#Counters I think the rationale of the counter aggregation needs to be explained. My understanding is that the metering system

Re: [Openstack] Openstack Essex - Guide for Ubuntu 12.04

2012-04-30 Thread Loic Dachary
On 04/30/2012 10:52 AM, Martin Gerhard Loschwitz wrote: Am 30.04.12 09:41, schrieb Emilien Macchi: Hi, I release my first documentation on OpenStack Essex for Ubuntu 12.04. I've been working for three weeks with StackOps for my internship, and my work is focused ont Quantum (Networking as

Re: [Openstack] [Metering] Metering repository in stackforge

2012-04-30 Thread Loic Dachary
On 04/28/2012 06:31 AM, Monty Taylor wrote: Hey! On 04/27/2012 06:20 PM, Loic Dachary wrote: Hi, I would like to create a repository ceilometer in https://github.com/stackforge to host the code for the newborn Metering project ( https://launchpad.net/ceilometer , first meeting held

Re: [Openstack] [Metering] schema and counter definitions

2012-04-30 Thread Loic Dachary
On 04/30/2012 03:49 PM, Doug Hellmann wrote: On Mon, Apr 30, 2012 at 6:46 AM, Loic Dachary l...@enovance.com mailto:l...@enovance.com wrote: On 04/30/2012 12:15 PM, Loic Dachary wrote: We could start a discussion from the content of the following sections: http

Re: [Openstack] [Metering] schema and counter definitions

2012-04-30 Thread Loic Dachary
On 04/30/2012 08:03 PM, Doug Hellmann wrote: On Mon, Apr 30, 2012 at 11:43 AM, Loic Dachary l...@enovance.com mailto:l...@enovance.com wrote: On 04/30/2012 03:49 PM, Doug Hellmann wrote: On Mon, Apr 30, 2012 at 6:46 AM, Loic Dachary l...@enovance.com mailto:l...@enovance.com

Re: [Openstack] [Metering] First meeting for the Metering project

2012-04-27 Thread Loic Dachary
On 04/27/2012 05:37 PM, Francis J. Lacoste wrote: On 12-04-27 10:50 AM, Nick Barcet wrote: The meeting occurred as planned, and overran... Nevertheless a lot of good decisions were made, the obviously most important one grin being the project name: ceilometer. For a more complete meeting

[Openstack] [Metering] Metering repository in stackforge

2012-04-27 Thread Loic Dachary
Hi, I would like to create a repository ceilometer in https://github.com/stackforge to host the code for the newborn Metering project ( https://launchpad.net/ceilometer , first meeting held this thursday http://wiki.openstack.org/Meetings/MeteringAgenda ). I'm not sure how to proceed, could

Re: [Openstack] Monitoring / Billing Architecture proposed

2012-04-24 Thread Loic Dachary
for this currently in some fashion, Dragon? -S On 04/24/2012 12:55 AM, Loic Dachary wrote: Metering needs to account for the volume of data sent to external network destinations ( i.e. n4 in http://wiki.openstack.org/EfficientMetering ) or the disk I/O etc. This kind of resource

Re: [Openstack] Monitoring / Billing Architecture proposed

2012-04-24 Thread Loic Dachary
On 04/24/2012 04:45 PM, Monsyne Dragon wrote: On Apr 24, 2012, at 9:03 AM, Loic Dachary wrote: On 04/24/2012 03:06 PM, Monsyne Dragon wrote: Yes, we emit bandwidth (bytes in/out) on a per VIF basis from each instance The event has the somewhat generic name of 'compute.instance.exists

Re: [Openstack] Monitoring / Billing Architecture proposed

2012-04-23 Thread Loic Dachary
On 04/23/2012 10:09 PM, Sandy Walsh wrote: Flavor information is copied to the Instance table on creation so the Flavors can change and still be tracked in the Instance. It may just need to be sent in the notification payload. The current events in the system are documented here:

Re: [Openstack] Providing packages for stable releases of OpenStack

2011-12-07 Thread Loic Dachary
On 12/07/2011 10:32 PM, Stefano Maffulli wrote: On Tue, 2011-12-06 at 23:56 +0100, Loic Dachary wrote: I think there is an opportunity to leverage the momentum that is growing in each distribution by creating an openstack team for them to meet. Maybe Stefano Maffulli has an idea about how

Re: [Openstack] Providing packages for stable releases of OpenStack

2011-12-06 Thread Loic Dachary
On 12/06/2011 09:24 PM, Thierry Carrez wrote: Duncan McGreggor wrote: On 06 Dec 2011 - 14:28, Thierry Carrez wrote: So the general consensus so far on this discussion seems to be: (0) The 2011.3 release PPA bears false expectations and should be removed now. In the future, we should not

Re: [Openstack] Providing packages for stable releases of OpenStack

2011-11-30 Thread Loic Dachary
Hi, TL;DR summary: The resources needed to do that properly are bigger than you think (and doing that will alienate some distro packaging resources), so we'll either do a terrible job at it, or lose focus on the development release. If there is a need, it should be done as an alternate