Re: [Openstack] Enabling remote participation at Folsom Design Summit

2012-03-22 Thread Doug Hellmann
The PSF has had fairly good luck with Ustream for our members' meetings. They are 1-way, though, so questions or comments from remote participants have to be relayed by someone in the room (we used IRC). On Thu, Mar 22, 2012 at 1:44 AM, Marton Kiss marton.k...@gmail.com wrote: Ustream broadcast

Re: [Openstack] Being pedantic about pedanticism: HACKING styleguide

2012-03-22 Thread Doug Hellmann
Why are those sorts of instructions replicated in each project in the first place? Shouldn't they be in the wiki? On Thu, Mar 22, 2012 at 12:22 PM, Andrew Bogott abog...@wikimedia.orgwrote: Just now I set out to merge a recent style guide change from python-novaclient into the hacking docs

Re: [Openstack] Being pedantic about pedanticism: HACKING styleguide

2012-03-22 Thread Doug Hellmann
On Thu, Mar 22, 2012 at 4:22 PM, Jay Pipes jaypi...@gmail.com wrote: On 03/22/2012 01:47 PM, Doug Hellmann wrote: Why are those sorts of instructions replicated in each project in the first place? Shouldn't they be in the wiki? :) Have you ever tried to get a dozen OpenStack contributors

Re: [Openstack] ESXi documentation..

2012-04-04 Thread Doug Hellmann
links that might help in this endeavor? thanks! Hi Mike: That link was killed by this commit authored by Doug Hellmann about a month ago: https://github.com/openstack/nova/commit/c16cd04cf61fc Doug, do you recall why the vmwareapi_readme.rst docs got moved to the unused_docs

Re: [Openstack] ESXi documentation..

2012-04-06 Thread Doug Hellmann
Services Nimbis Services, Inc. www.nimbisservices.com On Apr 4, 2012, at 1:43 PM, Doug Hellmann wrote: I think it was because it was not linked from any of the other rst files. Which table of contents should it be listed in? Doug On Apr 4, 2012, at 1:41 PM, Lorin Hochstein lo

Re: [Openstack] Agreeing a common set of Image Properties

2012-04-09 Thread Doug Hellmann
On Sat, Apr 7, 2012 at 6:13 PM, Justin Santa Barbara jus...@fathomdb.comwrote: Is there a (de-facto) standard for image metadata/properties? I'd like to be able to able to launch e.g. the Debian Squeeze image provided by the cloud. This is particularly important for clouds that don't allow

Re: [Openstack] Agreeing a common set of Image Properties

2012-04-09 Thread Doug Hellmann
On Mon, Apr 9, 2012 at 12:40 PM, Justin Santa Barbara jus...@fathomdb.comwrote: On Mon, Apr 9, 2012 at 8:18 AM, Doug Hellmann doug.hellm...@dreamhost.com wrote: I'm thinking of the os prefix as standing for OpenStack, not Operating System. I would never have guessed that from the context

Re: [Openstack] Image API v2 Draft 4

2012-04-10 Thread Doug Hellmann
Nova had (and hopefully moving it to openstack-common before bringing the code into Glance). Best, -jay On 04/10/2012 06:51 AM, Doug Hellmann wrote: On Mon, Apr 9, 2012 at 5:14 PM, Justin Santa Barbara jus...@fathomdb.com mailto:jus...@fathomdb.com wrote: When you're designing

Re: [Openstack] Just JSON, and extensibility

2012-04-14 Thread Doug Hellmann
On Fri, Apr 13, 2012 at 4:20 PM, Justin Santa Barbara jus...@fathomdb.comwrote: I don't think that works for non-linear extensibility... I would be very happy if we could agree out how we're going to deal with extensibility in JSON. It is easy to support XML JSON any future formats, and

Re: [Openstack] Just JSON, and extensibility

2012-04-14 Thread Doug Hellmann
On Sat, Apr 14, 2012 at 10:46 AM, Justin Santa Barbara jus...@fathomdb.comwrote: - Each (known) extension has its own strongly-typed model object. Does that mean that an extension cannot add properties to an existing object (such as adding a new attribute an Image), or just that all of

Re: [Openstack] OpenStack Client Followup

2012-04-19 Thread Doug Hellmann
On Wed, Apr 18, 2012 at 11:07 PM, Dean Troyer dtro...@gmail.com wrote: We had a good discussion about a unified OpenStack command line client on Monday at the Design Summit. The notes are in the Etherpad at http://etherpad.openstack.org/FolsumCLI, I summarized my recollection at the bottom;

Re: [Openstack] Python UUID and SELinux AVC denials

2012-04-20 Thread Doug Hellmann
Have you tried changing Dashboard to monkey patch the uuid module to blank out the functions being loaded from ctypes? If the _uuid_generate_* functions are not set, the existing python implementation is used instead and it looks like that just uses urandom() inline. On Thu, Apr 19, 2012 at 11:53

Re: [Openstack] Python UUID and SELinux AVC denials

2012-04-23 Thread Doug Hellmann
On Sun, Apr 22, 2012 at 1:49 PM, Adam Young ayo...@redhat.com wrote: On 04/20/2012 11:51 AM, Doug Hellmann wrote: Have you tried changing Dashboard to monkey patch the uuid module to blank out the functions being loaded from ctypes? If the _uuid_generate_* functions are not set

Re: [Openstack] Canonical AWSOME

2012-04-23 Thread Doug Hellmann
On Mon, Apr 23, 2012 at 8:39 AM, Thierry Carrez thie...@openstack.orgwrote: Philipp Wollermann wrote: What's the advantage of replacing the native EC2 compatibility layer with AWSOME from a user / operator point of view? One thing that was mentioned is that the proxy could be run on top of

Re: [Openstack] HTTP status value naming normalization

2012-04-23 Thread Doug Hellmann
This sounds like a good candidate to live in openstack-common, rather than being limited to Swift. On Sat, Apr 21, 2012 at 12:22 PM, John Dickinson m...@not.mn wrote: I like what you are trying to do here. Can you please submit this as a patch through gerrit so we can get the rest of the core

Re: [Openstack] Monitoring / Billing Architecture proposed

2012-04-23 Thread Doug Hellmann
On Sun, Apr 22, 2012 at 5:29 PM, Brian Schott brian.sch...@nimbisservices.com wrote: Dough is a proposed billing service. There was a session at Folsom design summit. This is a practical project for an OpenStack provider with test code on github.

Re: [Openstack] Canonical AWSOME

2012-04-23 Thread Doug Hellmann
Martin Packman mentioned that there are some other groups interested in creating a separate AWS validation test suite, and that AWSOME would probably be using that. I think Joshua Harlow from Yahoo! was working in that area, too. On Mon, Apr 23, 2012 at 1:38 PM, Joshua Harlow

Re: [Openstack] [quantum] summit slides for clearpath service insertion

2012-04-23 Thread Doug Hellmann
It would also be helpful for us newbies if you add your (full) name as session leader. I have first names and faces for a lot of people, but there are quite a few duplicate first names on the lists. Thanks! Doug On Mon, Apr 23, 2012 at 1:58 PM, Dan Wendlandt d...@nicira.com wrote: Adding

Re: [Openstack] Using Foreign Keys

2012-04-25 Thread Doug Hellmann
On Wed, Apr 25, 2012 at 7:38 AM, Andrew Hutchings and...@linuxjedi.co.ukwrote: On 12/04/12 13:35, J. Daniel Schmidt wrote: While testing our SUSE OpenStack packages we hit a nasty bug and reported it as: https://bugs.launchpad.net/keystone/+bug/972502 We found out that the underlying

Re: [Openstack] Using Foreign Keys

2012-04-25 Thread Doug Hellmann
at all). Vish On Apr 25, 2012, at 11:02 AM, Doug Hellmann wrote: On Wed, Apr 25, 2012 at 7:38 AM, Andrew Hutchings and...@linuxjedi.co.ukwrote: On 12/04/12 13:35, J. Daniel Schmidt wrote: While testing our SUSE OpenStack packages we hit a nasty bug and reported it as: https

Re: [Openstack] db notification support for API extension?

2012-04-26 Thread Doug Hellmann
On Wed, Apr 25, 2012 at 6:04 PM, Andrew Bogott abog...@wikimedia.orgwrote: On 4/25/12 4:48 PM, Nathanael Burton wrote: On Thu, Mar 8, 2012 at 11:53 AM, Andrew Bogottabog...@wikimedia.org wrote: I'm working on an API and implementation to support the creation of filesystems that are

Re: [Openstack] [Metering] schema and counter definitions

2012-04-30 Thread Doug Hellmann
On Mon, Apr 30, 2012 at 6:46 AM, Loic Dachary l...@enovance.com wrote: On 04/30/2012 12:15 PM, Loic Dachary wrote: We could start a discussion from the content of the following sections: http://wiki.openstack.org/EfficientMetering#Counters I think the rationale of the counter aggregation

Re: [Openstack] [Metering] schema and counter definitions

2012-04-30 Thread Doug Hellmann
On Mon, Apr 30, 2012 at 11:43 AM, Loic Dachary l...@enovance.com wrote: On 04/30/2012 03:49 PM, Doug Hellmann wrote: On Mon, Apr 30, 2012 at 6:46 AM, Loic Dachary l...@enovance.com wrote: On 04/30/2012 12:15 PM, Loic Dachary wrote: We could start a discussion from the content

Re: [Openstack] OpenStack Client Followup

2012-04-30 Thread Doug Hellmann
On Mon, Apr 30, 2012 at 12:13 PM, Adam Spiers aspi...@suse.com wrote: Dean Troyer (dtro...@gmail.com) wrote: One of the first things to do is to find out who is interested in contributing to this project.and hopefully coordinating some of the work with the other emerging project-specific

Re: [Openstack] OpenStack Client Followup

2012-04-30 Thread Doug Hellmann
On Mon, Apr 30, 2012 at 2:56 PM, Dean Troyer dtro...@gmail.com wrote: On Mon, Apr 30, 2012 at 1:18 PM, Doug Hellmann doug.hellm...@dreamhost.com wrote: Running a cliff-based app without any arguments enters interactive mode (as of 0.4) which gives the user a new prompt and lets them run

Re: [Openstack] OpenStack Client Followup

2012-04-30 Thread Doug Hellmann
On Mon, Apr 30, 2012 at 3:19 PM, Dolph Mathews dolph.math...@gmail.comwrote: On Mon, Apr 30, 2012 at 1:18 PM, Doug Hellmann doug.hellm...@dreamhost.com wrote: On Mon, Apr 30, 2012 at 12:13 PM, Adam Spiers aspi...@suse.com wrote: Dean Troyer (dtro...@gmail.com) wrote: One of the first

Re: [Openstack] OpenStack Client Followup

2012-04-30 Thread Doug Hellmann
On Mon, Apr 30, 2012 at 3:27 PM, Dean Troyer dtro...@gmail.com wrote: On Mon, Apr 30, 2012 at 2:19 PM, Dolph Mathews dolph.math...@gmail.com wrote: I find this behavior really annoying... --help should be contextual (depending on whether a subcommand is present, and what it is). I hope

Re: [Openstack] [Metering] schema and counter definitions

2012-04-30 Thread Doug Hellmann
On Mon, Apr 30, 2012 at 3:43 PM, Loic Dachary l...@enovance.com wrote: On 04/30/2012 08:03 PM, Doug Hellmann wrote: On Mon, Apr 30, 2012 at 11:43 AM, Loic Dachary l...@enovance.com wrote: On 04/30/2012 03:49 PM, Doug Hellmann wrote: On Mon, Apr 30, 2012 at 6:46 AM, Loic Dachary l

Re: [Openstack] [Metering] schema and counter definitions

2012-05-01 Thread Doug Hellmann
On Tue, May 1, 2012 at 10:38 AM, Nick Barcet nick.bar...@canonical.comwrote: On 05/01/2012 02:23 AM, Loic Dachary wrote: On 04/30/2012 11:39 PM, Doug Hellmann wrote: On Mon, Apr 30, 2012 at 3:43 PM, Loic Dachary l...@enovance.com mailto:l...@enovance.com wrote: On 04/30/2012 08

Re: [Openstack] [Metering] schema and counter definitions

2012-05-01 Thread Doug Hellmann
On Tue, May 1, 2012 at 11:49 AM, Doug Hellmann doug.hellm...@dreamhost.comwrote: On Tue, May 1, 2012 at 10:38 AM, Nick Barcet nick.bar...@canonical.comwrote: On 05/01/2012 02:23 AM, Loic Dachary wrote: On 04/30/2012 11:39 PM, Doug Hellmann wrote: On Mon, Apr 30, 2012 at 3:43 PM, Loic

Re: [Openstack] OpenStack Client Followup

2012-05-01 Thread Doug Hellmann
On Tue, May 1, 2012 at 1:54 PM, Adam Spiers aspi...@suse.com wrote: Matt Joyce (m...@nycresistor.com) wrote: 3. I think it would be good if the HIG recommended that, at least when subcommands are permitted, single arguments '--help' and 'help' always generate identical output:

Re: [Openstack] [client] OpenStack Client Followup

2012-05-01 Thread Doug Hellmann
On Tue, May 1, 2012 at 2:35 PM, Adam Spiers aspi...@suse.com wrote: Doug Hellmann (doug.hellm...@dreamhost.com) wrote: On Mon, Apr 30, 2012 at 12:13 PM, Adam Spiers aspi...@suse.com wrote: Dean Troyer (dtro...@gmail.com) wrote: One of the first things to do is to find out who

Re: [Openstack] [client] OpenStack Client Followup

2012-05-01 Thread Doug Hellmann
On Tue, May 1, 2012 at 3:36 PM, Matt Joyce m...@nycresistor.com wrote: On Tue, May 1, 2012 at 11:49 AM, Adam Spiers aspi...@suse.com wrote: Doug Hellmann (doug.hellm...@dreamhost.com) wrote: On Mon, Apr 30, 2012 at 2:56 PM, Dean Troyer dtro...@gmail.com wrote: On Mon, Apr 30, 2012 at 1:18

[Openstack] [client] creating blueprints for the unified CLI project

2012-05-01 Thread Doug Hellmann
I have started creating blueprints from my notes about activities we need to complete for the unified CLI. Please check the list at https://blueprints.launchpad.net/python-openstackclient/ and make sure I haven't missed anything that has been discussed so far, and open a blueprint if I have.

Re: [Openstack] [client] creating blueprints for the unified CLI project

2012-05-02 Thread Doug Hellmann
On Wed, May 2, 2012 at 10:39 AM, Adam Spiers aspi...@suse.com wrote: Doug Hellmann (doug.hellm...@dreamhost.com) wrote: I have started creating blueprints from my notes about activities we need to complete for the unified CLI. Please check the list at https://blueprints.launchpad.net

Re: [Openstack] OpenStack Client Followup

2012-05-02 Thread Doug Hellmann
On Wed, May 2, 2012 at 10:40 AM, Adam Spiers aspi...@suse.com wrote: Dean Troyer (dtro...@gmail.com) wrote: On Tue, May 1, 2012 at 12:54 PM, Adam Spiers aspi...@suse.com wrote: Agreed - while server-side auditing is a more important component than client-side, having both sounds

Re: [Openstack] [client] Where will client API libraries live?

2012-05-02 Thread Doug Hellmann
On Wed, May 2, 2012 at 10:13 AM, Lorin Hochstein lo...@nimbisservices.comwrote: (Apologies if this has been already answered in the mailing list, dealing with a large backlog of mailing list emails). With the current nova client (python-novaclient), there are Python bindings so you can write

Re: [Openstack] [client] final openstackclient binary name

2012-05-02 Thread Doug Hellmann
Oops, I saw the code change before this message and I went ahead and approved it. On Wed, May 2, 2012 at 10:59 AM, Dean Troyer dtro...@gmail.com wrote: There has been a little more activity in the discussion in http://etherpad.openstack.org/FolsumCLI this week regarding the name of the

Re: [Openstack] [Openstack-operators] OpenStack Client Followup

2012-05-02 Thread Doug Hellmann
capability-relevant UI). tl;dr: openstackclient should be uniformly featured across all OpenStack API's (service, admin or otherwise) -Dolph On Tue, May 1, 2012 at 6:55 PM, Doug Hellmann doug.hellm...@dreamhost.com wrote: There are a couple of ways to handle that: 1. A separate

Re: [Openstack] OpenStack Client Followup

2012-05-02 Thread Doug Hellmann
On Wed, May 2, 2012 at 1:23 PM, Adam Spiers aspi...@suse.com wrote: Dean Troyer (dtro...@gmail.com) wrote: On Tue, May 1, 2012 at 2:11 PM, Adam Spiers aspi...@suse.com wrote: As of my recent patch, --help is contextual in nova: I hadn't seen that yet... and I have started work on

Re: [Openstack] OpenStack Client Followup

2012-05-02 Thread Doug Hellmann
On Wed, May 2, 2012 at 6:01 PM, Doug Hellmann doug.hellm...@dreamhost.comwrote: On Wed, May 2, 2012 at 1:23 PM, Adam Spiers aspi...@suse.com wrote: Dean Troyer (dtro...@gmail.com) wrote: On Tue, May 1, 2012 at 2:11 PM, Adam Spiers aspi...@suse.com wrote: As of my recent patch, --help

Re: [Openstack] [client] Where will client API libraries live?

2012-05-02 Thread Doug Hellmann
On Wed, May 2, 2012 at 1:34 PM, Lorin Hochstein lo...@nimbisservices.comwrote: On May 2, 2012, at 11:30 AM, Doug Hellmann wrote: On Wed, May 2, 2012 at 10:13 AM, Lorin Hochstein lo...@nimbisservices.com wrote: (Apologies if this has been already answered in the mailing list, dealing

Re: [Openstack] Metering question??

2012-05-02 Thread Doug Hellmann
On Wed, May 2, 2012 at 2:31 PM, Joshua Harlow harlo...@yahoo-inc.comwrote: Hi all, I was just looking over the efficient metering stuff yesterday. Just a couple of questions, that might be dups (sorry if they are). I am noticing that there seems to be a mix of billing specifics there and

[Openstack] [metering] interesting notes on billing issues with Azure

2012-05-03 Thread Doug Hellmann
Via @jessenoller: http://www.nasuni.com/blog/177-azure_fair_and_balanced ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help :

Re: [Openstack] Glance store question??

2012-05-03 Thread Doug Hellmann
Andrew is doing some work on a plugin architecture. This sounds like another good application of that. On Wed, May 2, 2012 at 7:01 PM, Joshua Harlow harlo...@yahoo-inc.comwrote: Right, if there isn’t that existing, then I think I might just make a blueprint out of that. I just wanted to check

Re: [Openstack] [Metering] how should it be done ? ( Was: schema and counter definitions)

2012-05-04 Thread Doug Hellmann
On Thu, May 3, 2012 at 11:59 AM, Loic Dachary l...@enovance.com wrote: On 05/03/2012 09:58 AM, Robert Collins wrote: On Wed, May 2, 2012 at 10:28 AM, Loic Dachary l...@enovance.com wrote: As I wrote in a previous mail, once we manage to provide an implementation that proves useful, we

Re: [Openstack] [QA] Tempest Devstack/Jenkins gate job now passing

2012-05-04 Thread Doug Hellmann
+1000 On Fri, May 4, 2012 at 11:30 AM, Daryl Walleck daryl.wall...@rackspace.comwrote: This is great news! Thanks Jay for all the hard work you've put into getting this up and running. Daryl On May 4, 2012, at 8:34 AM, Jay Pipes wrote: All, A momentous event has occurred. We now

Re: [Openstack] [Swift][Keystone] Swift Quotas

2012-05-04 Thread Doug Hellmann
On Fri, May 4, 2012 at 12:02 PM, Jay Pipes jaypi...@gmail.com wrote: On 05/04/2012 10:14 AM, Rouault, Jason (Cloud Services) wrote: IMHO, if it is a quota related to a tenant or user, then managing it in Keystone makes sense. I think, as Eoghan mentioned, there was pretty broad agreement

Re: [Openstack] [Metering] how should it be done ? ( Was: schema and counter definitions)

2012-05-04 Thread Doug Hellmann
On Fri, May 4, 2012 at 4:51 PM, Christopher MacGown ch...@pistoncloud.comwrote: Do you envision that writing to AMQP directly, or using the existing notification API (which seems to be a wrapper over the RPC layer, which is in turn a wrapper for AMQP)? The RPC layer is not merely a wrapper

Re: [Openstack] [Metering] Adding a source notion to the schema

2012-05-04 Thread Doug Hellmann
On Fri, May 4, 2012 at 12:29 PM, Nick Barcet nick.bar...@canonical.comwrote: Following up on the discussion on IRC yesterday during the metering meeting, I'd like to explain my proposal to add the notion of source to the schema of our event. The current goal we have for ceilometer is to

Re: [Openstack] [Nova] EC2 api testing

2012-05-04 Thread Doug Hellmann
On Fri, May 4, 2012 at 1:09 PM, Martin Packman martin.pack...@canonical.com wrote: At the Folsom Design Summit we discussed[1] trying to collaborate on a test suite for EC2 api support. Currently nova supports the common stuff pretty well has differing behaviour in a lot of edge cases.

Re: [Openstack] [Metering] Adding a source notion to the schema

2012-05-04 Thread Doug Hellmann
On Fri, May 4, 2012 at 6:03 PM, Nick Barcet nick.bar...@canonical.comwrote: On 05/04/2012 02:25 PM, Doug Hellmann wrote: On Fri, May 4, 2012 at 12:29 PM, Nick Barcet nick.bar...@canonical.com mailto:nick.bar...@canonical.com wrote: Following up on the discussion on IRC yesterday

Re: [Openstack] Moving nova.rpc into openstack.common

2012-05-07 Thread Doug Hellmann
The metering project will probably want to take advantage of this work. How far along is it, and how can we help? On Fri, Apr 6, 2012 at 6:56 AM, Swaminathan Venkataraman venkat...@gmail.com wrote: Hi, I've created a blueprint for this. Please take a look and let me know your comments.

Re: [Openstack] [Metering] External API definition

2012-05-08 Thread Doug Hellmann
On Tue, May 8, 2012 at 11:27 AM, Nick Barcet nick.bar...@canonical.comwrote: Hello, The 3rd meeting of the Ceilometer project will be held on May 10th at 1600 UTC in the #openstack-meeting channel on Freenode. The main subject we will be tackling this week is the external API definition and

[Openstack] [nova] why does notification use a topic exchange instead of fanout?

2012-05-08 Thread Doug Hellmann
I'm working on some code to monitor notification messages coming from nova by listening directly on the AMQP queue. Unfortunately, nova is using a topic exchange so it seems I can't safely consume the messages or they might not go to some other client that is expecting to see them (especially some

Re: [Openstack] [nova] why does notification use a topic exchange instead of fanout?

2012-05-08 Thread Doug Hellmann
On Tue, May 8, 2012 at 5:45 PM, Russell Bryant rbry...@redhat.com wrote: On 05/08/2012 04:19 PM, Doug Hellmann wrote: I'm working on some code to monitor notification messages coming from nova by listening directly on the AMQP queue. Unfortunately, nova is using a topic exchange so

Re: [Openstack] [nova] why does notification use a topic exchange instead of fanout?

2012-05-08 Thread Doug Hellmann
On Tue, May 8, 2012 at 6:04 PM, Russell Bryant rbry...@redhat.com wrote: On 05/08/2012 05:59 PM, Doug Hellmann wrote: Here is a relevant section pulled out of the amqp 0-9-1 spec: 3.1.3.3 The Topic Exchange Type The topic exchange type works as follows

Re: [Openstack] [nova] why does notification use a topic exchange instead of fanout?

2012-05-08 Thread Doug Hellmann
On May 8, 2012, at 3:19 PM, Doug Hellmann wrote: I'm working on some code to monitor notification messages coming from nova by listening directly on the AMQP queue. Unfortunately, nova is using a topic exchange so it seems I can't safely consume the messages or they might not go to some

Re: [Openstack] ceilometer (java implementation)

2012-05-09 Thread Doug Hellmann
On Tue, May 8, 2012 at 7:19 PM, Luis Gervaso l...@woorea.es wrote: Hi, I have uploaded a toy version of ceilometer (java implementation). It does implement the first two counters (instance : rabbitmq listener and cpu : polling from libvirt) i need more clarification on the meaining:

Re: [Openstack] [nova] why does notification use a topic exchange instead of fanout?

2012-05-09 Thread Doug Hellmann
** ** *From:* Kiall Mac Innes [mailto:ki...@managedit.ie] *Sent:* 09 May 2012 10:51 *To:* Day, Phil *Cc:* openstack@lists.launchpad.net; Russell Bryant; Doug Hellmann *Subject:* Re: [Openstack] [nova] why does notification use a topic exchange instead of fanout? ** ** Your own queue listener

Re: [Openstack] [Metering] External API definition

2012-05-09 Thread Doug Hellmann
On Tue, May 8, 2012 at 8:43 PM, Nick Barcet nick.bar...@canonical.comwrote: On 05/08/2012 11:39 AM, Doug Hellmann wrote: [..] * Requests must be authenticated (separate from keystone, or only linked to accounting type account) What is the motivation for authenticating

Re: [Openstack] [Metering] Bootstrapping, first counter implementation

2012-05-09 Thread Doug Hellmann
What is the difference between review.stackforge.org and review.openstack.org and why aren't we using the latter? On Wed, May 9, 2012 at 11:13 AM, Julien Danjou julien.dan...@enovance.comwrote: Hi there, I've added a first script that's able to connect to the AMQP notification queue using

Re: [Openstack] [Metering] External API definition

2012-05-09 Thread Doug Hellmann
On Wed, May 9, 2012 at 11:27 AM, Nick Barcet nick.bar...@canonical.comwrote: On 05/08/2012 08:27 AM, Nick Barcet wrote: [..] Thinking about this, I think we need to expend the API a bit to reflect the evolutions of the schema that we decided last week. Here are my proposals: * Requests

Re: [Openstack] [Metering] Bootstrapping, first counter implementation

2012-05-09 Thread Doug Hellmann
to StackForge as long as it is related to OpenStack in some way. 2012/5/9 Doug Hellmann doug.hellm...@dreamhost.com: What is the difference between review.stackforge.org and review.openstack.org and why aren't we using the latter? On Wed, May 9, 2012 at 11:13 AM, Julien Danjou julien.dan

Re: [Openstack] [nova] why does notification use a topic exchange instead of fanout?

2012-05-09 Thread Doug Hellmann
. ## (ListOpt) AMQP topic used for Nova notifications notification_topics=notifications,metering,monitoring This will allow you to consume all the messages from a different service. On Wed, May 9, 2012 at 10:34 AM, Doug Hellmann doug.hellm...@dreamhost.com wrote: On Wed, May 9, 2012

Re: [Openstack] [Metering] schema and counter definitions

2012-05-09 Thread Doug Hellmann
On Wed, May 9, 2012 at 12:42 PM, Tomasz Paszkowski ss7...@gmail.com wrote: Here is the simplified version of my code (without ampq support, counter stored directly to mysql db). https://github.com/ss7pro/rescnt Code is started from main.py which is constantly collecting counters from

Re: [Openstack] [nova] why does notification use a topic exchange instead of fanout?

2012-05-09 Thread Doug Hellmann
. :-) On Wed, May 9, 2012 at 6:34 PM, Doug Hellmann doug.hellm...@dreamhost.com wrote: On Wed, May 9, 2012 at 6:42 AM, Kiall Mac Innes ki...@managedit.iewrote: Kinda! The queue has a name, but that name has no bearing on the set of messages received. If you create a queue called

Re: [Openstack] [Metering] Bootstrapping, first counter implementation

2012-05-09 Thread Doug Hellmann
On Wed, May 9, 2012 at 11:13 AM, Julien Danjou julien.dan...@enovance.comwrote: Hi there, I've added a first script that's able to connect to the AMQP notification queue using Nova RPC module. Later it will be able to treat them when we'll know what to do with them.

Re: [Openstack] [Metering] schema and counter definitions

2012-05-09 Thread Doug Hellmann
On Wed, May 9, 2012 at 3:07 PM, Tomasz Paszkowski ss7...@gmail.com wrote: On Wed, May 9, 2012 at 8:02 PM, Doug Hellmann doug.hellm...@dreamhost.com wrote: Nice! For production code I think we are going to want to separate collection from storage, aren't we? We don't want each compute

Re: [Openstack] [Metering] Meeting agenda for today 16:00 UTC (May 3rd, 2012)

2012-05-10 Thread Doug Hellmann
On Thu, May 10, 2012 at 12:17 AM, Daniel Dyer dan.dye...@gmail.com wrote: A question/comment about the scope of the schema or maybe the architecture. Assuming the services will provide the instrumentation to populate the raw metric data, it seems likely that you will need to define an

Re: [Openstack] [Metering] API Extensibility (was: External API definition)

2012-05-10 Thread Doug Hellmann
On Thu, May 10, 2012 at 9:22 AM, Loic Dachary l...@enovance.com wrote: Another item that we need to discuss is extensibility of this API. Hi, Here is a proposal, which we could discuss further during the meeting. GET extension=param1=fooparam2=bar The API looks up

[Openstack] [metering] public API design

2012-05-11 Thread Doug Hellmann
During yesterday's meeting we discussed the API proposal at http://wiki.openstack.org/EfficientMetering#API and came up with a few missing items and other points for discussion. We should try to work out those details on the list before the meeting next week. The original proposal included these

Re: [Openstack] [client] Event handling

2012-05-11 Thread Doug Hellmann
On Thu, May 10, 2012 at 5:58 PM, Matt Joyce matt.jo...@cloudscaling.comwrote: How are we doing event handling in the client? Is there a blueprint on this somewhere? What sort of event handling? Doug ___ Mailing list:

Re: [Openstack] [client] Event handling

2012-05-11 Thread Doug Hellmann
I'm still missing something... On Fri, May 11, 2012 at 12:19 PM, Doug Hellmann doug.hellm...@dreamhost.com wrote: On Thu, May 10, 2012 at 5:58 PM, Matt Joyce matt.jo...@cloudscaling.comwrote: How are we doing event handling in the client? Is there a blueprint on this somewhere

[Openstack] [metering] licensing

2012-05-11 Thread Doug Hellmann
I was very surprised to see the change to license ceilometer as AGPL [1]. Why are we not using the same Apache v2 license that all other OpenStack projects are using? Doug [1] https://review.stackforge.org/#/c/29/ ___ Mailing list:

Re: [Openstack] [metering] licensing

2012-05-11 Thread Doug Hellmann
://wiki.openstack.org/Governance/Foundation/Bylaws On Fri, May 11, 2012 at 4:01 PM, Doug Hellmann doug.hellm...@dreamhost.comwrote: I was very surprised to see the change to license ceilometer as AGPL [1]. Why are we not using the same Apache v2 license that all other OpenStack projects are using? Doug

Re: [Openstack] [metering] public API design

2012-05-11 Thread Doug Hellmann
On Fri, May 11, 2012 at 3:40 PM, Loic Dachary l...@enovance.com wrote: On 05/11/2012 05:55 PM, Doug Hellmann wrote: During yesterday's meeting we discussed the API proposal at http://wiki.openstack.org/EfficientMetering#API and came up with a few missing items and other points

Re: [Openstack] [metering] public API design

2012-05-11 Thread Doug Hellmann
On Fri, May 11, 2012 at 3:40 PM, Loic Dachary l...@enovance.com wrote: On 05/11/2012 05:55 PM, Doug Hellmann wrote: While thinking about this use case I also had a simple idea to optimize the storage of events and added it to the wiki http://wiki.openstack.org/EfficientMetering?action

Re: [Openstack] [metering] licensing

2012-05-14 Thread Doug Hellmann
On Mon, May 14, 2012 at 3:50 AM, Loic Dachary l...@enovance.com wrote: On 05/12/2012 01:30 AM, Doug Hellmann wrote: On Fri, May 11, 2012 at 5:27 PM, Loic Dachary l...@enovance.com wrote: On 05/11/2012 10:01 PM, Doug Hellmann wrote: I was very surprised to see the change to license

Re: [Openstack] [Netstack] Want to start Keystone support for Quantum Client

2012-05-14 Thread Doug Hellmann
On Mon, May 14, 2012 at 8:35 AM, Yong Sheng Gong gong...@cn.ibm.com wrote: Hi, How can I help with the common openstack client? I think quantum needs its own client to be implemented first and then common openstack client (just as a thin wrapper) can call the client module if we have quantum

Re: [Openstack] [metering] resources metadata (was: public API design)

2012-05-14 Thread Doug Hellmann
On Fri, May 11, 2012 at 3:55 PM, Loic Dachary l...@enovance.com wrote: - The interesting metadata for a resource may depend on the type of resource. Do we need separate tables for that or can we normalize somehow? - How do we map a resource to the correct version of its metadata at any

[Openstack] [metering] need +2 reviews/approvals

2012-05-14 Thread Doug Hellmann
Julien has done a good bit of work bootstrapping the server implementation, but we need to have more +2 reviews (and approvals) of the code [1] before it will make it into the public repository. Are we holding off on doing those reviews on purpose until after the series of design meetings is

Re: [Openstack] Stackforge server migration

2012-05-14 Thread Doug Hellmann
On Mon, May 14, 2012 at 1:35 PM, Andrew Hutchings and...@linuxjedi.co.ukwrote: Hey Jay, On 14/05/12 17:12, Jay Pipes wrote: On 05/14/2012 11:38 AM, Andrew Hutchings wrote: The first problem is more serious and can't be fixed where Gerrit is now, so it will require us to migrate Gerrit to

Re: [Openstack] [metering] resources metadata

2012-05-14 Thread Doug Hellmann
On Mon, May 14, 2012 at 1:04 PM, Loic Dachary l...@enovance.com wrote: On 05/14/2012 04:15 PM, Doug Hellmann wrote: On Fri, May 11, 2012 at 3:55 PM, Loic Dachary l...@enovance.com wrote: - The interesting metadata for a resource may depend on the type of resource. Do we need separate

Re: [Openstack] [metering] resources metadata

2012-05-15 Thread Doug Hellmann
Copying the list... On Tue, May 15, 2012 at 10:26 AM, Doug Hellmann doug.hellm...@dreamhost.com wrote: On Tue, May 15, 2012 at 8:21 AM, Julien Danjou julien.dan...@enovance.com wrote: On Tue, May 15 2012, Loic Dachary wrote: On 05/15/2012 12:05 PM, Julien Danjou wrote: OTOH I find

[Openstack] [metering] example of discrete counter

2012-05-17 Thread Doug Hellmann
I have added a row to the list of counters for discrete events such as uploading an image to glance [1]. Please let me know if you think I need more exposition to explain discrete counters. Doug [1] http://wiki.openstack.org/EfficientMetering?action=diffrev2=89rev1=87

Re: [Openstack] About openstack common client

2012-05-18 Thread Doug Hellmann
On Fri, May 18, 2012 at 10:09 AM, Andrew Bogott abog...@wikimedia.orgwrote: On 5/18/12 12:16 AM, Yong Sheng Gong wrote: Hi, I just want to ask about the relationship among openstackclient https://launchpad.net/python-openstackclient and other clients. Will openstackclient replace other

Re: [Openstack] [metering] Choice of a messaging queue

2012-05-18 Thread Doug Hellmann
On Fri, May 18, 2012 at 4:42 AM, Nick Barcet nick.bar...@canonical.comwrote: Hello everyone, Next week's irc meeting will have for goal to choose a reference messaging queue service for the ceilometer project. For this meeting to be able to be successful, a discussion on the choices that we

Re: [Openstack] [metering] Do we need an API and storage?

2012-05-18 Thread Doug Hellmann
On Fri, May 18, 2012 at 5:27 AM, Thierry Carrez thie...@openstack.orgwrote: Doug Hellmann wrote: On Thu, May 17, 2012 at 5:47 AM, Nick Barcet nick.bar...@canonical.com mailto:nick.bar...@canonical.com wrote: On 05/17/2012 11:13 AM, Loic Dachary wrote: On 05/16/2012 11:00 PM

Re: [Openstack] [metering] Choice of a messaging queue

2012-05-18 Thread Doug Hellmann
plugin for Essex and I'm preparing to make a Folsom merge prop within the next week or so, if all goes well. Excellent! Sent from my iPad On May 18, 2012, at 7:26, Doug Hellmann doug.hellm...@dreamhost.com wrote: On Fri, May 18, 2012 at 4:42 AM, Nick Barcet nick.bar...@canonical.comwrote

Re: [Openstack] [metering] Choice of a messaging queue

2012-05-18 Thread Doug Hellmann
On Fri, May 18, 2012 at 11:40 AM, Eric Windisch e...@cloudscaling.comwrote: a) the queue must guaranty the delivery of messages. To the contrary of monitoring, loss of events may have important billing impacts, it therefore cannot be an option that message be lost. Losing messages

Re: [Openstack] RFC: Plugin framework draft

2012-05-18 Thread Doug Hellmann
On Fri, May 18, 2012 at 12:16 PM, Andrew Bogott abog...@wikimedia.orgwrote: On 5/17/12 4:38 PM, Doug Hellmann wrote: snip In the wikistatus plugin I notice that you modify the global FLAGS when wikistatus.py is imported. Is that the right time to do that, or should it happen during

Re: [Openstack] RFC - dynamically loading virt drivers

2012-05-18 Thread Doug Hellmann
On Fri, May 18, 2012 at 3:08 PM, Sean Dague sda...@linux.vnet.ibm.comwrote: On 05/17/2012 06:38 PM, Vishvananda Ishaya wrote: So we already have plugabillity by just specifying a different compute_driver config option. I don't like that we defer another level in compute and call

Re: [Openstack] [metering] Do we need an API and storage?

2012-05-18 Thread Doug Hellmann
On Fri, May 18, 2012 at 4:53 PM, Francis J. Lacoste francis.laco...@canonical.com wrote: On 12-05-18 05:27 AM, Thierry Carrez wrote: You can certainly architect it in a way so that storage and API are optional: expose metering messages on the bus, and provide an optionally-run aggregation

[Openstack] [metering] high-level design proposal

2012-05-21 Thread Doug Hellmann
I have written up some of my thoughts on a proposed design for ceilometer in the wiki [1]. I'm sure there are missing details, but I wanted to start getting ideas into writing so they could be discussed here on the list, since I've talked about different parts with a couple of you separately. Let

Re: [Openstack] [metering] high-level design proposal

2012-05-22 Thread Doug Hellmann
On May 22, 2012, at 5:15 AM, Tom tom.gal...@hp.com wrote: On 05/21/2012 10:52 PM, Doug Hellmann wrote: I have written up some of my thoughts on a proposed design for ceilometer in the wiki [1]. I'm sure there are missing details, but I wanted to start getting ideas into writing so

Re: [Openstack] [metering] high-level design proposal

2012-05-22 Thread Doug Hellmann
On Tue, May 22, 2012 at 3:40 AM, Nick Barcet nick.bar...@canonical.comwrote: On 05/21/2012 10:52 PM, Doug Hellmann wrote: I have written up some of my thoughts on a proposed design for ceilometer in the wiki [1]. I'm sure there are missing details, but I wanted to start getting ideas

Re: [Openstack] [metering] high-level design proposal

2012-05-22 Thread Doug Hellmann
need will depend on the number of messages being generated, but the architecture supports running several in parallel in a way that each instance does not need to be aware of the others. Doug Endre. 2012/5/22 Nick Barcet nick.bar...@canonical.com On 05/21/2012 10:52 PM, Doug Hellmann wrote

[Openstack] adding a worker pool notion for RPC consumers

2012-05-22 Thread Doug Hellmann
ceilometer is going to need to subscribe several worker processes to the notifications.info topic for the other services like nova, glance, and quantum. The pool of workers needs to be assured of receiving all messages, without interference from other clients listening for notifications (such as

Re: [Openstack] adding a worker pool notion for RPC consumers

2012-05-22 Thread Doug Hellmann
On Tue, May 22, 2012 at 11:02 AM, Eric Windisch e...@cloudscaling.comwrote: Bringing my conversation with Doug back on-list... In nova.rpc with fanout=True every consumer gets a copy of the event because every consumer has its own queue. With fanout=False only one consumer *at all* will get

  1   2   3   >