Re: [openstack-dev] [Ceilometer] Vertica Storage Driver Testing

2014-01-03 Thread Herndon, John Luke
On 1/2/14, 7:06 PM, Sean Dague s...@dague.net wrote: On 01/02/2014 08:36 PM, Robert Collins wrote: On 3 January 2014 14:34, Robert Collins robe...@robertcollins.net wrote: On 3 January 2014 12:40, Herndon, John Luke john.hern...@hp.com wrote: On 1/2/14, 4:27 PM, Clint Byrum cl

Re: [openstack-dev] [Ceilometer][Oslo] Consuming Notifications in Batches

2014-01-02 Thread Herndon, John Luke
On 12/20/13, 11:57 PM, Jay Pipes jaypi...@gmail.com wrote: On 12/20/2013 04:43 PM, Julien Danjou wrote: On Fri, Dec 20 2013, Herndon, John Luke wrote: I think there is probably a tolerance for duplicates but you¹re right, missing a notification is unacceptable. Can anyone weigh in on how

Re: [openstack-dev] [Ceilometer][Oslo] Consuming Notifications in Batches

2014-01-02 Thread Herndon, John Luke
On 1/2/14, 11:36 AM, Gordon Sim g...@redhat.com wrote: On 12/20/2013 09:26 PM, Herndon, John Luke wrote: On Dec 20, 2013, at 12:13 PM, Gordon Sim g...@redhat.com wrote: On 12/20/2013 05:27 PM, Herndon, John Luke wrote: Other protocols may support bulk consumption. My one concern

[openstack-dev] [Ceilometer] Vertica Storage Driver Testing

2014-01-02 Thread Herndon, John Luke
Hi, I¹m working on adding a vertica (www.vertica.com) storage driver to ceilometer. I would love to get this driver into upstream. However, I¹ve run into a bit of a snag with the tests. It looks like all of the existing storage drivers have ³in-memory² versions that are used for unit tests.

Re: [openstack-dev] [Ceilometer] Vertica Storage Driver Testing

2014-01-02 Thread Herndon, John Luke
On 1/2/14, 4:27 PM, Clint Byrum cl...@fewbar.com wrote: Excerpts from Herndon, John Luke's message of 2014-01-02 15:16:26 -0800: Hi, I¹m working on adding a vertica (www.vertica.com) storage driver to ceilometer. I would love to get this driver into upstream. However, I¹ve run into a bit

Re: [openstack-dev] [Ceilometer][Oslo] Consuming Notifications in Batches

2013-12-20 Thread Herndon, John Luke
understood notification messages will be kept in MQ for some time (during batch-basket is being filled), right? I'm concerned about the additional load that will be on MQ (Rabbit). Thanks, Nadya On Fri, Dec 20, 2013 at 3:31 AM, Herndon, John Luke john.hern...@hp.com wrote: Hi Folks, The Rackspace-HP

Re: [openstack-dev] [Ceilometer][Oslo] Consuming Notifications in Batches

2013-12-20 Thread Herndon, John Luke
On Dec 20, 2013, at 8:10 AM, Doug Hellmann doug.hellm...@dreamhost.com wrote: On Thu, Dec 19, 2013 at 6:31 PM, Herndon, John Luke john.hern...@hp.com wrote: Hi Folks, The Rackspace-HP team has been putting a lot of effort into performance testing event collection in the ceilometer

Re: [openstack-dev] [Ceilometer][Oslo] Consuming Notifications in Batches

2013-12-20 Thread Herndon, John Luke
On Dec 20, 2013, at 8:48 AM, Julien Danjou jul...@danjou.info wrote: On Thu, Dec 19 2013, Herndon, John Luke wrote: Hi John, The Rackspace-HP team has been putting a lot of effort into performance testing event collection in the ceilometer storage drivers[0]. Based on some results

Re: [openstack-dev] [Ceilometer][Oslo] Consuming Notifications in Batches

2013-12-20 Thread Herndon, John Luke
On Dec 20, 2013, at 10:47 AM, Julien Danjou jul...@danjou.info wrote: On Fri, Dec 20 2013, Herndon, John Luke wrote: Yeah, I like this idea. As far as I can tell, AMQP doesn’t support grabbing more than a single message at a time, but we could definitely have the broker store up the batch

Re: [openstack-dev] [Ceilometer][Oslo] Consuming Notifications in Batches

2013-12-20 Thread Herndon, John Luke
On Dec 20, 2013, at 12:13 PM, Gordon Sim g...@redhat.com wrote: On 12/20/2013 05:27 PM, Herndon, John Luke wrote: On Dec 20, 2013, at 8:48 AM, Julien Danjou jul...@danjou.info wrote: Anyway, my main concern here is that I am not very enthusiast about using the executor to do that. I

Re: [openstack-dev] [Ceilometer][Oslo] Consuming Notifications in Batches

2013-12-20 Thread Herndon, John Luke
On Dec 20, 2013, at 1:12 PM, Dan Dyer dan.dye...@gmail.com wrote: On 12/20/2013 11:18 AM, Herndon, John Luke wrote: On Dec 20, 2013, at 10:47 AM, Julien Danjou jul...@danjou.info wrote: On Fri, Dec 20 2013, Herndon, John Luke wrote: Yeah, I like this idea. As far as I can tell, AMQP

[openstack-dev] [Ceilometer][Oslo] Consuming Notifications in Batches

2013-12-19 Thread Herndon, John Luke
Hi Folks, The Rackspace-HP team has been putting a lot of effort into performance testing event collection in the ceilometer storage drivers[0]. Based on some results of this testing, we would like to support batch consumption of notifications, as it will greatly improve insertion performance.

[openstack-dev] [Ceilometer] Nomination of Sandy Walsh to core team

2013-12-09 Thread Herndon, John Luke
Hi There! I¹m not 100% sure what the process is around electing an individual to the core team (i.e., can a non-core person nominate someone?). However, I believe the ceilometer core team could use a member who is more active in the development of the event pipeline. A core developer in this area

[openstack-dev] [Ceilometer] Alembic or SA Migrate (again)

2013-11-13 Thread Herndon, John Luke
Hi Folks! Sorry to dig up a really old topic[1][2], but I¹d like to know the status of ceilometer db migrations. Rehash: I¹d like to submit two branches to modify the Event and Trait tables. If I were to do that now, I would need to write SQLAlchemy scripts to do the database migration [3].

[openstack-dev] Alembic or SA Migrate (again)

2013-11-12 Thread Herndon, John Luke
Hi Folks! Sorry to dig up a really old topic, but I¹d like to know the status of ceilometer db migrations. I¹d like to submit two branches to modify the Event and Trait tables. If I were to do that now, I would need to write SQLAlchemy scripts to do the database migration - (background:

Re: [openstack-dev] [Ceilometer] Need help with Alembic...

2013-08-26 Thread Herndon, John Luke (HPCS - Ft. Collins)
Jay - It looks there is an error in the migration script that causes it to abort: AttributeError: 'ForeignKeyConstraint' object has no attribute 'drop' My guess is the migration runs on the first test, creates event types table fine, but exits with the above error, so migration is not

[openstack-dev] [Ceilometer] Adding TraitType Storage Model

2013-08-17 Thread Herndon, John Luke (HPCS - Ft. Collins)
Hi - After discussion with Jay Pipes about this bug (https://bugs.launchpad.net/ceilometer/+bug/1211015), I'd like to split out a new TraitType table in the storage layer, and remove the UniqueName table. A TraitType is the name of the trait and the data type (i.e., string, int, floatŠ). I'd

[openstack-dev] [Ceilometer] Nova_tests failing in jenkins

2013-08-12 Thread Herndon, John Luke (HPCS - Ft. Collins)
Hi - The nova_tests are failing for a couple of different Ceilometer reviews, due to 'module' object has no attribute 'add_driver'. This review (https://review.openstack.org/#/c/41316/) had nothing to do with the nova_tests, yet they are failing. Any clue what's going on? Apologies if there is

Re: [openstack-dev] [Ceilometer] Event API Access Controls

2013-08-05 Thread Herndon, John Luke (HPCS - Ft. Collins)
Hi Julien, On 8/5/13 2:04 AM, Julien Danjou jul...@danjou.info wrote: On Sat, Aug 03 2013, Herndon, John Luke (HPCS - Ft. Collins) wrote: Hi John, Hello, I'm currently implementing the event api blueprint[0], and am wondering what access controls we should impose on the event api

[openstack-dev] [Ceilometer] Event API Access Controls

2013-08-02 Thread Herndon, John Luke (HPCS - Ft. Collins)
Hello, I'm currently implementing the event api blueprint[0], and am wondering what access controls we should impose on the event api. The purpose of the blueprint is to provide a StackTach equivalent in the ceilometer api. I believe that StackTach is used as an internal tool which end with no