Re: [openstack-dev] [all][pbr] splitting our deployment vs install dependencies

2015-04-12 Thread Monty Taylor
On 04/12/2015 08:01 PM, James Polley wrote: On Mon, Apr 13, 2015 at 9:12 AM, Monty Taylor mord...@inaugust.com wrote: On 04/12/2015 06:43 PM, Robert Collins wrote: Right now we do something that upstream pip considers wrong: we make our requirements.txt be our install_requires. Upstream

[openstack-dev] [all] Problems with keystoneclient stable branch (and maybe yours too)

2015-04-12 Thread Brant Knudson
There were several problems with the keystoneclient stable/juno branch that have been or are in the process of being fixed since its creation. Hopefully this note will be useful to other projects that create stable branches for their libraries. 1) Unit tests didn't pass with earlier packages

Re: [openstack-dev] [all][pbr] splitting our deployment vs install dependencies

2015-04-12 Thread Robert Collins
On 13 April 2015 at 13:09, Robert Collins robe...@robertcollins.net wrote: On 13 April 2015 at 12:53, Monty Taylor mord...@inaugust.com wrote: What we have in the gate is the thing that produces the artifacts that someone installing using the pip tool would get. Shipping anything with those

Re: [openstack-dev] [puppet] Puppet PTL

2015-04-12 Thread Emilien Macchi
On 04/10/2015 06:58 PM, Colleen Murphy wrote: Just to make it official: since we only had one nominee for PTL, we will go ahead and name Emilien Macchi as our new PTL without proceeding with an election process. Thanks, Emilien, for all your hard work and for taking on this responsibility!

Re: [openstack-dev] [all][pbr] splitting our deployment vs install dependencies

2015-04-12 Thread James Polley
On Mon, Apr 13, 2015 at 9:12 AM, Monty Taylor mord...@inaugust.com wrote: On 04/12/2015 06:43 PM, Robert Collins wrote: Right now we do something that upstream pip considers wrong: we make our requirements.txt be our install_requires. Upstream there are two separate concepts.

Re: [openstack-dev] [neutron] Neutron scaling datapoints?

2015-04-12 Thread Joshua Harlow
Kevin Benton wrote: Timestamps are just one way (and likely the most primitive), using redis (or memcache) key/value and expiry are another (and letting memcache or redis expire using its own internal algorithms), using zookeeper ephemeral nodes[1] are another... The point being that its

Re: [openstack-dev] [all][pbr] splitting our deployment vs install dependencies

2015-04-12 Thread Robert Collins
On 13 April 2015 at 12:53, Monty Taylor mord...@inaugust.com wrote: What we have in the gate is the thing that produces the artifacts that someone installing using the pip tool would get. Shipping anything with those artifacts other that a direct communication of what we tested is just mean

Re: [openstack-dev] In loving memory of Chris Yeoh

2015-04-12 Thread Michael Still
Hi, as promised I now have details of a charity for people to donate to in Chris' memory: http://participate.freetobreathe.org/site/TR?px=1582460fr_id=2710pg=personal#.VSscH5SUd90 In the words of the family: We would prefer that people donate to lung cancer research in lieu of flowers.

Re: [openstack-dev] In loving memory of Chris Yeoh

2015-04-12 Thread Gary Kotton
Hi, I am very saddened to read this. Not only will Chris be missed on a professional level but on a personal level. He was a real mensh (http://www.thefreedictionary.com/mensh). He was always helpful and supportive. Wishing his family a long life. Thanks Gary On 4/13/15, 4:33 AM, Michael Still

Re: [openstack-dev] [neutron] Neutron scaling datapoints?

2015-04-12 Thread Joshua Harlow
joehuang wrote: Hi, Kevin and Joshua, As my understanding, Tooz only addresses the issue of agent status management, but how to solve the concurrent dynamic load impact on large scale ( for example 100k managed nodes with the dynamic load like security goup rule update, routers_updated, etc )

Re: [openstack-dev] [all][pbr] splitting our deployment vs install dependencies

2015-04-12 Thread Robert Collins
On 13 April 2015 at 12:01, James Polley j...@jamezpolley.com wrote: That sounds, to me, very similar to a discussion we had a few weeks ago in the context of our stable branches. In that context, we have two competing requirements. One requirement is that our CI system wants a very tightly

Re: [openstack-dev] [neutron] Neutron scaling datapoints?

2015-04-12 Thread joehuang
Hi, Kevin and Joshua, As my understanding, Tooz only addresses the issue of agent status management, but how to solve the concurrent dynamic load impact on large scale ( for example 100k managed nodes with the dynamic load like security goup rule update, routers_updated, etc ) And one more

Re: [openstack-dev] [all][pbr] splitting our deployment vs install dependencies

2015-04-12 Thread Monty Taylor
On 04/12/2015 06:43 PM, Robert Collins wrote: Right now we do something that upstream pip considers wrong: we make our requirements.txt be our install_requires. Upstream there are two separate concepts. install_requirements, which are meant to document what *must* be installed to import

Re: [openstack-dev] [Nova] VMware CI

2015-04-12 Thread John Garbutt
I have updated the bug so it's high priority and tagged with kilo-rc-potential, and added your note from below as a comment on the bug. It looks like it might be worth a backport so it gets into RC2? Can anyone take that bit on please? Thanks, John On Sunday, April 12, 2015, Gary Kotton

Re: [openstack-dev] [Nova] VMware CI

2015-04-12 Thread Davanum Srinivas
Gary, John, Just to speed things up, i filed a backport: https://review.openstack.org/#/c/172710/ thanks, dims On Sun, Apr 12, 2015 at 4:23 AM, John Garbutt j...@johngarbutt.com wrote: I have updated the bug so it's high priority and tagged with kilo-rc-potential, and added your note from

Re: [openstack-dev] [neutron] Neutron scaling datapoints?

2015-04-12 Thread joehuang
Hi, Kevin, I assumed that all agents are connected to same IP address of RabbitMQ, then the connection will exceed the port ranges limitation. For a RabbitMQ cluster, for sure the client can connect to any one of member in the cluster, but in this case, the client has to be designed in

Re: [openstack-dev] [Nova] VMware CI

2015-04-12 Thread Gary Kotton
Thanks! On 4/12/15, 3:04 PM, Davanum Srinivas dava...@gmail.com wrote: Gary, John, Just to speed things up, i filed a backport: https://review.openstack.org/#/c/172710/ thanks, dims On Sun, Apr 12, 2015 at 4:23 AM, John Garbutt j...@johngarbutt.com wrote: I have updated the bug so it's high

Re: [openstack-dev] [OpenStack-docs] What's Up Doc? Apr 10 2015

2015-04-12 Thread Monty Taylor
On 04/12/2015 04:16 AM, Bernd Bausch wrote: There is nothing like a good rage on a Sunday (yes Sunday) afternoon. Many thanks, Monty. You helped me make glance work for my particular case; I will limit any further messages to the docs mailing list. Rage on a Sunday followed up by rage coding:

Re: [openstack-dev] [TripleO] Consistent variable documentation for diskimage-builder elements

2015-04-12 Thread Gregory Haynes
Excerpts from Clint Byrum's message of 2015-04-08 23:11:29 +: I discussed a format for something similar here: https://review.openstack.org/#/c/162267/ Perhaps we could merge the effort. The design and implementation in that might take some time, but if we can document the

Re: [openstack-dev] [neutron] Neutron scaling datapoints?

2015-04-12 Thread Joshua Harlow
Kevin Benton wrote: So IIUC tooz would be handling the liveness detection for the agents. That would be nice to get ride of that logic in Neutron and just register callbacks for rescheduling the dead. Where does it store that state, does it persist timestamps to the DB like Neutron does? If so,

Re: [openstack-dev] [neutron] Neutron scaling datapoints?

2015-04-12 Thread Kevin Benton
Timestamps are just one way (and likely the most primitive), using redis (or memcache) key/value and expiry are another (and letting memcache or redis expire using its own internal algorithms), using zookeeper ephemeral nodes[1] are another... The point being that its backend specific and tooz

Re: [openstack-dev] [neutron] Neutron scaling datapoints?

2015-04-12 Thread Kevin Benton
I assumed that all agents are connected to same IP address of RabbitMQ, then the connection will exceed the port ranges limitation. Only if the clients are all using the same IP address. If connections weren't scoped by source IP, busy servers would be completely unreliable because clients would

[openstack-dev] [all][pbr] splitting our deployment vs install dependencies

2015-04-12 Thread Robert Collins
Right now we do something that upstream pip considers wrong: we make our requirements.txt be our install_requires. Upstream there are two separate concepts. install_requirements, which are meant to document what *must* be installed to import the package, and should encode any mandatory version