Re: [openstack-dev] The recent gate performance and how it affects you

2013-11-21 Thread Michael Still
On Thu, Nov 21, 2013 at 9:10 AM, Michael Still mi...@stillhq.com wrote: On Thu, Nov 21, 2013 at 7:44 AM, Clark Boylan clark.boy...@gmail.com wrote: How do we avoid this in the future? Step one is reviewers that are approving changes (or reverifying them) should keep an eye on the gate queue.

Re: [openstack-dev] The recent gate performance and how it affects you

2013-11-21 Thread James E. Blair
Matt Riedemann mrie...@linux.vnet.ibm.com writes: People get heads-down in their own projects and what they are working on and it's hard to keep up with what's going on in the infra channel (or nova channel for that matter), so sending out a recap that everyone can see in the mailing list is

[openstack-dev] The recent gate performance and how it affects you

2013-11-20 Thread Clark Boylan
Joe Gordon has been doing great working tracking test failures and how often they affect us. Post Havana release the failure rate has increased dramatically, negatively affecting the gate and forcing it to run in a near worst case scenario. That is changes are being tested in parallel but the head

Re: [openstack-dev] The recent gate performance and how it affects you

2013-11-20 Thread Matt Riedemann
On Wednesday, November 20, 2013 2:44:52 PM, Clark Boylan wrote: Joe Gordon has been doing great working tracking test failures and how often they affect us. Post Havana release the failure rate has increased dramatically, negatively affecting the gate and forcing it to run in a near worst case

Re: [openstack-dev] The recent gate performance and how it affects you

2013-11-20 Thread Michael Still
On Thu, Nov 21, 2013 at 7:44 AM, Clark Boylan clark.boy...@gmail.com wrote: How do we avoid this in the future? Step one is reviewers that are approving changes (or reverifying them) should keep an eye on the gate queue. Talking on the -infra IRC channel just now, it has become clear to me

Re: [openstack-dev] The recent gate performance and how it affects you

2013-11-20 Thread Anita Kuno
On 11/20/2013 05:10 PM, Michael Still wrote: On Thu, Nov 21, 2013 at 7:44 AM, Clark Boylan clark.boy...@gmail.com wrote: How do we avoid this in the future? Step one is reviewers that are approving changes (or reverifying them) should keep an eye on the gate queue. Talking on the -infra

Re: [openstack-dev] The recent gate performance and how it affects you

2013-11-20 Thread Davanum Srinivas
Anita, Joe, I need help with adding debug message in: https://review.openstack.org/#/c/56316/ to track down: Bug: https://bugs.launchpad.net/bugs/1251784 = message:Connection to neutron failed: Maximum attempts reached AND filename:logs/screen-n-cpu.txt Title: nova+neutron scheduling error:

Re: [openstack-dev] The recent gate performance and how it affects you

2013-11-20 Thread Anita Kuno
On 11/20/2013 06:58 PM, Davanum Srinivas wrote: Anita, Joe, I need help with adding debug message in: https://review.openstack.org/#/c/56316/ to track down: Bug: https://bugs.launchpad.net/bugs/1251784 = message:Connection to neutron failed: Maximum attempts reached AND

Re: [openstack-dev] The recent gate performance and how it affects you

2013-11-20 Thread Joe Gordon
Dims, we think https://review.openstack.org/#/c/57509/ will fix 125178https://launchpad.net/bugs/1251784 . On Wed, Nov 20, 2013 at 3:58 PM, Davanum Srinivas dava...@gmail.com wrote: Anita, Joe, I need help with adding debug message in: https://review.openstack.org/#/c/56316/ to track

Re: [openstack-dev] The recent gate performance and how it affects you

2013-11-20 Thread Davanum Srinivas
Nice! Joe. thanks, -- dims On Wed, Nov 20, 2013 at 7:15 PM, Joe Gordon joe.gord...@gmail.com wrote: Dims, we think https://review.openstack.org/#/c/57509/ will fix 125178. On Wed, Nov 20, 2013 at 3:58 PM, Davanum Srinivas dava...@gmail.com wrote: Anita, Joe, I need help with adding debug