Re: [openstack-dev] [neutron] [third-party] What tests are required to be run

2014-08-26 Thread Karthik Natarajan
, Karthik -Original Message- From: Dane Leblanc (leblancd) [mailto:lebla...@cisco.com] Sent: Monday, August 25, 2014 10:02 AM To: OpenStack Development Mailing List (not for usage questions) Subject: Re: [openstack-dev] [neutron] [third-party] What tests are required to be run Edgar, Kyle

Re: [openstack-dev] [neutron] [third-party] What tests are required to be run

2014-08-26 Thread Salvatore Orlando
: Monday, August 25, 2014 12:44 PM To: OpenStack Development Mailing List (not for usage questions) Subject: Re: [openstack-dev] [neutron] [third-party] What tests are required to be run Dane, I will second Kyle's idea. Let's discuss this during today IRC meeting if Kevin's suggestion does

Re: [openstack-dev] [neutron] [third-party] What tests are required to be run

2014-08-26 Thread Jeremy Stanley
On 2014-08-27 00:52:35 +0200 (+0200), Salvatore Orlando wrote: [...] In this case you might try to rebase the patch you're going to test on master before running devstack, which I think it's also what happens in the upstream gate. More or less. Technically we try to merge the proposed change

Re: [openstack-dev] [neutron] [third-party] What tests are required to be run

2014-08-25 Thread Kyle Mestery
, 2014 5:47 AM To: OpenStack Development Mailing List (not for usage questions) Subject: Re: [openstack-dev] [neutron] [third-party] What tests are required to be run Can you disable posting of results directly from your Jenkins/Zuul setup and have a script that just checks the log file

Re: [openstack-dev] [neutron] [third-party] What tests are required to be run

2014-08-25 Thread Edgar Magana
: [openstack-dev] [neutron] [third-party] What tests are required to be run Can you disable posting of results directly from your Jenkins/Zuul setup and have a script that just checks the log file for special markers to determine if the vote should be FAILED/PASSED/SKIPPED? Another advantage

Re: [openstack-dev] [neutron] [third-party] What tests are required to be run

2014-08-25 Thread Dane Leblanc (leblancd)
, 2014 12:44 PM To: OpenStack Development Mailing List (not for usage questions) Subject: Re: [openstack-dev] [neutron] [third-party] What tests are required to be run Dane, I will second Kyle's idea. Let's discuss this during today IRC meeting if Kevin's suggestion does not work for you. Thanks

Re: [openstack-dev] [neutron] [third-party] What tests are required to be run

2014-08-24 Thread Dane Leblanc (leblancd)
(or plugins blocked on a certain fix). Thanks, Dane From: Kevin Benton [mailto:blak...@gmail.com] Sent: Saturday, August 23, 2014 5:47 AM To: OpenStack Development Mailing List (not for usage questions) Subject: Re: [openstack-dev] [neutron] [third-party] What tests are required to be run Can you disable

Re: [openstack-dev] [neutron] [third-party] What tests are required to be run

2014-08-23 Thread Kevin Benton
Magana [mailto:edgar.mag...@workday.com] Sent: Thursday, August 21, 2014 2:58 PM To: Dane Leblanc (leblancd); OpenStack Development Mailing List (not for usage questions) Subject: Re: [openstack-dev] [neutron] [third-party] What tests are required to be run Dane, Wiki has been updated

Re: [openstack-dev] [neutron] [third-party] What tests are required to be run

2014-08-22 Thread Edgar Magana
, August 21, 2014 at 1:37 PM To: OpenStack Development Mailing List (not for usage questions) openstack-dev@lists.openstack.orgmailto:openstack-dev@lists.openstack.org Subject: Re: [openstack-dev] [neutron] [third-party] What tests are required to be run Edgar, CI name: One Convergence CI

Re: [openstack-dev] [neutron] [third-party] What tests are required to be run

2014-08-22 Thread Edgar Magana
: Thursday, August 21, 2014 2:58 PM To: Dane Leblanc (leblancd); OpenStack Development Mailing List (not for usage questions) Subject: Re: [openstack-dev] [neutron] [third-party] What tests are required to be run Dane, Wiki has been updated. Thanks, Edgar On 8/21/14, 7:57 AM, Dane Leblanc (leblancd

Re: [openstack-dev] [neutron] [third-party] What tests are required to be run

2014-08-22 Thread Dane Leblanc (leblancd)
Development Mailing List (not for usage questions) Subject: Re: [openstack-dev] [neutron] [third-party] What tests are required to be run Sorry my bad but I just changed. Edgar On 8/21/14, 2:13 PM, Dane Leblanc (leblancd) lebla...@cisco.com wrote: Edgar: I'm still seeing the comment Results

Re: [openstack-dev] [neutron] [third-party] What tests are required to be run

2014-08-21 Thread Dane Leblanc (leblancd)
List (not for usage questions) Subject: RE: [openstack-dev] [neutron] [third-party] What tests are required to be run The APIC CI did run tests against that commit (after some queue latency): http://128.107.233.28:8080/job/apic/1860/ http://cisco-neutron-ci.cisco.com/logs/apic/1860

Re: [openstack-dev] [neutron] [third-party] What tests are required to be run

2014-08-21 Thread Edgar Magana
- From: Dane Leblanc (leblancd) Sent: Tuesday, August 19, 2014 3:05 PM To: 'Edgar Magana'; OpenStack Development Mailing List (not for usage questions) Subject: RE: [openstack-dev] [neutron] [third-party] What tests are required to be run The APIC CI did run tests against that commit (after some queue

Re: [openstack-dev] [neutron] [third-party] What tests are required to be run

2014-08-21 Thread Edgar Magana
To: OpenStack Development Mailing List (not for usage questions) openstack-dev@lists.openstack.orgmailto:openstack-dev@lists.openstack.org Subject: Re: [openstack-dev] [neutron] [third-party] What tests are required to be run I also added a two more nodes to our cluster to reduce the delay. Can we

Re: [openstack-dev] [neutron] [third-party] What tests are required to be run

2014-08-21 Thread Kevin Benton
) openstack-dev@lists.openstack.org Subject: Re: [openstack-dev] [neutron] [third-party] What tests are required to be run I also added a two more nodes to our cluster to reduce the delay. Can we establish a maximum time to vote on the wiki? On Aug 19, 2014 9:39 AM, Edgar Magana edgar.mag

Re: [openstack-dev] [neutron] [third-party] What tests are required to be run

2014-08-21 Thread Hemanth Ravi
@lists.openstack.org Date: Tuesday, August 19, 2014 at 1:11 PM To: OpenStack Development Mailing List (not for usage questions) openstack-dev@lists.openstack.org Subject: Re: [openstack-dev] [neutron] [third-party] What tests are required to be run I also added a two more nodes to our cluster

Re: [openstack-dev] [neutron] [third-party] What tests are required to be run

2014-08-21 Thread Dane Leblanc (leblancd)
questions) Subject: Re: [openstack-dev] [neutron] [third-party] What tests are required to be run Dane, Wiki has been updated. Thanks, Edgar On 8/21/14, 7:57 AM, Dane Leblanc (leblancd) lebla...@cisco.com wrote: Edgar: The status on the wiki page says Results are not accurate. Needs

Re: [openstack-dev] [neutron] [third-party] What tests are required to be run

2014-08-19 Thread Parikshit Manur
(not for usage questions) Subject: Re: [openstack-dev] [neutron] [third-party] What tests are required to be run Importance: High Team, I did a quick audit on the Neutron CI. Very sad results. Only few plugins and drivers are running properly and testing all Neutron commits. I created a report here

Re: [openstack-dev] [neutron] [third-party] What tests are required to be run

2014-08-19 Thread Edgar Magana
: Edgar Magana [mailto:edgar.mag...@workday.com] Sent: Saturday, 16 August 2014 4:06 AM To: OpenStack Development Mailing List (not for usage questions) Subject: Re: [openstack-dev] [neutron] [third-party] What tests are required to be run Importance: High Team, I did a quick audit on the Neutron CI

Re: [openstack-dev] [neutron] [third-party] What tests are required to be run

2014-08-19 Thread Edgar Magana
...@oneconvergence.com, Deepak Gupta deepak.gu...@oneconvergence.commailto:deepak.gu...@oneconvergence.com Subject: Re: [openstack-dev] [neutron] [third-party] What tests are required to be run Edgar, Our CI is running the tests (non voting), but don't see it listed on the review for any patch. Is this due

Re: [openstack-dev] [neutron] [third-party] What tests are required to be run

2014-08-19 Thread Edgar Magana
:04 PM To: OpenStack Development Mailing List (not for usage questions) Subject: Re: [openstack-dev] [neutron] [third-party] What tests are required to be run Hi Edgar, Freescale CI is reporting the results for ML2 Mechanism driver (J-1) and FWaaS Plugin (to be approved for J-3). I'm

Re: [openstack-dev] [neutron] [third-party] What tests are required to be run

2014-08-19 Thread Edgar Magana
about on another thread). Thanks, Dane -Original Message- From: Edgar Magana [mailto:edgar.mag...@workday.com] Sent: Friday, August 15, 2014 6:36 PM To: OpenStack Development Mailing List (not for usage questions) Subject: Re: [openstack-dev] [neutron] [third-party] What tests are required

Re: [openstack-dev] [neutron] [third-party] What tests are required to be run

2014-08-19 Thread Edgar Magana
, August 16, 2014 4:06 AM To: OpenStack Development Mailing List (not for usage questions) Subject: Re: [openstack-dev] [neutron] [third-party] What tests are required to be run Importance: High Team, I did a quick audit on the Neutron CI. Very sad results. Only few plugins and drivers are running

Re: [openstack-dev] [neutron] [third-party] What tests are required to be run

2014-08-19 Thread Edgar Magana
] [neutron] [third-party] What tests are required to be run Importance: High Correction The right links are: https://review.openstack.org/#/c/114629/ https://review.openstack.org/#/c/114393/ Not this one: https://review.openstack.org/#/c/40296/ Edgar On 8/15/14, 3:35 PM, Edgar Magana edgar.mag

Re: [openstack-dev] [neutron] [third-party] What tests are required to be run

2014-08-19 Thread Edgar Magana
Date: Friday, August 15, 2014 at 5:33 PM To: OpenStack Development Mailing List (not for usage questions) openstack-dev@lists.openstack.orgmailto:openstack-dev@lists.openstack.org Subject: Re: [openstack-dev] [neutron] [third-party] What tests are required to be run Hi, Edgar MetapluginCI didn't

Re: [openstack-dev] [neutron] [third-party] What tests are required to be run

2014-08-19 Thread Edgar Magana
To: OpenStack Development Mailing List (not for usage questions) openstack-dev@lists.openstack.orgmailto:openstack-dev@lists.openstack.org Subject: Re: [openstack-dev] [neutron] [third-party] What tests are required to be run You didn't wait long enough for the Big Switch CI to reach your negative

Re: [openstack-dev] [neutron] [third-party] What tests are required to be run

2014-08-19 Thread Dane Leblanc (leblancd)
List (not for usage questions) Subject: Re: [openstack-dev] [neutron] [third-party] What tests are required to be run Dane, Are you sure about it? I just went to this commit and I could not find the APIC tests. Thanks, Edgar On 8/17/14, 8:47 PM, Dane Leblanc (leblancd) lebla...@cisco.com wrote

Re: [openstack-dev] [neutron] [third-party] What tests are required to be run

2014-08-19 Thread Edgar Magana
: [openstack-dev] [neutron] [third-party] What tests are required to be run Also, you can add me as a contact person for the Cisco VPNaaS driver. -Original Message- From: Dane Leblanc (leblancd) Sent: Friday, August 15, 2014 8:14 PM To: OpenStack Development Mailing List (not for usage questions

Re: [openstack-dev] [neutron] [third-party] What tests are required to be run

2014-08-18 Thread Edgar Magana
Neutron Ci Folks, I have received answers from almost all the CI contacts and I want to thank you all. Every case is different and I will review each one of your answer and questions. I do understand that every CI is different and this is why I would suggest two things: 1) Today's Neutron IRC

Re: [openstack-dev] [neutron] [third-party] What tests are required to be run

2014-08-18 Thread Edgar Magana
Thank you Akihiro. I will propose a better organization for this section. Stay tune! Edgar On 8/17/14, 10:53 PM, Akihiro Motoki mot...@da.jp.nec.com wrote: On 2014/08/18 0:12, Kyle Mestery wrote: On Fri, Aug 15, 2014 at 5:35 PM, Edgar Magana edgar.mag...@workday.com wrote: Team, I did a

Re: [openstack-dev] [neutron] [third-party] What tests are required to be run

2014-08-18 Thread Hemanth Ravi
Edgar, Our CI is running the tests (non voting), but don't see it listed on the review for any patch. Is this due to missing logs? I would like to confirm this is the issue, will resolve this. Thanks, -hemanth On Mon, Aug 18, 2014 at 8:35 AM, Edgar Magana edgar.mag...@workday.com wrote:

Re: [openstack-dev] [neutron] [third-party] What tests are required to be run

2014-08-18 Thread Edgar Magana
@lists.openstack.orgmailto:openstack-dev@lists.openstack.org Subject: Re: [openstack-dev] [neutron] [third-party] What tests are required to be run VMware minesweeper has filters which have been designed to cover the largest possible subset of submissions without add unnecessary load to our scarce

Re: [openstack-dev] [neutron] [third-party] What tests are required to be run

2014-08-17 Thread trinath.soman...@freescale.com
...@freescale.com | extn: 4048 -Original Message- From: Edgar Magana [mailto:edgar.mag...@workday.com] Sent: Saturday, August 16, 2014 4:06 AM To: OpenStack Development Mailing List (not for usage questions) Subject: Re: [openstack-dev] [neutron] [third-party] What tests are required to be run

Re: [openstack-dev] [neutron] [third-party] What tests are required to be run

2014-08-17 Thread Kyle Mestery
On Fri, Aug 15, 2014 at 5:35 PM, Edgar Magana edgar.mag...@workday.com wrote: Team, I did a quick audit on the Neutron CI. Very sad results. Only few plugins and drivers are running properly and testing all Neutron commits. I created a report here:

Re: [openstack-dev] [neutron] [third-party] What tests are required to be run

2014-08-17 Thread Dane Leblanc (leblancd)
8:18 PM To: OpenStack Development Mailing List (not for usage questions) Subject: Re: [openstack-dev] [neutron] [third-party] What tests are required to be run Also, you can add me as a contact person for the Cisco VPNaaS driver. -Original Message- From: Dane Leblanc (leblancd) Sent

Re: [openstack-dev] [neutron] [third-party] What tests are required to be run

2014-08-17 Thread balaj...@freescale.com
] [third-party] What tests are required to be run Importance: High Team, I did a quick audit on the Neutron CI. Very sad results. Only few plugins and drivers are running properly and testing all Neutron commits. I created a report here: https://wiki.openstack.org/wiki

Re: [openstack-dev] [neutron] [third-party] What tests are required to be run

2014-08-17 Thread Akihiro Motoki
On 2014/08/18 0:12, Kyle Mestery wrote: On Fri, Aug 15, 2014 at 5:35 PM, Edgar Magana edgar.mag...@workday.com wrote: Team, I did a quick audit on the Neutron CI. Very sad results. Only few plugins and drivers are running properly and testing all Neutron commits. I created a report here:

Re: [openstack-dev] [neutron] [third-party] What tests are required to be run

2014-08-15 Thread Edgar Magana
Team, I did a quick audit on the Neutron CI. Very sad results. Only few plugins and drivers are running properly and testing all Neutron commits. I created a report here: https://wiki.openstack.org/wiki/Neutron_Plugins_and_Drivers#Existing_Plugin _and_Drivers We will discuss the actions to take

Re: [openstack-dev] [neutron] [third-party] What tests are required to be run

2014-08-15 Thread Ivar Lazzaro
Hi Edgar, Nice shot, to be the inquisitor is not necessarily a bad thing :) I know some CIs are 'stuck' waiting for bugs to be fixed or certain patches to be merged, but I was wondering if it is a requirement that CIs vote *ALL* the Neutron patches. Some may have missed your call just because of

Re: [openstack-dev] [neutron] [third-party] What tests are required to be run

2014-08-15 Thread Edgar Magana
Correction The right links are: https://review.openstack.org/#/c/114629/ https://review.openstack.org/#/c/114393/ Not this one: https://review.openstack.org/#/c/40296/ Edgar On 8/15/14, 3:35 PM, Edgar Magana edgar.mag...@workday.com wrote: Team, I did a quick audit on the Neutron CI.

Re: [openstack-dev] [neutron] [third-party] What tests are required to be run

2014-08-15 Thread Edgar Magana
Subject: Re: [openstack-dev] [neutron] [third-party] What tests are required to be run Hi Edgar, Nice shot, to be the inquisitor is not necessarily a bad thing :) I know some CIs are 'stuck' waiting for bugs to be fixed or certain patches to be merged, but I was wondering

Re: [openstack-dev] [neutron] [third-party] What tests are required to be run

2014-08-15 Thread Salvatore Orlando
Development Mailing List (not for usage questions) openstack-dev@lists.openstack.org Subject: Re: [openstack-dev] [neutron] [third-party] What tests are required to be run Hi Edgar, Nice shot, to be the inquisitor is not necessarily a bad thing :) I know some CIs are 'stuck' waiting

Re: [openstack-dev] [neutron] [third-party] What tests are required to be run

2014-08-15 Thread Ivar Lazzaro
To: OpenStack Development Mailing List (not for usage questions) openstack-dev@lists.openstack.org Subject: Re: [openstack-dev] [neutron] [third-party] What tests are required to be run Hi Edgar, Nice shot, to be the inquisitor is not necessarily a bad thing :) I know some CIs are 'stuck' waiting

Re: [openstack-dev] [neutron] [third-party] What tests are required to be run

2014-08-15 Thread Kevin Benton
You didn't wait long enough for the Big Switch CI to reach your negative test. :-) Currently the CI system is backed by about 100 patches to push responses out ~22 hours. This does bring up an old discussion that was never resolved. What is the minimum expected response time for CI systems? On

Re: [openstack-dev] [neutron] [third-party] What tests are required to be run

2014-08-15 Thread Franck Yelles
Hi Edgar, I am running the Nuage CI. The Nuage CI has run and posted successfully the result for the first review. Because of infra issue(internet can be down, etc) we are running manually the -1 -1 take some time away for developper and before doing a -1, I want to be sure that it's a valid

Re: [openstack-dev] [neutron] [third-party] What tests are required to be run

2014-08-15 Thread Dane Leblanc (leblancd)
Message- From: Edgar Magana [mailto:edgar.mag...@workday.com] Sent: Friday, August 15, 2014 6:36 PM To: OpenStack Development Mailing List (not for usage questions) Subject: Re: [openstack-dev] [neutron] [third-party] What tests are required to be run Importance: High Team, I did a quick audit

Re: [openstack-dev] [neutron] [third-party] What tests are required to be run

2014-08-15 Thread Dane Leblanc (leblancd)
, Dane -Original Message- From: Edgar Magana [mailto:edgar.mag...@workday.com] Sent: Friday, August 15, 2014 6:36 PM To: OpenStack Development Mailing List (not for usage questions) Subject: Re: [openstack-dev] [neutron] [third-party] What tests are required to be run Importance: High Team

Re: [openstack-dev] [neutron] [third-party] What tests are required to be run

2014-08-15 Thread Ichihara Hirofumi
Hi, Edgar MetapluginCI didn't run for document changes. I changed filter so that CI run for ALL changes include documents. Thanks, Hirofumi 2014-08-16 7:35 GMT+09:00 Edgar Magana edgar.mag...@workday.com: Team, I did a quick audit on the Neutron CI. Very sad results. Only few plugins and

Re: [openstack-dev] [neutron] [third-party] What tests are required to be run

2014-08-15 Thread Ignacio Scopetta
...@workday.com] Sent: Friday, August 15, 2014 3:59 PM To: OpenStack Development Mailing List (not for usage questions) Subject: Re: [openstack-dev] [neutron] [third-party] What tests are required to be run Importance: High Correction The right links are: https://review.openstack.org/#/c/114629

Re: [openstack-dev] [neutron] [third-party] What tests are required to be run

2014-08-15 Thread Karthik Natarajan
Magana [mailto:edgar.mag...@workday.com] Sent: Friday, August 15, 2014 3:59 PM To: OpenStack Development Mailing List (not for usage questions) Subject: Re: [openstack-dev] [neutron] [third-party] What tests are required to be run Importance: High Correction The right links are: https

Re: [openstack-dev] [neutron] [third-party] What tests are required to be run

2014-08-15 Thread daya kamath
: Saturday, August 16, 2014 4:29 AM Subject: Re: [openstack-dev] [neutron] [third-party] What tests are required to be run Correction The right links are: https://review.openstack.org/#/c/114629/ https://review.openstack.org/#/c/114393/ Not this one: https://review.openstack.org/#/c/40296

Re: [openstack-dev] [neutron] [third-party] What tests are required to be run

2014-08-15 Thread daya kamath
  From: daya kamath day...@yahoo.com To: OpenStack Development Mailing List (not for usage questions) openstack-dev@lists.openstack.org Sent: Saturday, August 16, 2014 9:46 AM Subject: Re: [openstack-dev] [neutron] [third-party] What tests are required to be run hi edgar, the IBM SDNVE system

[openstack-dev] [neutron] [third-party] What tests are required to be run

2014-08-14 Thread Kyle Mestery
Folks, I'm not sure if all CI accounts are running sufficient tests. Per the requirements wiki page here [1], everyone needs to be running more than just Tempest API tests, which I still see most neutron third-party CI setups doing. I'd like to ask everyone who operates a third-party CI account

Re: [openstack-dev] [neutron] [third-party] What tests are required to be run

2014-08-14 Thread trinath.soman...@freescale.com
...@mestery.com] Sent: Thursday, August 14, 2014 9:00 PM To: OpenStack Development Mailing List (not for usage questions) Subject: [openstack-dev] [neutron] [third-party] What tests are required to be run Folks, I'm not sure if all CI accounts are running sufficient tests. Per the requirements