Re: [openstack-dev] [qa] Do I need a spec for testing the compute os-networks API?

2014-08-08 Thread Andrea Frittoli
Thanks Matt for bringing this up/ There is a tiny start in flight here [0] - if you plan to work on providing full testing coverage for the n-net api you may want to create a spec with a link to an etherpad to help track / split the work. andrea [0] https://review.openstack.org/#/c/107552/21

Re: [openstack-dev] [qa] Using any username/password to create tempest clients

2014-08-13 Thread Andrea Frittoli
Hello Udi, I don't see anything wrong in principle with your code. This said, the main use case I had in mind when I wrote the auth providers and credentials classes was to abstract authentication for all tests, so that it is possible to configure and target identity api version to be used for

Re: [openstack-dev] [qa] Lack of consistency in returning response from tempest clients

2014-08-30 Thread Andrea Frittoli
+1 keeping the body as a ~dict will help with all existing asserts comparing dicts in tests. Andrea On 30 Aug 2014 06:45, Christopher Yeoh cbky...@gmail.com wrote: On Fri, 29 Aug 2014 11:13:39 -0400 David Kranz dkr...@redhat.com wrote: On 08/29/2014 10:56 AM, Sean Dague wrote: On

Re: [openstack-dev] [devstack][keystone] Devstack, auth_token and keystone v3

2014-07-22 Thread Andrea Frittoli
The v3 experimental jobs are available for tempest [0]: - check-tempest-dsvm-keystonev3-full - check-tempest-dsvm-neutron-keystonev3-ful At the moment the difference between these and the regular jobs are that what has been implemented in this bp [1]: - tempest works with v3

Re: [openstack-dev] [all] periodic jobs for master

2014-10-24 Thread Andrea Frittoli
. Andrea Frittoli (andreaf) ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

Re: [openstack-dev] [all] periodic jobs for master

2014-10-29 Thread Andrea Frittoli
/1e33d1f4896a52e2c02b062cfc18ba39#.VFEZqvmsV8E About moving functional test to projects: http://kilodesignsummit.sched.org/event/575938e4837e8293615845582d7e3e7f#.VFEaM_msV8E Andrea Frittoli (andreaf) ___ OpenStack-dev mailing list OpenStack-dev

Re: [openstack-dev] [QA][Tempest] Proposing Ghanshyam Mann for Tempest Core

2014-11-22 Thread Andrea Frittoli
+1 On 21 Nov 2014 18:25, Ken1 Ohmichi ken1ohmi...@gmail.com wrote: +1 :-) Sent from my iPod On 2014/11/22, at 7:56, Christopher Yeoh cbky...@gmail.com wrote: +1 Sent from my iPad On 22 Nov 2014, at 4:56 am, Matthew Treinish mtrein...@kortar.org wrote: Hi Everyone, I'd

Re: [openstack-dev] [tempest] tearDownClass usage in scenario tests

2014-12-02 Thread Andrea Frittoli
Hello Rich, in the latest tempest we made two significant changes compared to the version you're using. We dropped the use of official clients from scenario tests (and OfficialClientTest has been replaced by ScenarioTest). And we introduced resource_setup and resource_cleanup in the test base

Re: [openstack-dev] [qa] Question about is_admin_available()

2015-03-10 Thread Andrea Frittoli
Preventing the token request could be an improvement, as the token request might not be expected to happen in that method. If the token cannot be obtained because credentials are wrong, an exception will be triggered. If we removed the token request from is_admin_available, this scenario would be

Re: [openstack-dev] [qa] [tempest] Question on time precision in auth providers

2015-05-04 Thread Andrea Frittoli
Hi Daryl, the original reason for having a strict check in there was that the auth provider a specialised to the identity provider in use (KeystoneV2AuthProvider, KeystoneV3AuthProvider), and the timestamp format embedded in there is what's provided by keystone's identity v2 and identity v3 token

Re: [openstack-dev] [qa] [devstack] Confusion about member roles in tempest/devstack

2015-04-07 Thread Andrea Frittoli
On 6 April 2015 at 21:27, David Kranz dkr...@redhat.com wrote: On 04/06/2015 03:14 PM, Matthew Treinish wrote: On Mon, Apr 06, 2015 at 02:25:14PM -0400, David Kranz wrote: There have been a number of changes in tempest recently that seem to coordinate with devstack that are a bit unclear.

Re: [openstack-dev] [QA][Tempest] Proposing Jordan Pittier for Tempest Core

2015-07-16 Thread Andrea Frittoli
I'm late in my reply, but I can still give my +1 and say welcome to the team Jordan! On Mon, Jun 29, 2015 at 4:26 PM Jordan Pittier jordan.pitt...@scality.com wrote: Thanks a lot ! I just want to say that I am happy about this and I look forward to continue working on Tempest with you all.

Re: [openstack-dev] [qa] Status of account creds in the [identity] section of tempest.conf

2015-07-16 Thread Andrea Frittoli
On Fri, Jun 19, 2015 at 10:30 AM Matthew Treinish mtrein...@kortar.org wrote: On Thu, Jun 18, 2015 at 02:13:56PM -0400, David Kranz wrote: We had a discussion about this at the qa meeting today around the following proposal: tl;dr The test accounts feature provides the same

Re: [openstack-dev] [qa] identity v3 issue causing non-admin job to fail

2015-07-16 Thread Andrea Frittoli
Hi David, admin_domain_name is used at the moment to fill in the domain when missing in a few cases. The get_credentials method is one of them. Another two are setting the default domain for the users in tempest.conf [0], and setting the domain for credentials loaded from a YAML file [1]. [0]

Re: [openstack-dev] [Tempest] Can we add testcase for Unshelving volume backed instance?

2015-07-20 Thread Andrea Frittoli
Hi, Yes please do. Could you file a lp bug for it? It seems to me to be a good candidate for a scenario test. Thank you Andrea On Mon, 20 Jul 2015 1:45 pm Deore, Pranali11 pranali11.de...@nttdata.com wrote: Hi, Unshelving a volume backed instance was not working before merging the

Re: [openstack-dev] [OpenStack-Infra] Gerrit Upgrade to ver 2.11 completed.

2015-12-17 Thread Andrea Frittoli
Thanks for the upgrade, and for all the effort you folks put into keeping our gerrit close to upstream! One thing that I find inconvenient in the new UI is the size of the middle (test results) column: it's too narrow, no matter how large my browser window is, or what browser I use - which causes

Re: [openstack-dev] Gerrit Upgrade to ver 2.11 completed.

2015-12-17 Thread Andrea Frittoli
nice, thank you! On Thu, Dec 17, 2015 at 4:05 PM Zaro <zaro0...@gmail.com> wrote: > forgot this one as well: https://review.openstack.org/241278 > > On Thu, Dec 17, 2015 at 7:02 AM, Zaro <zaro0...@gmail.com> wrote: > > On Thu, Dec 17, 2015 at 12:31 AM, Andrea

Re: [openstack-dev] [QA][Tempest] Use tempest-config for tempest-cli-improvements

2015-11-30 Thread Andrea Frittoli
Looking at the tool, it seems to me that is servers a combination of functions: - provision test resources - support for distribution specific / cloud specific overrides to default - support for configuration override via CLI - discovery of configuration Test resource provisioning is something

Re: [openstack-dev] [QA][Tempest] Deprecate or drop about Tempest CLI

2015-11-18 Thread Andrea Frittoli
_ >> OpenStack Development Mailing List (not for usage questions) >> Unsubscribe: >> openstack-dev-requ...@lists.openstack.org?subject:unsubscribe >> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev >> > __

Re: [openstack-dev] StackViz is now enabled for all devstack-gate jobs

2016-06-07 Thread Andrea Frittoli
Great job, thanks! On Tue, 7 Jun 2016, 3:36 a.m. Masayuki Igawa, wrote: > Congrats! I'm looking forward to seeing an integration/collaboration > with openstack-heath :) > > On Tue, Jun 7, 2016 at 8:32 AM, Buckley, Tim Jason > wrote: > >

[openstack-dev] [qa] Tempest unstable interfaces in plugins

2016-06-10 Thread Andrea Frittoli
Dear all, I'm working on making the client manager in Tempest a stable interface, so that in future it may be used safely by plugins to easily gain access service clients [0]. This work inevitably involves changing the current client manager (unstable) interface. Several tempest plugins in

Re: [openstack-dev] [qa] Tempest unstable interfaces in plugins

2016-06-13 Thread Andrea Frittoli
On Sun, Jun 12, 2016 at 2:25 PM Assaf Muller <as...@redhat.com> wrote: > On Sat, Jun 11, 2016 at 4:04 PM, Ken'ichi Ohmichi <ken1ohmi...@gmail.com> > wrote: > > 2016-06-10 17:01 GMT-07:00 Assaf Muller <as...@redhat.com>: > >> On Fri, Jun 10, 2016 at 12:02

Re: [openstack-dev] [qa] [Tempest] Abondoned old code reviews

2016-05-31 Thread Andrea Frittoli
On Mon, 30 May 2016, 6:25 p.m. Ken'ichi Ohmichi, wrote: > Hi, > > There are many patches which are not updated in Tempest review queue > even if having gotten negative feedback from reviewers or jenkins. > Nova team is abandoning such patches like [1]. > I feel it would be

Re: [openstack-dev] [tempest][SR-IOV] tempest breaks Mellanox CI

2016-06-16 Thread Andrea Frittoli
ox CI failure rates, so it may be that the pass rate is already good enough. > > > Anyway we proposed the following fix to tempest [3] > > Thanks for fixing this, and sorry about the inconvenience. Even with the fix in, the Mellanox CI job failed, which if unfortunate. I issued a re-ch

[openstack-dev] [qa] Tempest pre-provisioned credentials in the gate

2016-06-14 Thread Andrea Frittoli
] of the tool that pre-proprovisioned the accounts has fixed the issue: the past 8 runs of the periodic jobs have not encountered that race anymore [4][5]. Specifically I'd like to propose changing to start changing of the neutron jobs [6]. Andrea Frittoli [0] http://docs.openstack.org/developer

Re: [openstack-dev] [Octavia] [Tempest] Tempest tests using tempest-plugin

2016-02-19 Thread Andrea Frittoli
All the code that is in tempest-lib is stable interface that can be consumed safely. The code in tempest instead does not provide a guaranteed stable interface, as it was not originally meant for external consumption. So while you can import it, it may change without warning (i.e. with no new

Re: [openstack-dev] [QA] Not running for PTL

2016-03-14 Thread Andrea Frittoli
Thanks Matt for the great work as PTL in the past 4 cycles! You had the fun of serving through the change in governance model, which is especially though on horizontal teams like QA - and I think you set strong foundations for QA to be successful in the big tent. andreaf On Mon, Mar 14, 2016

Re: [openstack-dev] [Neutron] [neutron-lib] adding a new flag to neutron-lib

2016-03-14 Thread Andrea Frittoli
packages from a single repo. On Mon, Mar 14, 2016 at 6:04 PM Andrea Frittoli <andrea.fritt...@gmail.com> wrote: > Hi Anil, > > Devstack will install neutron-lib from the configured pypi mirror by > default. > > To pickup the change in neutron-lib (or in a library in gen

Re: [openstack-dev] [Neutron] [neutron-lib] adding a new flag to neutron-lib

2016-03-14 Thread Andrea Frittoli
Hi Anil, Devstack will install neutron-lib from the configured pypi mirror by default. To pickup the change in neutron-lib (or in a library in general) before a release is made you'll need to use a -src job for that library [0], where the library is installed from source. andrea [0]

Re: [openstack-dev] [QA][all] Propose to remove negative tests from Tempest

2016-03-19 Thread Andrea Frittoli
On Thu, Mar 17, 2016 at 2:57 AM Ken'ichi Ohmichi wrote: > 2016-03-16 19:41 GMT-07:00 Jim Rollenhagen : > > On Wed, Mar 16, 2016 at 06:20:11PM -0700, Ken'ichi Ohmichi wrote: > >> Hi > >> > >> I have one proposal[1] related to negative tests in

Re: [openstack-dev] How does tempest read in the variables defined in tempest.conf?

2016-03-26 Thread Andrea Frittoli
Hi, To run a multi-region scenario you need to have both regions deployed before a tempest run is started, so you would need a extra configuration items. But I'm not convinced that would be in scope for tempest - there's no single way to deploy multiple regions. To run the same scenario tests

Re: [openstack-dev] [qa] openstack health accounting problem

2016-03-02 Thread Andrea Frittoli
Thanks Sean for bringing this up. It's a known pain point that we discussed back in Tokyo [0]. Failures in class level fixtures are difficult to handle consistently, because there is no concept of success / failure at class level in the data model. If a failure happens during setup, no test is

Re: [openstack-dev] [neutron]: Neutron naming legal issues

2016-04-01 Thread Andrea Frittoli
LoL good one :) On Fri, Apr 1, 2016 at 6:47 AM Jimmy Akin wrote: > > Dear Neutrinos, > > We've been following the project for quite some time. > To our satisfaction the project seems to have done well; the base line of > features that were available to the networking

Re: [openstack-dev] [Designate] Tempest Tests - in-repo or separate

2016-04-04 Thread Andrea Frittoli
I look forward to the first (as far as I know) tempest plugin for a service in its own repo! :) On Mon, Apr 4, 2016 at 4:49 PM Hayes, Graham wrote: > On 04/04/2016 16:36, Jordan Pittier wrote: > > > > On Mon, Apr 4, 2016 at 5:01 PM, Hayes, Graham >

Re: [openstack-dev] [openstack-health][QA] We need your feedbacks

2016-05-02 Thread Andrea Frittoli
I personally like Openstack Health UI/UX. I use it a lot a an initial source of information. Thanks to the OH team for all the great work on this! And +1 to the new "feedback" link on the top and bottom of every page :) A few thoughts on my experience with OH. It can take a few clicks in OH to

Re: [openstack-dev] [QA][RFC] Skip this week meeting

2016-05-02 Thread Andrea Frittoli
I don't have anything urgent so fine with me. Andrea On Mon, 2 May 2016, 3:04 p.m. Masayuki Igawa, wrote: > Hi QA guys, > > We have very few topic this week to discuss. So I think we should skip > this week meeting. > Any thoughts? > > Best Regards, > -- Masayuki

Re: [openstack-dev] [all][tc] Equal Chances for all projects (was Plugins for all)

2016-07-26 Thread Andrea Frittoli
On Mon, Jul 25, 2016 at 10:36 PM Hayes, Graham wrote: > Top posting - this is a recap of what has been said, and some > clarifications > > I realise that I was not very clear at the beginning of this process, so > here is my effort to clarify things, from the ML thread, and

[openstack-dev] [tempest][plugins] Service clients stable interface in tempest.lib

2016-08-12 Thread Andrea Frittoli
your currently using one of the unstable "Manager" interfaces today. Please reach out for help in the #openstack-qa room if you have questions on the new interfaces, trouble using them in your plugin, requests for features or feedback. Thanks for reading through. Andrea Frittoli (andreaf

Re: [openstack-dev] gate jobs - papercuts

2017-02-01 Thread Andrea Frittoli
The first one is yet another flavour of libvirtd crash [0]: >> *** Error in `/usr/sbin/libvirtd': realloc(): invalid next size: 0x56108d7a7450 *** which adds to the list of three libvirt crash signatures listed by Jordan in [1]. I guess this new (?) signature could be incorporated in bug [2]

Re: [openstack-dev] gate jobs - papercuts

2017-02-01 Thread Andrea Frittoli
I actually ended-up proposing an update to the other bug, as the signature was much closed [0] andrea [0] https://bugs.launchpad.net/nova/+bug/1643911 [1] https://review.openstack.org/427754 On Wed, Feb 1, 2017 at 1:50 PM Andrea Frittoli <andrea.fritt...@gmail.com> wrote: > The

Re: [openstack-dev] [QA] Announcing my candidacy for PTL of the Pike cycle

2017-02-07 Thread Andrea Frittoli
On Tue, Feb 7, 2017 at 1:55 AM Ghanshyam Mann wrote: > Hi Jordan, > > Thanks for bring it up. I know we had both side of argument on those > changes. > > IMO in general, its all QA team responsibility to verify the requirement > very strictly and make sure no changes

Re: [openstack-dev] [QA] Gate Jobs failing after patch for bug/1628016

2017-01-30 Thread Andrea Frittoli
On Mon, Jan 30, 2017 at 3:25 PM White, Joshua L wrote: > Hi Team, > > > > I would like to get your feedback on the gate jobs failing and how to > alleviate the issue. > > > > The gate jobs are failing once the prefix is actually added for these > tests jobs below: > > >

[openstack-dev] [QA] [ptg] Team photo

2017-02-21 Thread Andrea Frittoli
Here are our team photos: https://www.dropbox.com/home/Public/PTG%20Atlanta%20QA%20Team andrea __ OpenStack Development Mailing List (not for usage questions) Unsubscribe:

Re: [openstack-dev] [qa] Tempest Stable plugin interface change broke gate

2017-02-21 Thread Andrea Frittoli
Hi Graham, sorry about that, and good catch. You are right, that's a stable interface so that change should not have landed. andrea On Tue, Feb 21, 2017 at 2:51 PM Hayes, Graham wrote: > Hi. > > https://review.openstack.org/#/c/434304/ landed yesterday, which was a >

Re: [openstack-dev] [QA] [ptg] Team photo

2017-02-22 Thread Andrea Frittoli
My bad, this link should be working: https://www.dropbox.com/sh/9svvv9cx51s1gzc/AAABHkfOTNtsUwi9Eb2GxPXLa?dl=0 The pictures are quite large so I'd rather not attach them directly. andrea On Wed, Feb 22, 2017 at 10:15 AM Yaroslav Lobankov wrote: > +1 > > Regards, >

[openstack-dev] [QA] No team meeting this week

2017-02-20 Thread Andrea Frittoli
Hello, Since most of us are at the PTG, we will not have a meeting this week (Feb 16th). Next meeting will be on March 2nd at 17:00 UTC [0]. andrea [0] https://wiki.openstack.org/wiki/Meetings/QATeamMeeting#Agenda_for_March_2nd_2017_.281700_UTC.29

Re: [openstack-dev] [QA][ptg] QA Team social evening

2017-02-20 Thread Andrea Frittoli
know. Thanks! andrea On Sun, Feb 19, 2017 at 12:35 PM Andrea Frittoli <andrea.fritt...@gmail.com> wrote: > Hello, > > I'd like to propose a social evening for the folks in the QA sessions. > I prepared a doodle [0] so if you're interested please vote :) > > I added

Re: [openstack-dev] [QA] [all] Pike PTG QA Input / Feedback Session

2017-02-17 Thread Andrea Frittoli
can discuss about it at the PTG and use it to improve ourselves :) On Tue, Feb 14, 2017 at 12:38 AM Andrea Frittoli <andrea.fritt...@gmail.com> wrote: > Hi folks, > > at the PTG in Atlanta we will schedule a session [0] to collect and > discuss feedback and > input from the

[openstack-dev] [QA][ptg] QA Team social evening

2017-02-19 Thread Andrea Frittoli
Hello, I'd like to propose a social evening for the folks in the QA sessions. I prepared a doodle [0] so if you're interested please vote :) I added the link to the main QA etherpad [1] as well. If you know a good place to go for food or drinks please add it to the etherpad as well. Andrea [0]

Re: [openstack-dev] [QA][ptg] QA Team social evening

2017-02-21 Thread Andrea Frittoli
] http://www.poorcalvins.com/Home [1] https://goo.gl/ADuVlX [2] http://doodle.com/poll/yxy8ts8s8te8rwwhsfrnft2i/admin On Mon, Feb 20, 2017 at 11:18 PM Andrea Frittoli <andrea.fritt...@gmail.com> wrote: Hi folks, thank you for your vote! It looks like the best option is tomorrow (Tuesday)

Re: [openstack-dev] [QA][ptg] QA Team social evening

2017-02-21 Thread Andrea Frittoli
we're meeting at the reception in 5min see you there andrea On Tue, 21 Feb 2017, 11:49 a.m. Andrea Frittoli, <andrea.fritt...@gmail.com> wrote: > Hello folks, > > I booked a table for tonight at 7:30 at Poor Calvin's [0]. It's a 15min > away from the Sheraton [1], for everyone

Re: [openstack-dev] [QA]Removal of test runner wrapper scripts in Tempest

2017-02-22 Thread Andrea Frittoli
On Wed, Feb 22, 2017 at 10:40 AM Jordan Pittier wrote: > Hi, > I've proposed https://review.openstack.org/#/c/436983/ in Tempest which > says: > > *Remove deprecated test runner wrappers (.sh files) This patch removes > run_tempest.sh, run_tests.sh,

[openstack-dev] [QA] Quality Assurance logo files

2017-02-13 Thread Andrea Frittoli
-- Forwarded message - From: Heidi Joy Tretheway Date: Mon, Feb 13, 2017 at 10:09 PM Subject: Quality Assurance logo files To: , Hi Ken’ichi and Andrea, I’m excited to finally be able to share final

[openstack-dev] [QA] Pike PTG Schedule

2017-02-13 Thread Andrea Frittoli
Hello team, I did some work on the etherpad [0] to organise the QA PTG schedule based on the proposed sessions. I separated discussion sessions from hands-on type of actives. I thing the former will require a fixed schedule so folks may know when to pop-in to attend; the latter may happen more

[openstack-dev] [QA] [all] Pike PTG QA Input / Feedback Session

2017-02-13 Thread Andrea Frittoli
Hi folks, at the PTG in Atlanta we will schedule a session [0] to collect and discuss feedback and input from the community on existing QA projects. We will use the resulting material in a later session to set priorities of the QA team for Pike. Note that for Tempest plugins specifically there

Re: [openstack-dev] [infra] [gate] [all] openstack services footprint lead to oom-kill in the gate

2017-02-15 Thread Andrea Frittoli
Some (new?) data on the oom kill issue in the gate. I filed a new bug / E-R query yet for the issue [1][2] since it looks to me like the issue is not specific to mysqld - oom-kill will just pick the best candidate, which in most cases happens to be mysqld. The next most likely candidate to show

Re: [openstack-dev] [QA] Pike PTG Schedule

2017-02-15 Thread Andrea Frittoli
On Tue, Feb 14, 2017 at 3:00 PM Ken'ichi Ohmichi <ken1ohmi...@gmail.com> wrote: > Hi Andrea, > > Thanks for organizing QA sessions for PTG. > > 2017-02-13 16:16 GMT-08:00 Andrea Frittoli <andrea.fritt...@gmail.com>: > > Hello team, > > > > I did som

Re: [openstack-dev] [QA] Pike PTG Schedule

2017-02-15 Thread Andrea Frittoli
and go, so I allocated 2 x 30min slots to most sessions. If you need a projector please book a room accordingly, and mark it on the schedule so that folks know where to go. Andrea On Wed, Feb 15, 2017 at 2:22 PM Andrea Frittoli <andrea.fritt...@gmail.com> wrote: > On Tue, Feb 14, 2017 a

Re: [openstack-dev] [designate] Status of the project

2017-02-11 Thread Andrea Frittoli
On Thu, Feb 9, 2017 at 7:22 PM Hayes, Graham wrote: > The HTML version of this is here: > http://graham.hayes.ie/posts/openstack-designate-where-we-are/ > > I have been asked a few times recently "What is the state of the Designate > project?", "How is Designate getting

Re: [openstack-dev] [qa] PTL non-candidacy

2017-01-19 Thread Andrea Frittoli
Thank you Ken for the great work and for your leadership! I'm really glad you'll stay in the team and keep contributing. On Fri, Jan 20, 2017 at 12:41 AM Ghanshyam Mann wrote: > Thanks Kenichi for all your hardwork and nice leadership. > > Its been very good and lot of

[openstack-dev] [qa] PTL Candidacy for Pike

2017-01-19 Thread Andrea Frittoli
Andrea Frittoli (andreaf) __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

[openstack-dev] [QA] Pike PTG Summary

2017-02-27 Thread Andrea Frittoli
Hi everyone, thanks to everyone who joined the QA track, hands-on session and discussions at the first PTG in Atlanta. I think it was a very productive week, it was great to meet so many of you in person. We also received a lot of feedback from the community [0]. The list of sessions is

[openstack-dev] [QA][blazar][ceilometer][congress][intel-nfv-ci-tests][ironic][manila][networking-bgpvpn][networking-fortinet][networking-sfc][neutron][neutron-fwaas][neutron-lbaas][nova-lxd][octavia]

2017-02-27 Thread Andrea Frittoli
Hello folks, TL;DR: if today you import manager,py from tempest.scenario please maintain a copy of [0] in tree until further notice. Full message: -- One of the priorities for the QA team in the Pike cycle is to refactor scenario tests to a sane code base [1]. As they are now,

Re: [openstack-dev] [QA]Refactoring Scenarios manager.py

2017-02-26 Thread Andrea Frittoli
On Sun, Feb 26, 2017 at 12:49 AM Masayuki Igawa wrote: > Hi, > > Thank you for bringing this up. > > Yeah, I understand your frustration. We already have the document about > our stable interface[1]. It says > -- > Stability > Any code that lives in tempest/lib will be

Re: [openstack-dev] [QA]Refactoring Scenarios manager.py

2017-02-26 Thread Andrea Frittoli
if we do it on a patch by patch basis. It would slow us down too much and it would become an ongoing effort for other teams which is probably not sustainable. > -gmann > > On Mon, Feb 27, 2017 at 3:13 AM, Andrea Frittoli < > andrea.fritt...@gmail.com> wrote: > > >

Re: [openstack-dev] [QA][infra][all] Measuring code coverage in integration tests

2016-10-06 Thread Andrea Frittoli
The difficulty with integration testing is that the services under test run in processes separated from the test one(s). There is not obvious / existing mechanism to collect coverage data in this case. Several cycles back used to be a backdoor built into nova to enable coverage data collection

Re: [openstack-dev] tempest tests in Horizon GUI

2016-09-21 Thread Andrea Frittoli
Hi Ofer, Tempest tests try to cleanup after themselves, so in theory after a Tempest run you shouldn't see any test resource left around. If you run your tests using dynamic credentials, test accounts are created on the fly, and deleted after they're used. If you use preprovisioned credentials,

Re: [openstack-dev] [QA] [Patrole] Nominating Felipe Monteiro for patrole core

2017-03-22 Thread Andrea Frittoli
On Thu, Mar 16, 2017 at 6:32 PM BARTRA, RICK wrote: > Felipe has done a tremendous amount of work stabilizing, enabling gates, > contributing new tests, and extensively reviewing code in the Patrole > project. In fact, he is the number one contributor to Patrole in terms of >

Re: [openstack-dev] Project Navigator Updates - Feedback Request

2017-03-25 Thread Andrea Frittoli
On Fri, 24 Mar 2017, 5:06 p.m. Lauren Sell, wrote: > Hi everyone, > > We’ve been talking for some time about updating the project navigator, and > we have a draft ready to share for community feedback before we launch and > publicize it. One of the big goals coming out of

Re: [openstack-dev] [qa][cinder] RFC: Cinder test on Tempest

2017-03-22 Thread Andrea Frittoli
On Wed, Mar 22, 2017 at 8:31 PM Sean McGinnis wrote: > On Wed, Mar 22, 2017 at 01:08:23PM -0700, Ken'ichi Ohmichi wrote: > > Hi, > > > > Now we need to update Tempest for following Cinder API status. > > I have an idea for restructuring and happy to see feedback about

Re: [openstack-dev] [QA][blazar][intel-nfv-ci-tests][nova-lxd][octavia][tap-as-a-service][vmware-nsx][barbican] Refactor of Tempest scenario base classes

2017-03-24 Thread Andrea Frittoli
to this. thank you andrea On Sat, Mar 18, 2017 at 12:04 PM Andrea Frittoli <andrea.fritt...@gmail.com> wrote: > Status update. > > Thanks to all your work, we are getting close to finishing this work! > > - 12 patches merged > - 7 patches ready, pending approval > - 2

Re: [openstack-dev] [QA][blazar][ceilometer][congress][intel-nfv-ci-tests][ironic][manila][networking-bgpvpn][networking-fortinet][networking-sfc][neutron][neutron-fwaas][neutron-lbaas][nova-lxd][octa

2017-03-17 Thread Andrea Frittoli
ne local copy) > Thank you, much appreciated! > > > -Solio > > > > *From: *Andrea Frittoli <andrea.fritt...@gmail.com> > *Reply-To: *"OpenStack Development Mailing List (not for usage > questions)" <openstack-dev@lists.openstack.org> > *Da

Re: [openstack-dev] [cinder][glance][horizon][keystone][nova][qa][swift] Feedback needed: Removal of legacy per-project vanity domain redirects

2017-03-15 Thread Andrea Frittoli
On Wed, Mar 8, 2017 at 8:09 PM Monty Taylor wrote: > On 03/08/2017 10:31 AM, Daniel P. Berrange wrote: > > On Wed, Mar 08, 2017 at 09:12:59AM -0600, Monty Taylor wrote: > >> Hey all, > >> > >> We have a set of old vanity redirect URLs from back when we made a URL > >> for

Re: [openstack-dev] [QA][blazar][ceilometer][congress][intel-nfv-ci-tests][ironic][manila][networking-bgpvpn][networking-fortinet][networking-sfc][neutron][neutron-fwaas][neutron-lbaas][nova-lxd][octa

2017-03-15 Thread Andrea Frittoli
On Wed, Mar 15, 2017 at 11:38 AM Dmitry Tantsur <dtant...@redhat.com> wrote: > On 02/27/2017 12:34 PM, Andrea Frittoli wrote: > > Hello folks, > > > > TL;DR: if today you import manager,py from tempest.scenario please > maintain a > > copy of [0] in tree unti

[openstack-dev] [QA] Forum Boston - Brainstorming

2017-03-15 Thread Andrea Frittoli
Hello folks, I set up an etherpad [0] for the QA team to track topic ideas / proposals for the Forum [1]. Please feel free to contribute ideas, we'll have a slot to discuss about this during our meetings starting tomorrow. Andrea [0] https://etherpad.openstack.org/p/BOS-QA-brainstorming [1]

Re: [openstack-dev] [QA][blazar][ceilometer][congress][intel-nfv-ci-tests][ironic][manila][networking-bgpvpn][networking-fortinet][networking-sfc][neutron][neutron-fwaas][neutron-lbaas][nova-lxd][octa

2017-03-18 Thread Andrea Frittoli
patches that need a review, any help would be much appreciated! Thank you andrea On Wed, Mar 15, 2017 at 3:56 PM Andrea Frittoli <andrea.fritt...@gmail.com> wrote: > On Wed, Mar 15, 2017 at 11:38 AM Dmitry Tantsur <dtant...@redhat.com> > wrote: > > On 02/27/2017 12:34 P

Re: [openstack-dev] [QA][gate][all] dsvm gate stability and scenario tests

2017-03-17 Thread Andrea Frittoli
On Fri, Mar 17, 2017 at 1:03 PM Sean Dague wrote: > On 03/17/2017 08:27 AM, Jordan Pittier wrote: > > The patch that reduced the number of Tempest Scenarios we run in every > > job and also reduce the test run concurrency [0] was merged 13 days ago. > > Since, the situation (i.e

Re: [openstack-dev] [ptls] Project On-Boarding Rooms

2017-03-15 Thread Andrea Frittoli
QA would love to have a slot for new contributors to QA projects and plugins. On Wed, 15 Mar 2017, 8:21 p.m. Rob Cresswell (rcresswe), wrote: > Horizon would love the opportunity to baffle newcomers. > This could also be useful for the many plugins that are managed by their

Re: [openstack-dev] [ptls] Project On-Boarding Rooms

2017-03-16 Thread Andrea Frittoli
On Thu, 16 Mar 2017, 9:34 a.m. Thierry Carrez, wrote: > Kendall Nelson wrote: > > We have a very limited slots available for interested projects so it > > will be a first come first served process. Let me know if you are > > interested and I will reserve a slot for you if

Re: [openstack-dev] [tripleo] pingtest vs tempest

2017-04-06 Thread Andrea Frittoli
I don't really have much context in what the decision is going to be based on here, so I'll just add some random comments here and there. On Thu, Apr 6, 2017 at 12:48 PM Arx Cruz wrote: > Having tempest running will allow these jobs to appear in openstack-health > system as

Re: [openstack-dev] [devstack] experimenting with systemd for services

2017-04-05 Thread Andrea Frittoli
On Wed, Apr 5, 2017 at 9:14 PM Sean Dague wrote: > At the PTG clayg brought up an excellent question about what the > expected flow was to restart a bunch of services in devstack after a > code changes that impacts many of them (be it common code, or a > library). People had

Re: [openstack-dev] [QA][intel-nfv-ci-tests][octavia][tap-as-a-service][vmware-nsx][networking-sfc] Refactor of Tempest scenario base classes

2017-04-06 Thread Andrea Frittoli
andrea On Fri, Mar 24, 2017 at 2:55 PM Andrea Frittoli <andrea.fritt...@gmail.com> wrote: > Status update on the scenario manager base class: > > - 13 patches merged > - 6 patches ready (on master) > - 2 patches ready (on stable branches) > > Details: https://etherpad.open

[openstack-dev] [qa] No meeting next week 13/04

2017-04-09 Thread Andrea Frittoli
Hi, a few of us will be off next week, so I'm proposing to cancel the meeting on Thursday. Let me know if you have any concern. andrea __ OpenStack Development Mailing List (not for usage questions) Unsubscribe:

Re: [openstack-dev] [qa][nova][defcore] Removal of Compute Baremetal GET nodes tests from Tempest

2017-04-11 Thread Andrea Frittoli
Thanks for raising this point! On Tue, Apr 11, 2017 at 5:34 AM Ghanshyam Mann wrote: > Hi All, > > There is tempest tests for compute baremetal GET nodes tests[1]. This > tests involve ironic and nova. Ironic to create baremetal nodes and > then GET nodes using nova

[openstack-dev] [api][qa][tc][glance][keystone][cinder] Testing of deprecated API versions

2017-03-09 Thread Andrea Frittoli
Hi folks, I'm trying to figure out what's the best approach to fade out testing of deprecated API versions. We currently host in Tempest API tests for Glance API v1, Keystone API v2 and Cinder API v1. According to the guidelines for the "follow-standard-deprecation" tag [0], when projects that

Re: [openstack-dev] Disabling glance v1 by default in devstack

2017-03-03 Thread Andrea Frittoli
On Fri, Mar 3, 2017 at 7:38 PM Matt Riedemann wrote: > I've got a change proposed to disable glance v1 by default in devstack > for Pike [1]. > > The glance v1 API has been deprecated for awhile now. Nova started > supporting glance v2 in Newton and removed the ability to

Re: [openstack-dev] [QA][gate][all] dsvm gate stability and scenario tests

2017-03-04 Thread Andrea Frittoli
nitor their status periodically > as well as on particular patch if we need to. > > -gmann > > On Fri, Mar 3, 2017 at 4:28 PM, Andrea Frittoli <andrea.fritt...@gmail.com > > wrote: > > Hello folks, > > we discussed a lot since the PTG about issues with gate stability;

Re: [openstack-dev] [QA][blazar][ceilometer][congress][intel-nfv-ci-tests][ironic][manila][networking-bgpvpn][networking-fortinet][networking-sfc][neutron][neutron-fwaas][neutron-lbaas][nova-lxd][octa

2017-03-07 Thread Andrea Frittoli
ps://review.openstack.org/#/c/439291/1 > Cheers, > > Dr. Pavlo Shchelokovskyy > Senior Software Engineer > Mirantis Inc > www.mirantis.com > > On Mon, Feb 27, 2017 at 1:34 PM, Andrea Frittoli < > andrea.fritt...@gmail.com> wrote: > > Hello folks, > > TL;DR: if to

Re: [openstack-dev] [QA][blazar][ceilometer][congress][intel-nfv-ci-tests][ironic][manila][networking-bgpvpn][networking-fortinet][networking-sfc][neutron][neutron-fwaas][neutron-lbaas][nova-lxd][octa

2017-03-07 Thread Andrea Frittoli
work on this! I would recommend to prune the imported module as much as possible as well. It would make it easier for the QA team to identify which interfaces on Tempest side should be migrated to stable. andrea On Wed, Mar 1, 2017 at 1:25 PM Andrea Frittoli <andrea.fritt...@gmail.com>

Re: [openstack-dev] [api][qa][tc][nova][cinder] Testing of a microversioned world

2017-03-13 Thread Andrea Frittoli
On Sat, Mar 11, 2017 at 10:45 PM Matt Riedemann <mriede...@gmail.com> wrote: On 3/10/2017 3:02 PM, Andrea Frittoli wrote: > > We had a couple of sessions related to this topic at the PTG [0][1]. > > We agreed that we want to still maintain integration tests only in > Tempest,

Re: [openstack-dev] [api][qa][tc][nova][cinder] Testing of a microversioned world

2017-03-13 Thread Andrea Frittoli
On Mon, Mar 13, 2017 at 6:52 AM Ghanshyam Mann <ghanshyamm...@gmail.com> wrote: > On Sun, Mar 12, 2017 at 7:40 AM, Matt Riedemann <mriede...@gmail.com> > wrote: > > On 3/10/2017 3:02 PM, Andrea Frittoli wrote: > > > We had a couple of sessions related to thi

Re: [openstack-dev] [api][qa][tc][glance][keystone][cinder] Testing of deprecated API versions

2017-03-10 Thread Andrea Frittoli
On Fri, Mar 10, 2017 at 2:24 PM Doug Hellmann wrote: > Excerpts from Ghanshyam Mann's message of 2017-03-10 10:55:25 +0900: > > On Fri, Mar 10, 2017 at 7:23 AM, Lance Bragstad > wrote: > > > > > > > > > > > On Thu, Mar 9, 2017 at 3:46 PM, Doug

Re: [openstack-dev] [api][qa][tc][glance][keystone][cinder] Testing of deprecated API versions

2017-03-10 Thread Andrea Frittoli
#OpenStack_Block_Storage_.28Cinder.29 On Fri, Mar 10, 2017 at 2:49 PM Andrea Frittoli <andrea.fritt...@gmail.com> wrote: > On Fri, Mar 10, 2017 at 2:24 PM Doug Hellmann <d...@doughellmann.com> > wrote: > > Excerpts from Ghanshyam Mann's message of 2017-03-10 10:55:25 +0900:

Re: [openstack-dev] [api][qa][tc][glance][keystone][cinder] Testing of deprecated API versions

2017-03-10 Thread Andrea Frittoli
On Fri, Mar 10, 2017 at 2:49 PM Andrea Frittoli <andrea.fritt...@gmail.com> wrote: > On Fri, Mar 10, 2017 at 2:24 PM Doug Hellmann <d...@doughellmann.com> > wrote: > > Excerpts from Ghanshyam Mann's message of 2017-03-10 10:55:25 +0900: > > On Fri, Mar 10, 2017 at 7

Re: [openstack-dev] [api][qa][tc][glance][keystone][cinder] Testing of deprecated API versions

2017-03-10 Thread Andrea Frittoli
On Fri, Mar 10, 2017 at 3:12 PM Lance Bragstad <lbrags...@gmail.com> wrote: > On Fri, Mar 10, 2017 at 8:49 AM, Andrea Frittoli < > andrea.fritt...@gmail.com> wrote: > > > > On Fri, Mar 10, 2017 at 2:24 PM Doug Hellmann <d...@doughellmann.com> > wrote: >

Re: [openstack-dev] [api][qa][tc][glance][keystone][cinder] Testing of deprecated API versions

2017-03-10 Thread Andrea Frittoli
On Fri, Mar 10, 2017 at 1:59 AM Ghanshyam Mann wrote: On Fri, Mar 10, 2017 at 7:23 AM, Lance Bragstad wrote: On Thu, Mar 9, 2017 at 3:46 PM, Doug Hellmann wrote: Excerpts from Andrea Frittoli's message of 2017-03-09

Re: [openstack-dev] [api][qa][tc][glance][keystone][cinder] Testing of deprecated API versions

2017-03-10 Thread Andrea Frittoli
On Fri, Mar 10, 2017 at 4:55 PM Sean McGinnis wrote: > > > > > As far as I can tell: > > - Cinder v1 if I'm not mistaken has been deprecated in Juno, so it's > > deprecated in all supported releases. > > - Glance v1 has been deprecated in Newton, so it's deprecated in all

Re: [openstack-dev] [api][qa][tc][nova][cinder] Testing of a microversioned world

2017-03-10 Thread Andrea Frittoli
On Fri, Mar 10, 2017 at 8:39 PM Ken'ichi Ohmichi wrote: > Hi John, > > Now Tempest is testing microversions only for Nova and contains some > testing framework for re-using for another projects. > On this framework, we can implement necessary microversions tests as > we

Re: [openstack-dev] [QA]Refactoring Scenarios manager.py

2017-03-01 Thread Andrea Frittoli
On Wed, Mar 1, 2017 at 12:39 PM Jordan Pittier wrote: > On Wed, Mar 1, 2017 at 3:57 AM, Ghanshyam Mann > wrote: > > Doing gradual refactoring and fixing plugins time to time needs lot of > wait and sync. > > That needs: > 1. Plugins to switch

Re: [openstack-dev] [QA]Refactoring Scenarios manager.py

2017-03-01 Thread Andrea Frittoli
On Wed, Mar 1, 2017 at 12:54 PM Sean Dague wrote: > On 03/01/2017 07:35 AM, Jordan Pittier wrote: > > > > > > On Wed, Mar 1, 2017 at 3:57 AM, Ghanshyam Mann > > wrote: > > > > Doing gradual refactoring and fixing

  1   2   3   >