Re: [openstack-dev] [tempest][nova][defcore] Add option to disable some strict response checking for interop testing

2016-06-15 Thread Daryl Walleck
> -Original Message- > From: GHANSHYAM MANN [mailto:ghanshyamm...@gmail.com] > Sent: Wednesday, June 15, 2016 9:59 PM > To: OpenStack Development Mailing List (not for usage questions) > > Subject: Re: [openstack-dev] [tempest][nova][defcore] Add option

Re: [openstack-dev] [QA][all] Propose to remove negative tests from Tempest

2016-03-18 Thread Daryl Walleck
I do think negative tests should live on, most likely in their own tempest-plugin based repository. However, I'm not sure that I agree with the reason being because they are functional tests rather than integration. If you look at the current tests, one could argue that many non-Nova tests are

[openstack-dev] [qa] [tempest] Question on time precision in auth providers

2015-05-03 Thread Daryl Walleck
Hi folks, While running Tempest I ran into a bit of interesting behavior. As part of the Tempest auth client, checks are performed to assure the token in use is still valid. When parsing the expiry timestamp from the auth response, a very specific datetime format is expected for Keystone v2

Re: [openstack-dev] [qa] Smarter timeouts in Tempest?

2014-05-19 Thread Daryl Walleck
This is still a partially formed idea, but one of the ways I've thought of solving the timeout issue is by using aggregate data from previous results. Any of the event systems (Ceilometer, StackTach) should allow you to create models of what an inbounds server build (or any action) time per

Re: [openstack-dev] [qa] Selecting Compute tests by driver/hypervisor

2014-04-22 Thread Daryl Walleck
@lists.openstack.org Subject: Re: [openstack-dev] [qa] Selecting Compute tests by driver/hypervisor On 04/21/2014 06:52 PM, Daryl Walleck wrote: I nearly opened a spec for this, but I’d really like to get some feedback first. One of the challenges I’ve seen lately for Nova teams not using KVM or Xen

[openstack-dev] [qa] Selecting Compute tests by driver/hypervisor

2014-04-21 Thread Daryl Walleck
I nearly opened a spec for this, but I'd really like to get some feedback first. One of the challenges I've seen lately for Nova teams not using KVM or Xen (Ironic and LXC are just a few) is how to properly run the subset of Compute tests that will run for their hypervisor or driver. Regexes

Re: [openstack-dev] [qa] [ironic] Need tempest reviews from ironic team

2014-03-31 Thread Daryl Walleck
Hi David, I'm actually starting to ramp up on Ironic, so once I have my dev environment up and running, I'll be more than glad to have a look at any Tempest/Ironic reviews. Daryl From: David Kranz [dkr...@redhat.com] Sent: Monday, March 31, 2014 3:46 PM To:

Re: [openstack-dev] [Ironic] Functional testing, Tempest

2014-03-23 Thread Daryl Walleck
Hi Adam, I think the steps you've completed so far are the foundation for testers like myself to be able to really dive in and start kicking the tires of Ironic. Having an easily repeatable way to generate test environments makes a huge impact in where I spend my time (environments vs actual