Re: [openstack-dev] [qa][keystone] Keystoneclient tests to tempest

2013-12-09 Thread Brant Knudson
Responses inline. On Mon, Dec 9, 2013 at 10:07 AM, Sean Dague s...@dague.net wrote: On 12/09/2013 10:12 AM, Brant Knudson wrote: Monty - Thanks for doing the work already to get the infrastructure set up. Looks like I've got the easy part here. I posted an initial patch that has one

Re: [openstack-dev] [qa][keystone] Keystoneclient tests to tempest

2013-12-09 Thread Jeremy Stanley
On 2013-12-09 11:07:50 -0600 (-0600), Brant Knudson wrote: [...] Is testing multiple versions of keystoneclient actually worth it? If the other projects don't feel the need for this then why does Keystone? It's actually caught problems so it's proved useful to Keystone, and we're making

Re: [openstack-dev] [qa][keystone] Keystoneclient tests to tempest

2013-12-09 Thread Brant Knudson
On Mon, Dec 9, 2013 at 11:18 AM, Jeremy Stanley fu...@yuggoth.org wrote: On 2013-12-09 11:07:50 -0600 (-0600), Brant Knudson wrote: [...] Is testing multiple versions of keystoneclient actually worth it? If the other projects don't feel the need for this then why does Keystone? It's

Re: [openstack-dev] [qa][keystone] Keystoneclient tests to tempest

2013-12-09 Thread Jeremy Stanley
On 2013-12-09 11:50:31 -0600 (-0600), Brant Knudson wrote: [...] I don't know of any specific testing that verifies that the client works against older (stable/*) servers. Maybe it happens when you submit a change to stable/ later. When a change is submitted or approved for a stable/foo server

Re: [openstack-dev] [qa][keystone] Keystoneclient tests to tempest

2013-12-09 Thread Adam Young
On 12/09/2013 11:07 AM, Sean Dague wrote: On 12/09/2013 10:12 AM, Brant Knudson wrote: Monty - Thanks for doing the work already to get the infrastructure set up. Looks like I've got the easy part here. I posted an initial patch that has one test from keystone in

Re: [openstack-dev] [qa][keystone] Keystoneclient tests to tempest

2013-12-09 Thread Dolph Mathews
On Sun, Dec 8, 2013 at 5:20 PM, Monty Taylor mord...@inaugust.com wrote: Hi! Thanks - I've been wanting to kill this for a long time. Thanks for starting the discussion... On 12/08/2013 07:26 PM, Brant Knudson wrote: We'd like to get the keystoneclient tests out of keystone. They're

Re: [openstack-dev] [qa][keystone] Keystoneclient tests to tempest

2013-12-09 Thread Brant Knudson
Monty - Thanks for doing the work already to get the infrastructure set up. Looks like I've got the easy part here. I posted an initial patch that has one test from keystone in https://review.openstack.org/#/c/60724/ . I hope to be able to move all the tests over unchanged. The tricky part is

Re: [openstack-dev] [qa][keystone] Keystoneclient tests to tempest

2013-12-09 Thread Sean Dague
On 12/09/2013 10:12 AM, Brant Knudson wrote: Monty - Thanks for doing the work already to get the infrastructure set up. Looks like I've got the easy part here. I posted an initial patch that has one test from keystone in https://review.openstack.org/#/c/60724/ . I hope to be able to move

[openstack-dev] [qa][keystone] Keystoneclient tests to tempest

2013-12-08 Thread Brant Knudson
We'd like to get the keystoneclient tests out of keystone. They're serving a useful purpose of catching problems with non-backwards compatible changes in keystoneclient so we still want them run. Problem is they're running at the wrong time -- only on changes to keystone and not changes to

Re: [openstack-dev] [qa][keystone] Keystoneclient tests to tempest

2013-12-08 Thread Matt Riedemann
On Sunday, December 08, 2013 11:26:07 AM, Brant Knudson wrote: We'd like to get the keystoneclient tests out of keystone. They're serving a useful purpose of catching problems with non-backwards compatible changes in keystoneclient so we still want them run. Problem is they're running at the

Re: [openstack-dev] [qa][keystone] Keystoneclient tests to tempest

2013-12-08 Thread David Stanek
On Sun, Dec 8, 2013 at 3:37 PM, Matt Riedemann mrie...@linux.vnet.ibm.comwrote: On Sunday, December 08, 2013 11:26:07 AM, Brant Knudson wrote: We'd like to get the keystoneclient tests out of keystone. They're serving a useful purpose of catching problems with non-backwards compatible

Re: [openstack-dev] [qa][keystone] Keystoneclient tests to tempest

2013-12-08 Thread Monty Taylor
Hi! Thanks - I've been wanting to kill this for a long time. Thanks for starting the discussion... On 12/08/2013 07:26 PM, Brant Knudson wrote: We'd like to get the keystoneclient tests out of keystone. They're serving a useful purpose of catching problems with non-backwards compatible