Re: [Openstack] running Tempest continuously in the openstack project?

2012-02-27 Thread Daryl Walleck
I'm testing against a bare metal installation of Openstack and since a few days 
ago, an instance of Devstack as well. My team and I are mostly running Tempest 
from OSX or Ubuntu. Some of the clutter in the Tempest project is due to a 
merge of many projects to one. There are still some legacy portions of code 
remaining which will be phased out in the next few months so that the final 
project is much cleaner and easier to understand.

I have some revised documentation that I'm preparing to push, but in the 
interim I'll explain a bit more about how the project should be configured. The 
tempest.conf.sample file is a template to be used for your actual 
configuration. Your actual config file should be named tempest.conf. The host, 
port, apiVer, and path variables should build the path to your Keystone 
deployment, and the user, api_key, and tenant_name fields should match some 
existing user in your deployment.

The environment section is mostly for reference data. image_ref and 
image_ref_alt should be id or ref for two distinct images in your deployment. 
Flavor_ref and flavor_ref_alt should be set based on valid flavors in your 
deployment as well. Create_image_enabled and resize_available are feature flags 
to toggle tests for that functionality. Once you have a valid config file, the 
tests are runnable like any other test via nose. That one file is all that 
needs to be changed. 

I'm glad to see the surge of interest in Tempest, and every bit of feedback is 
helpful. I'll be pushing code (some of which is already merged) and 
documentation changes this week to address issues and concerns. I'm also 
lurking in openstack-dev as dwalleck, and I'd be more than glad to discuss 
Tempest and help work through any issues anyone is having.

Daryl

On Feb 27, 2012, at 11:03 AM, Ionuț Arțăriși wrote:

> On 02/27/2012 05:13 PM, Daryl Walleck wrote:
>> I'm actively looking into any issues. I have all these tests passing locally 
>> in my environment, so the issues seem to be focused around people using 
>> devstack. I've made some merge prop's that will take care of a few of the 
>> issues. One issue that will certainly come up is that if you have rate 
>> limiting enabled, most of the tests will certainly fail. I've also included 
>> the link to the Tempest documentation, which also should help make using a 
>> bit more clear. I'm working on updating this document as I'm using Devstack 
>> so that I can either smooth over or enumerate issues that may come up when 
>> running the tests. If you run into anything though, please make a report to 
>> the Tempest project and I'll have a look.
>> 
>> http://qa.openstack.org/integration.html
>> 
>> https://launchpad.net/tempest
>> 
>> Daryl
>> 
> 
> Can you give more details about your environment? What operating system are 
> you running the tests on? Are all the tested openstack components the latest 
> versions from master? What specific configurations have you done?
> 
> The documentation that you linked to does not explain how to actually set up 
> the tests.
> 
> There are currently three README files in the repository which say to rename 
> the tempest.conf.sample and config.ini.sample files and then "edit the 
> variables to fit your test environment", but none of them explain what that 
> actually means. Which values should be reset? Where would I get the 
> information to be able to set them?
> 
> I'm trying hard to understand how all of this works, but without a canonical 
> working configuration I don't know which errors are mine and which are 
> tempest bugs.
> 
> -Ionuț

___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] running Tempest continuously in the openstack project?

2012-02-27 Thread David Kranz

On 2/27/2012 3:02 PM, Dean Troyer wrote:

On Mon, Feb 27, 2012 at 10:13 AM, Daryl Walleck
  wrote:

  I'm working on updating this document as I'm using Devstack so that I can 
either smooth
over or enumerate issues that may come up when running the tests. If you run 
into
anything though, please make a report to the Tempest project and I'll have a 
look.

Daryl, devstack has a script (tools/configure_tempest.sh) that is
meant to transfer the devstack settings to tempest.conf.  It edits
tempest.conf.sample so it should just need to know the attribute names
for the settings.  Let me know if there is more that devstack needs to
do to set up tempest.

dt

It would be helpful to have a NORATELIMIT variable that could be set in 
localrc.


 -David

___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] running Tempest continuously in the openstack project?

2012-02-27 Thread David Kranz

On 2/27/2012 3:02 PM, Dean Troyer wrote:

On Mon, Feb 27, 2012 at 10:13 AM, Daryl Walleck
  wrote:

  I'm working on updating this document as I'm using Devstack so that I can 
either smooth
over or enumerate issues that may come up when running the tests. If you run 
into
anything though, please make a report to the Tempest project and I'll have a 
look.

Daryl, devstack has a script (tools/configure_tempest.sh) that is
meant to transfer the devstack settings to tempest.conf.  It edits
tempest.conf.sample so it should just need to know the attribute names
for the settings.  Let me know if there is more that devstack needs to
do to set up tempest.

dt

It would be helpful to have a NORATELIMIT variable that could be set in 
localrc.


 -David

___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] running Tempest continuously in the openstack project?

2012-02-27 Thread Jay Pipes
Please note that the patch that fixes the Catalog name/type is now in 
Tempest trunk.


Thanks,
-jay

On 02/27/2012 01:27 PM, Eoghan Glynn wrote:




1. Add catalog_name=compute to tempest.conf
2. Change "name" to "type" in rest_client.py



Yep, easiest to just apply this patch:

git fetch https://review.openstack.org/p/openstack/tempest 
refs/changes/59/4259/1&&  git format-patch -1 --stdout FETCH_HEAD

Cheers,
Eoghan

___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] running Tempest continuously in the openstack project?

2012-02-27 Thread Jay Pipes

On 02/27/2012 11:13 AM, Daryl Walleck wrote:

I'm actively looking into any issues. I have all these tests passing locally in 
my environment, so the issues seem to be focused around people using devstack.


Actually, devstack + keystone redux... we've been having some weird 
issues preventing us from even being able to authenticate with an admin 
token.


Currently working on this...

> I've made some merge prop's that will take care of a few of the 
issues. One issue that will certainly come up is that if you have rate 
limiting enabled, most of the tests will certainly fail.


Note this patch from John Garbutt to devstack that enables one to turn 
off ratelimit middleware... should hit devstack trunk shortly:


https://review.openstack.org/#change,4586

-jay

___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] running Tempest continuously in the openstack project?

2012-02-27 Thread Dean Troyer
On Mon, Feb 27, 2012 at 10:13 AM, Daryl Walleck
 wrote:
>  I'm working on updating this document as I'm using Devstack so that I can 
> either smooth
> over or enumerate issues that may come up when running the tests. If you run 
> into
> anything though, please make a report to the Tempest project and I'll have a 
> look.

Daryl, devstack has a script (tools/configure_tempest.sh) that is
meant to transfer the devstack settings to tempest.conf.  It edits
tempest.conf.sample so it should just need to know the attribute names
for the settings.  Let me know if there is more that devstack needs to
do to set up tempest.

dt

-- 

Dean Troyer
dtro...@gmail.com

___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] running Tempest continuously in the openstack project?

2012-02-27 Thread Michael Pittaro
On Mon, Feb 27, 2012 at 9:03 AM, Ionuț Arțăriși  wrote:
> On 02/27/2012 05:13 PM, Daryl Walleck wrote:
>>
>> I'm actively looking into any issues. I have all these tests passing
>> locally in my environment, so the issues seem to be focused around people
>> using devstack. I've made some merge prop's that will take care of a few of
>> the issues. One issue that will certainly come up is that if you have rate
>> limiting enabled, most of the tests will certainly fail. I've also included
>> the link to the Tempest documentation, which also should help make using a
>> bit more clear. I'm working on updating this document as I'm using Devstack
>> so that I can either smooth over or enumerate issues that may come up when
>> running the tests. If you run into anything though, please make a report to
>> the Tempest project and I'll have a look.
>>
>> http://qa.openstack.org/integration.html
>>
>> https://launchpad.net/tempest
>>
>> Daryl
>>
>
> Can you give more details about your environment? What operating system are
> you running the tests on? Are all the tested openstack components the latest
> versions from master? What specific configurations have you done?
>
> The documentation that you linked to does not explain how to actually set up
> the tests.
>
> There are currently three README files in the repository which say to rename
> the tempest.conf.sample and config.ini.sample files and then "edit the
> variables to fit your test environment", but none of them explain what that
> actually means. Which values should be reset? Where would I get the
> information to be able to set them?
>
> I'm trying hard to understand how all of this works, but without a canonical
> working configuration I don't know which errors are mine and which are
> tempest bugs.
>
>
> -Ionuț
>
I found the presentation linked here to be useful:

http://www.mail-archive.com/openstack@lists.launchpad.net/msg06616.html

A few other notes:

- If you are using devstack. the script tools/configure_tempest.sh
  creates a good first cut at tempest.conf.

- Until bug 933845 is fixed https://bugs.launchpad.net/tempest/+bug/933845,
  you will need to add the catalog_name entry for comput to tempest.conf

- I found I had to manually update the [environment] image_ref in
  tempest.conf

- I disabled resize (resize_available=false) , since I had problems
  with it and kvm )( didn't pursue yet...)

- You definitely need to disable or change the rate limits in novas
api-paste.ini

[pipeline:openstack_compute_api_v2]
pipeline = faultwrap noauth ratelimit osapi_compute_app_v2
^^^ just remove

[pipeline:openstack_volume_api_v1]
pipeline = faultwrap noauth ratelimit osapi_volume_app_v1
^^^

mike

___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] running Tempest continuously in the openstack project?

2012-02-27 Thread David Kranz
I have been using devstack and tempest quite well. There is a script in 
tempest that will convert the devstack-created configuration to a 
tempest.conf file. The thing that really got me over the hump was Jay's 
writeup:


https://docs.google.com/a/qrclab.com/presentation/d/1M3XhAco_0u7NZQn3Gz53z9VOHHrkQBzEs5gt43ZvhOc/edit

I highly recommend it. As Daryl said, make sure you remove the ratelimit 
from devstack/stack.sh before running it.


 -David

On 2/27/2012 12:03 PM, Ionuț Arțăriși wrote:

On 02/27/2012 05:13 PM, Daryl Walleck wrote:
I'm actively looking into any issues. I have all these tests passing 
locally in my environment, so the issues seem to be focused around 
people using devstack. I've made some merge prop's that will take 
care of a few of the issues. One issue that will certainly come up is 
that if you have rate limiting enabled, most of the tests will 
certainly fail. I've also included the link to the Tempest 
documentation, which also should help make using a bit more clear. 
I'm working on updating this document as I'm using Devstack so that I 
can either smooth over or enumerate issues that may come up when 
running the tests. If you run into anything though, please make a 
report to the Tempest project and I'll have a look.


http://qa.openstack.org/integration.html

https://launchpad.net/tempest

Daryl



Can you give more details about your environment? What operating 
system are you running the tests on? Are all the tested openstack 
components the latest versions from master? What specific 
configurations have you done?


The documentation that you linked to does not explain how to actually 
set up the tests.


There are currently three README files in the repository which say to 
rename the tempest.conf.sample and config.ini.sample files and then 
"edit the variables to fit your test environment", but none of them 
explain what that actually means. Which values should be reset? Where 
would I get the information to be able to set them?


I'm trying hard to understand how all of this works, but without a 
canonical working configuration I don't know which errors are mine and 
which are tempest bugs.


-Ionuț

___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp



___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] running Tempest continuously in the openstack project?

2012-02-27 Thread Daryl Walleck
This isn't really a bug in either project, but a configuration issue. The name 
of the endpoint isn't static, so making it 'nova' or 'compute' may not always 
be correct. If you check the name of your Compute project that's returned in 
the Keystone auth request, you can find the name and configure Tempest by 
setting the catalog property with that. To avoid having to even configure that, 
I have a merge prop in queue to look at the type (which for Nova as far as I 
understand should always be 'compute') to have one less configuration for 
people to deal with.

Daryl

On Feb 27, 2012, at 9:49 AM, David Kranz wrote:

> There is still a bug in tempest and/or keystone. To run Tempest and devstack 
> you have to:
> 
> 1. Add catalog_name=compute to tempest.conf
> 2. Change "name" to "type" in rest_client.py
> 
> 
> -David
> 
> 
> On 2/27/2012 8:18 AM, Ionuț Arțăriși wrote:
>> On 02/22/2012 07:17 PM, Jay Pipes wrote:
>>> On 02/22/2012 10:49 AM, James E. Blair wrote:
 Indeed, as soon as someone says "I have Tempest working on a system
 configured by devstack with a repeatable process, here's how I did
 it..." we'll start running it in Jenkins. But so far I've heard from
 the Tempest developers that it's not quite ready yet.
>>> 
>>> That would be correct. Still work needed to get things working more
>>> consistently.
>>> 
>> 
>> How can I help with this effort? Who should I contact?
>> 
>> Right now I'm having trouble setting up running the tests against devstack 
>> (a configuration problem on my part I suppose, but I blame it on the lack of 
>> documentation).
>> 
>> -Ionuț
>> 
>> ___
>> Mailing list: https://launchpad.net/~openstack
>> Post to : openstack@lists.launchpad.net
>> Unsubscribe : https://launchpad.net/~openstack
>> More help   : https://help.launchpad.net/ListHelp
> 
> 
> ___
> Mailing list: https://launchpad.net/~openstack
> Post to : openstack@lists.launchpad.net
> Unsubscribe : https://launchpad.net/~openstack
> More help   : https://help.launchpad.net/ListHelp

___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] running Tempest continuously in the openstack project?

2012-02-27 Thread Eoghan Glynn


> 1. Add catalog_name=compute to tempest.conf
> 2. Change "name" to "type" in rest_client.py


Yep, easiest to just apply this patch:

git fetch https://review.openstack.org/p/openstack/tempest 
refs/changes/59/4259/1 && git format-patch -1 --stdout FETCH_HEAD

Cheers,
Eoghan

___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] running Tempest continuously in the openstack project?

2012-02-27 Thread Michael Pittaro
On Mon, Feb 27, 2012 at 7:49 AM, David Kranz  wrote:
>
> There is still a bug in tempest and/or keystone. To run Tempest and devstack 
> you have to:
>
> 1. Add catalog_name=compute to tempest.conf
> 2. Change "name" to "type" in rest_client.py
>
>

You can also use:

catalog_name = 'Compute Service'

and ship the change in rest_client.py

___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] running Tempest continuously in the openstack project?

2012-02-27 Thread Eoghan Glynn



> Right now I'm having trouble setting up running the tests against
> devstack (a configuration problem on my part I suppose, but I blame
> it on the lack of documentation).


Hi Ionut,

I'm currently working on getting tempest running on Fedora 16.

I'll follow up here with a recipe once I have the test runs fully green.

Cheers,
Eoghan

___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] running Tempest continuously in the openstack project?

2012-02-27 Thread Ionuț Arțăriși

On 02/27/2012 05:13 PM, Daryl Walleck wrote:

I'm actively looking into any issues. I have all these tests passing locally in 
my environment, so the issues seem to be focused around people using devstack. 
I've made some merge prop's that will take care of a few of the issues. One 
issue that will certainly come up is that if you have rate limiting enabled, 
most of the tests will certainly fail. I've also included the link to the 
Tempest documentation, which also should help make using a bit more clear. I'm 
working on updating this document as I'm using Devstack so that I can either 
smooth over or enumerate issues that may come up when running the tests. If you 
run into anything though, please make a report to the Tempest project and I'll 
have a look.

http://qa.openstack.org/integration.html

https://launchpad.net/tempest

Daryl



Can you give more details about your environment? What operating system 
are you running the tests on? Are all the tested openstack components 
the latest versions from master? What specific configurations have you done?


The documentation that you linked to does not explain how to actually 
set up the tests.


There are currently three README files in the repository which say to 
rename the tempest.conf.sample and config.ini.sample files and then 
"edit the variables to fit your test environment", but none of them 
explain what that actually means. Which values should be reset? Where 
would I get the information to be able to set them?


I'm trying hard to understand how all of this works, but without a 
canonical working configuration I don't know which errors are mine and 
which are tempest bugs.


-Ionuț

___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] running Tempest continuously in the openstack project?

2012-02-27 Thread Daryl Walleck
I'm actively looking into any issues. I have all these tests passing locally in 
my environment, so the issues seem to be focused around people using devstack. 
I've made some merge prop's that will take care of a few of the issues. One 
issue that will certainly come up is that if you have rate limiting enabled, 
most of the tests will certainly fail. I've also included the link to the 
Tempest documentation, which also should help make using a bit more clear. I'm 
working on updating this document as I'm using Devstack so that I can either 
smooth over or enumerate issues that may come up when running the tests. If you 
run into anything though, please make a report to the Tempest project and I'll 
have a look.

http://qa.openstack.org/integration.html

https://launchpad.net/tempest

Daryl

On Feb 27, 2012, at 7:18 AM, Ionuț Arțăriși wrote:

> On 02/22/2012 07:17 PM, Jay Pipes wrote:
>> On 02/22/2012 10:49 AM, James E. Blair wrote:
>>> Indeed, as soon as someone says "I have Tempest working on a system
>>> configured by devstack with a repeatable process, here's how I did
>>> it..." we'll start running it in Jenkins. But so far I've heard from
>>> the Tempest developers that it's not quite ready yet.
>> 
>> That would be correct. Still work needed to get things working more
>> consistently.
>> 
> 
> How can I help with this effort? Who should I contact?
> 
> Right now I'm having trouble setting up running the tests against devstack (a 
> configuration problem on my part I suppose, but I blame it on the lack of 
> documentation).
> 
> -Ionuț
> 
> ___
> Mailing list: https://launchpad.net/~openstack
> Post to : openstack@lists.launchpad.net
> Unsubscribe : https://launchpad.net/~openstack
> More help   : https://help.launchpad.net/ListHelp

___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] running Tempest continuously in the openstack project?

2012-02-27 Thread David Kranz
There is still a bug in tempest and/or keystone. To run Tempest and 
devstack you have to:


1. Add catalog_name=compute to tempest.conf
2. Change "name" to "type" in rest_client.py


 -David


On 2/27/2012 8:18 AM, Ionuț Arțăriși wrote:

On 02/22/2012 07:17 PM, Jay Pipes wrote:

On 02/22/2012 10:49 AM, James E. Blair wrote:

Indeed, as soon as someone says "I have Tempest working on a system
configured by devstack with a repeatable process, here's how I did
it..." we'll start running it in Jenkins. But so far I've heard from
the Tempest developers that it's not quite ready yet.


That would be correct. Still work needed to get things working more
consistently.



How can I help with this effort? Who should I contact?

Right now I'm having trouble setting up running the tests against 
devstack (a configuration problem on my part I suppose, but I blame it 
on the lack of documentation).


-Ionuț

___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp



___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] running Tempest continuously in the openstack project?

2012-02-27 Thread Ionuț Arțăriși

On 02/22/2012 07:17 PM, Jay Pipes wrote:

On 02/22/2012 10:49 AM, James E. Blair wrote:

Indeed, as soon as someone says "I have Tempest working on a system
configured by devstack with a repeatable process, here's how I did
it..." we'll start running it in Jenkins. But so far I've heard from
the Tempest developers that it's not quite ready yet.


That would be correct. Still work needed to get things working more
consistently.



How can I help with this effort? Who should I contact?

Right now I'm having trouble setting up running the tests against 
devstack (a configuration problem on my part I suppose, but I blame it 
on the lack of documentation).


-Ionuț

___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] running Tempest continuously in the openstack project?

2012-02-27 Thread Ionuț Arțăriși

On 02/22/2012 07:17 PM, Jay Pipes wrote:

On 02/22/2012 10:49 AM, James E. Blair wrote:

Indeed, as soon as someone says "I have Tempest working on a system
configured by devstack with a repeatable process, here's how I did
it..." we'll start running it in Jenkins. But so far I've heard from
the Tempest developers that it's not quite ready yet.


That would be correct. Still work needed to get things working more
consistently.



How can I help with this effort? Who should I contact?

Right now I'm having trouble setting up running the tests against 
devstack (a configuration problem on my part I suppose, but I blame it 
on the lack of documentation).


-Ionuț

___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] running Tempest continuously in the openstack project?

2012-02-22 Thread Jay Pipes

On 02/22/2012 10:49 AM, James E. Blair wrote:

Indeed, as soon as someone says "I have Tempest working on a system
configured by devstack with a repeatable process, here's how I did
it..." we'll start running it in Jenkins.  But so far I've heard from
the Tempest developers that it's not quite ready yet.


That would be correct. Still work needed to get things working more 
consistently.


___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] running Tempest continuously in the openstack project?

2012-02-22 Thread James E. Blair
Indeed, as soon as someone says "I have Tempest working on a system
configured by devstack with a repeatable process, here's how I did
it..." we'll start running it in Jenkins.  But so far I've heard from
the Tempest developers that it's not quite ready yet.

-Jim

David Kranz  writes:

> There is currently a bug
> https://bugs.launchpad.net/tempest/+bug/933845 that will prevent
> tempest from working with  keystone. That ticket provides a workaround
> but still not all of the tests are working at the moment. I think the
> goal is for tempest to become actively run but we are not there yet...
>
>  -David
>
>
> On 2/22/2012 9:12 AM, Ionuț Arțăriși wrote:
>> Hello,
>>
>> I'm trying to get started with Tempest and I would really like to be
>> able to see a running setup somewhere. I'm getting a lot of tests
>> failing and I don't know if it's because of my setup or because of
>> bugs in Tempest or incompatibilities with the current code in the
>> other components.
>>
>> I looked at Jenkins, but it seems there are only two tasks related
>> to Tempest there, testing for git-merge and pep8. Does the OpenStack
>> project actively run the full Tempest test suite anywhere?
>>
>> It would be great if anyone can offer a working configuration or at
>> least say if they have Tempest running successfully against which
>> versions of nova, glance, swift etc.
>>
>> Thanks,
>> Ionuț
>>
>> ___
>> Mailing list: https://launchpad.net/~openstack
>> Post to : openstack@lists.launchpad.net
>> Unsubscribe : https://launchpad.net/~openstack
>> More help   : https://help.launchpad.net/ListHelp
>
>
> ___
> Mailing list: https://launchpad.net/~openstack
> Post to : openstack@lists.launchpad.net
> Unsubscribe : https://launchpad.net/~openstack
> More help   : https://help.launchpad.net/ListHelp

___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] running Tempest continuously in the openstack project?

2012-02-22 Thread Daryl Walleck
We're running Tempest as part of our continuous build. For the bug you're 
referring to David, there is a configuration in Tempest where the name of the 
Nova/Compute project can be set, so I don't think its fair to say that Tempest 
is currently broken. However, I am working on a more comprehensive set of 
documentation and auto-configuration tools to allow people to work with Tempest 
more easily. Expect more very soon coming down the pipeline.

Daryl

From: openstack-bounces+daryl.walleck=rackspace@lists.launchpad.net 
[openstack-bounces+daryl.walleck=rackspace@lists.launchpad.net] on behalf 
of David Kranz [david.kr...@qrclab.com]
Sent: Wednesday, February 22, 2012 8:24 AM
To: openstack@lists.launchpad.net
Subject: Re: [Openstack] running Tempest continuously in the openstack  project?

There is currently a bug https://bugs.launchpad.net/tempest/+bug/933845
that will prevent tempest from working with  keystone. That ticket
provides a workaround but still not all of the tests are working at the
moment. I think the goal is for tempest to become actively run but we
are not there yet...

  -David


On 2/22/2012 9:12 AM, Ionuț Arțăriși wrote:
> Hello,
>
> I'm trying to get started with Tempest and I would really like to be
> able to see a running setup somewhere. I'm getting a lot of tests
> failing and I don't know if it's because of my setup or because of
> bugs in Tempest or incompatibilities with the current code in the
> other components.
>
> I looked at Jenkins, but it seems there are only two tasks related to
> Tempest there, testing for git-merge and pep8. Does the OpenStack
> project actively run the full Tempest test suite anywhere?
>
> It would be great if anyone can offer a working configuration or at
> least say if they have Tempest running successfully against which
> versions of nova, glance, swift etc.
>
> Thanks,
> Ionuț
>
> ___
> Mailing list: https://launchpad.net/~openstack
> Post to : openstack@lists.launchpad.net
> Unsubscribe : https://launchpad.net/~openstack
> More help   : https://help.launchpad.net/ListHelp


___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp
___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] running Tempest continuously in the openstack project?

2012-02-22 Thread David Kranz
There is currently a bug https://bugs.launchpad.net/tempest/+bug/933845 
that will prevent tempest from working with  keystone. That ticket 
provides a workaround but still not all of the tests are working at the 
moment. I think the goal is for tempest to become actively run but we 
are not there yet...


 -David


On 2/22/2012 9:12 AM, Ionuț Arțăriși wrote:

Hello,

I'm trying to get started with Tempest and I would really like to be 
able to see a running setup somewhere. I'm getting a lot of tests 
failing and I don't know if it's because of my setup or because of 
bugs in Tempest or incompatibilities with the current code in the 
other components.


I looked at Jenkins, but it seems there are only two tasks related to 
Tempest there, testing for git-merge and pep8. Does the OpenStack 
project actively run the full Tempest test suite anywhere?


It would be great if anyone can offer a working configuration or at 
least say if they have Tempest running successfully against which 
versions of nova, glance, swift etc.


Thanks,
Ionuț

___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp



___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp