Re: [openstack-dev] [nova] novaclient functional test failures

[melanie witt]

On Oct 14, 2015, at 13:50, Matt Riedemann  wrote:

> Well we at least have a bug to track against now:
> 
> https://bugs.launchpad.net/python-novaclient/+bug/1506103

Thanks.

I just proposed a possible fix [1] which is hacking the clouds.yaml for only 
the functional test job in the post test hook.

The issue is devstack is now creating clouds.yaml configured for 
openstackclient using keystone v3. Novaclient relies on having "v2.0" in the 
auth_url and for the functional test jobs, it comes from clouds.yaml.

It doesn't seem right to change clouds.yaml on the devstack side, otherwise 
openstackclient won't work right during stack.sh.

The other option I thought of is if we put a workaround in 
novaclient/tests/functional/base.py to append/replace "v2.0" in the auth_url 
from clouds.yaml. I didn't want to do that because it would force all 
clouds.yaml (even running locally) to be modified while running functional 
tests instead of modifying it only for the build job.

Let me know if there's a better way to solve this.

-melanie (irc: melwitt)

[1] https://review.openstack.org/#/c/236160/





signature.asc
Description: Message signed with OpenPGP using GPGMail
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

Re: [openstack-dev] [nova] novaclient functional test failures

[Matt Riedemann]

On 10/12/2015 5:12 PM, melanie witt wrote:

On Oct 12, 2015, at 12:14, Kevin L. Mitchell  
wrote:


http://logs.openstack.org/77/232677/1/check/gate-novaclient-dsvm-functional/2de31bc/
(For review https://review.openstack.org/232677)

http://logs.openstack.org/99/232899/1/check/gate-novaclient-dsvm-functional/6d6dd1d/
(For review https://review.openstack.org/232899)

The first review does some stuff with functional tests, but the second
is a simple global-requirements update, and both have the same failure
signature.


I noticed in the trace, novaclient is calling a function for keystone v1 auth 
[1][2]. It had been calling v2 auth in the past and I think this commit [3] in 
devstack that writes the clouds.yaml specifying v3 as the identity API version 
is probably responsible for the change in behavior. It used to use the 
$IDENTITY_API_VERSION variable. The patch merged on Oct 7 and in logstash I 
find the failures start on Oct 8 [4]

Novaclient looks for "v2.0" in the auth url and creates a request based on that. If it 
doesn't find "v2.0" it falls back generating a v1 request. And it doesn't yet have a 
function for generating a v3 request.

-melanie (irc: melwitt)

[1] 
http://logs.openstack.org/99/232899/1/check/gate-novaclient-dsvm-functional/6d6dd1d/console.html.gz#_2015-10-09_16_01_24_088
[2] 
https://github.com/openstack/python-novaclient/blob/147a1a6ee421f9a45a562f013e233d29d43258e4/novaclient/client.py#L601-L622
[3] https://review.openstack.org/#/c/220846/
[4] http://goo.gl/5GxiiF



__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev



Well we at least have a bug to track against now:

https://bugs.launchpad.net/python-novaclient/+bug/1506103

--

Thanks,

Matt Riedemann


__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

[openstack-dev] [nova] novaclient functional test failures

[Kevin L. Mitchell]

Functional tests on novaclient (gate-novaclient-dsvm-functional) have
started failing consistently.  The test failures all seem to be for an
HTTP 300, which leads me to suspect a problem with the test environment,
rather than with the tests in novaclient.  Anyone have any insights as
to how to address the problem?
-- 
Kevin L. Mitchell 
Rackspace


__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

Re: [openstack-dev] [nova] novaclient functional test failures

[Sean Dague]

On 10/12/2015 11:54 AM, Kevin L. Mitchell wrote:
> Functional tests on novaclient (gate-novaclient-dsvm-functional) have
> started failing consistently.  The test failures all seem to be for an
> HTTP 300, which leads me to suspect a problem with the test environment,
> rather than with the tests in novaclient.  Anyone have any insights as
> to how to address the problem?

Do you have a link to failed jobs? Or a bug to start accumulating that in?

-Sean

-- 
Sean Dague
http://dague.net

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

Re: [openstack-dev] [nova] novaclient functional test failures

[Kevin L. Mitchell]

On Mon, 2015-10-12 at 12:16 -0400, Sean Dague wrote:
> On 10/12/2015 11:54 AM, Kevin L. Mitchell wrote:
> > Functional tests on novaclient (gate-novaclient-dsvm-functional) have
> > started failing consistently.  The test failures all seem to be for an
> > HTTP 300, which leads me to suspect a problem with the test environment,
> > rather than with the tests in novaclient.  Anyone have any insights as
> > to how to address the problem?
> 
> Do you have a link to failed jobs? Or a bug to start accumulating that in?

And I thought about including such a link right after I hit "Send".
Figures :)

http://logs.openstack.org/77/232677/1/check/gate-novaclient-dsvm-functional/2de31bc/
(For review https://review.openstack.org/232677)

http://logs.openstack.org/99/232899/1/check/gate-novaclient-dsvm-functional/6d6dd1d/
(For review https://review.openstack.org/232899)

The first review does some stuff with functional tests, but the second
is a simple global-requirements update, and both have the same failure
signature.
-- 
Kevin L. Mitchell 
Rackspace


__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

Re: [openstack-dev] [nova] novaclient functional test failures

[melanie witt]

On Oct 12, 2015, at 12:14, Kevin L. Mitchell  
wrote:

> http://logs.openstack.org/77/232677/1/check/gate-novaclient-dsvm-functional/2de31bc/
> (For review https://review.openstack.org/232677)
> 
> http://logs.openstack.org/99/232899/1/check/gate-novaclient-dsvm-functional/6d6dd1d/
> (For review https://review.openstack.org/232899)
> 
> The first review does some stuff with functional tests, but the second
> is a simple global-requirements update, and both have the same failure
> signature.

I noticed in the trace, novaclient is calling a function for keystone v1 auth 
[1][2]. It had been calling v2 auth in the past and I think this commit [3] in 
devstack that writes the clouds.yaml specifying v3 as the identity API version 
is probably responsible for the change in behavior. It used to use the 
$IDENTITY_API_VERSION variable. The patch merged on Oct 7 and in logstash I 
find the failures start on Oct 8 [4]

Novaclient looks for "v2.0" in the auth url and creates a request based on 
that. If it doesn't find "v2.0" it falls back generating a v1 request. And it 
doesn't yet have a function for generating a v3 request.

-melanie (irc: melwitt)

[1] 
http://logs.openstack.org/99/232899/1/check/gate-novaclient-dsvm-functional/6d6dd1d/console.html.gz#_2015-10-09_16_01_24_088
[2] 
https://github.com/openstack/python-novaclient/blob/147a1a6ee421f9a45a562f013e233d29d43258e4/novaclient/client.py#L601-L622
[3] https://review.openstack.org/#/c/220846/
[4] http://goo.gl/5GxiiF



signature.asc
Description: Message signed with OpenPGP using GPGMail
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev