Re: [openstack-dev] [nova] novaclient functional test failures
On Oct 14, 2015, at 13:50, Matt Riedemann wrote: > Well we at least have a bug to track against now: > > https://bugs.launchpad.net/python-novaclient/+bug/1506103 Thanks. I just proposed a possible fix [1] which is hacking the clouds.yaml for only the functional test job in the post test hook. The issue is devstack is now creating clouds.yaml configured for openstackclient using keystone v3. Novaclient relies on having "v2.0" in the auth_url and for the functional test jobs, it comes from clouds.yaml. It doesn't seem right to change clouds.yaml on the devstack side, otherwise openstackclient won't work right during stack.sh. The other option I thought of is if we put a workaround in novaclient/tests/functional/base.py to append/replace "v2.0" in the auth_url from clouds.yaml. I didn't want to do that because it would force all clouds.yaml (even running locally) to be modified while running functional tests instead of modifying it only for the build job. Let me know if there's a better way to solve this. -melanie (irc: melwitt) [1] https://review.openstack.org/#/c/236160/ signature.asc Description: Message signed with OpenPGP using GPGMail __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [nova] novaclient functional test failures
On 10/12/2015 5:12 PM, melanie witt wrote: On Oct 12, 2015, at 12:14, Kevin L. Mitchell wrote: http://logs.openstack.org/77/232677/1/check/gate-novaclient-dsvm-functional/2de31bc/ (For review https://review.openstack.org/232677) http://logs.openstack.org/99/232899/1/check/gate-novaclient-dsvm-functional/6d6dd1d/ (For review https://review.openstack.org/232899) The first review does some stuff with functional tests, but the second is a simple global-requirements update, and both have the same failure signature. I noticed in the trace, novaclient is calling a function for keystone v1 auth [1][2]. It had been calling v2 auth in the past and I think this commit [3] in devstack that writes the clouds.yaml specifying v3 as the identity API version is probably responsible for the change in behavior. It used to use the $IDENTITY_API_VERSION variable. The patch merged on Oct 7 and in logstash I find the failures start on Oct 8 [4] Novaclient looks for "v2.0" in the auth url and creates a request based on that. If it doesn't find "v2.0" it falls back generating a v1 request. And it doesn't yet have a function for generating a v3 request. -melanie (irc: melwitt) [1] http://logs.openstack.org/99/232899/1/check/gate-novaclient-dsvm-functional/6d6dd1d/console.html.gz#_2015-10-09_16_01_24_088 [2] https://github.com/openstack/python-novaclient/blob/147a1a6ee421f9a45a562f013e233d29d43258e4/novaclient/client.py#L601-L622 [3] https://review.openstack.org/#/c/220846/ [4] http://goo.gl/5GxiiF __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev Well we at least have a bug to track against now: https://bugs.launchpad.net/python-novaclient/+bug/1506103 -- Thanks, Matt Riedemann __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [nova] novaclient functional test failures
On Oct 12, 2015, at 12:14, Kevin L. Mitchell wrote: > http://logs.openstack.org/77/232677/1/check/gate-novaclient-dsvm-functional/2de31bc/ > (For review https://review.openstack.org/232677) > > http://logs.openstack.org/99/232899/1/check/gate-novaclient-dsvm-functional/6d6dd1d/ > (For review https://review.openstack.org/232899) > > The first review does some stuff with functional tests, but the second > is a simple global-requirements update, and both have the same failure > signature. I noticed in the trace, novaclient is calling a function for keystone v1 auth [1][2]. It had been calling v2 auth in the past and I think this commit [3] in devstack that writes the clouds.yaml specifying v3 as the identity API version is probably responsible for the change in behavior. It used to use the $IDENTITY_API_VERSION variable. The patch merged on Oct 7 and in logstash I find the failures start on Oct 8 [4] Novaclient looks for "v2.0" in the auth url and creates a request based on that. If it doesn't find "v2.0" it falls back generating a v1 request. And it doesn't yet have a function for generating a v3 request. -melanie (irc: melwitt) [1] http://logs.openstack.org/99/232899/1/check/gate-novaclient-dsvm-functional/6d6dd1d/console.html.gz#_2015-10-09_16_01_24_088 [2] https://github.com/openstack/python-novaclient/blob/147a1a6ee421f9a45a562f013e233d29d43258e4/novaclient/client.py#L601-L622 [3] https://review.openstack.org/#/c/220846/ [4] http://goo.gl/5GxiiF signature.asc Description: Message signed with OpenPGP using GPGMail __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [nova] novaclient functional test failures
On Mon, 2015-10-12 at 12:16 -0400, Sean Dague wrote: > On 10/12/2015 11:54 AM, Kevin L. Mitchell wrote: > > Functional tests on novaclient (gate-novaclient-dsvm-functional) have > > started failing consistently. The test failures all seem to be for an > > HTTP 300, which leads me to suspect a problem with the test environment, > > rather than with the tests in novaclient. Anyone have any insights as > > to how to address the problem? > > Do you have a link to failed jobs? Or a bug to start accumulating that in? And I thought about including such a link right after I hit "Send". Figures :) http://logs.openstack.org/77/232677/1/check/gate-novaclient-dsvm-functional/2de31bc/ (For review https://review.openstack.org/232677) http://logs.openstack.org/99/232899/1/check/gate-novaclient-dsvm-functional/6d6dd1d/ (For review https://review.openstack.org/232899) The first review does some stuff with functional tests, but the second is a simple global-requirements update, and both have the same failure signature. -- Kevin L. Mitchell Rackspace __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [nova] novaclient functional test failures
On 10/12/2015 11:54 AM, Kevin L. Mitchell wrote: > Functional tests on novaclient (gate-novaclient-dsvm-functional) have > started failing consistently. The test failures all seem to be for an > HTTP 300, which leads me to suspect a problem with the test environment, > rather than with the tests in novaclient. Anyone have any insights as > to how to address the problem? Do you have a link to failed jobs? Or a bug to start accumulating that in? -Sean -- Sean Dague http://dague.net __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
[openstack-dev] [nova] novaclient functional test failures
Functional tests on novaclient (gate-novaclient-dsvm-functional) have started failing consistently. The test failures all seem to be for an HTTP 300, which leads me to suspect a problem with the test environment, rather than with the tests in novaclient. Anyone have any insights as to how to address the problem? -- Kevin L. Mitchell Rackspace __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev