Re: [openstack-dev] [Nova client] gate-python-novaclient-pypy

2014-03-17 Thread Jeremy Stanley 
On 2014-03-10 21:56:57 + (+), Jeremy Stanley wrote:
[...]
 I've determined that (for reasons as of yet unknown) this is only
 happening in one of our two providers, so I'm temporarily removing
 the problem nodes while I continue to debug this. Hopefully that
 un-breaks gating for clients in the near term.
 
 I've opened https://launchpad.net/bugs/1290562 for now which these
 failures can be rechecked against while I work out the underlying
 problem.
[...]

And starting with the release of setuptools 3.3 yesterday, this is
now happening in both of our providers. A project-by-project
workaround is linked in a recent update to the bug, for those who
need temporary relief while work continues to identify the
underlying cause.
-- 
Jeremy Stanley

___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

[openstack-dev] [Nova client] gate-python-novaclient-pypy

2014-03-10 Thread Gary Kotton 
Hi,
The client gate seems to be broken with the following error:


2014-03-10 
08:19:39.566http://logs.openstack.org/74/67074/8/check/gate-python-novaclient-pypy/44c12e7/console.html#_2014-03-10_08_19_39_566
 |   Running setup.py install for python-mimeparse
2014-03-10 
08:19:39.567http://logs.openstack.org/74/67074/8/check/gate-python-novaclient-pypy/44c12e7/console.html#_2014-03-10_08_19_39_567
 |
2014-03-10 
08:19:39.567http://logs.openstack.org/74/67074/8/check/gate-python-novaclient-pypy/44c12e7/console.html#_2014-03-10_08_19_39_567
 |   Found existing installation: setuptools 2.2
2014-03-10 
08:19:39.567http://logs.openstack.org/74/67074/8/check/gate-python-novaclient-pypy/44c12e7/console.html#_2014-03-10_08_19_39_567
 | Uninstalling setuptools:
2014-03-10 
08:19:39.567http://logs.openstack.org/74/67074/8/check/gate-python-novaclient-pypy/44c12e7/console.html#_2014-03-10_08_19_39_567
 |   Successfully uninstalled setuptools
2014-03-10 
08:19:39.567http://logs.openstack.org/74/67074/8/check/gate-python-novaclient-pypy/44c12e7/console.html#_2014-03-10_08_19_39_567
 |   Running setup.py install for mccabe
2014-03-10 
08:19:39.567http://logs.openstack.org/74/67074/8/check/gate-python-novaclient-pypy/44c12e7/console.html#_2014-03-10_08_19_39_567
 | /usr/lib/pypy/lib-python/2.7/distutils/dist.py:267: UserWarning: Unknown 
distribution option: 'entry_points'
2014-03-10 
08:19:39.567http://logs.openstack.org/74/67074/8/check/gate-python-novaclient-pypy/44c12e7/console.html#_2014-03-10_08_19_39_567
 |   warnings.warn(msg)
2014-03-10 
08:19:39.567http://logs.openstack.org/74/67074/8/check/gate-python-novaclient-pypy/44c12e7/console.html#_2014-03-10_08_19_39_567
 | /usr/lib/pypy/lib-python/2.7/distutils/dist.py:267: UserWarning: Unknown 
distribution option: 'zip_safe'
2014-03-10 
08:19:39.567http://logs.openstack.org/74/67074/8/check/gate-python-novaclient-pypy/44c12e7/console.html#_2014-03-10_08_19_39_567
 |   warnings.warn(msg)
2014-03-10 
08:19:39.567http://logs.openstack.org/74/67074/8/check/gate-python-novaclient-pypy/44c12e7/console.html#_2014-03-10_08_19_39_567
 | usage: -c [global_opts] cmd1 [cmd1_opts] [cmd2 [cmd2_opts] ...]
2014-03-10 
08:19:39.567http://logs.openstack.org/74/67074/8/check/gate-python-novaclient-pypy/44c12e7/console.html#_2014-03-10_08_19_39_567
 |or: -c --help [cmd1 cmd2 ...]
2014-03-10 
08:19:39.567http://logs.openstack.org/74/67074/8/check/gate-python-novaclient-pypy/44c12e7/console.html#_2014-03-10_08_19_39_567
 |or: -c --help-commands
2014-03-10 
08:19:39.568http://logs.openstack.org/74/67074/8/check/gate-python-novaclient-pypy/44c12e7/console.html#_2014-03-10_08_19_39_568
 |or: -c cmd --help
2014-03-10 
08:19:39.568http://logs.openstack.org/74/67074/8/check/gate-python-novaclient-pypy/44c12e7/console.html#_2014-03-10_08_19_39_568
 |
2014-03-10 
08:19:39.568http://logs.openstack.org/74/67074/8/check/gate-python-novaclient-pypy/44c12e7/console.html#_2014-03-10_08_19_39_568
 | error: option --single-version-externally-managed not recognized
2014-03-10 
08:19:39.568http://logs.openstack.org/74/67074/8/check/gate-python-novaclient-pypy/44c12e7/console.html#_2014-03-10_08_19_39_568
 | Complete output from command 
/home/jenkins/workspace/gate-python-novaclient-pypy/.tox/pypy/bin/pypy -c 
import setuptools, 
tokenize;__file__='/home/jenkins/workspace/gate-python-novaclient-pypy/.tox/pypy/build/mccabe/setup.py';exec(compile(getattr(tokenize,
 'open', open)(__file__).read().replace('\r\n', '\n'), __file__, 'exec')) 
install --record /tmp/tmp.l53ekBaPmF/pip-5i1oDp-record/install-record.txt 
--single-version-externally-managed --compile --install-headers 
/home/jenkins/workspace/gate-python-novaclient-pypy/.tox/pypy/include/site/python2.7:
2014-03-10 
08:19:39.568http://logs.openstack.org/74/67074/8/check/gate-python-novaclient-pypy/44c12e7/console.html#_2014-03-10_08_19_39_568
 | /usr/lib/pypy/lib-python/2.7/distutils/dist.py:267: UserWarning: Unknown 
distribution option: 'entry_points'
2014-03-10 
08:19:39.568http://logs.openstack.org/74/67074/8/check/gate-python-novaclient-pypy/44c12e7/console.html#_2014-03-10_08_19_39_568
 |
2014-03-10 
08:19:39.568http://logs.openstack.org/74/67074/8/check/gate-python-novaclient-pypy/44c12e7/console.html#_2014-03-10_08_19_39_568
 |   warnings.warn(msg)
2014-03-10 
08:19:39.568http://logs.openstack.org/74/67074/8/check/gate-python-novaclient-pypy/44c12e7/console.html#_2014-03-10_08_19_39_568
 |
2014-03-10 
08:19:39.568http://logs.openstack.org/74/67074/8/check/gate-python-novaclient-pypy/44c12e7/console.html#_2014-03-10_08_19_39_568
 | /usr/lib/pypy/lib-python/2.7/distutils/dist.py:267: UserWarning: Unknown 
distribution option: 'zip_safe'
2014-03-10 
08:19:39.568http://logs.openstack.org/74/67074/8/check/gate-python-novaclient-pypy/44c12e7/console.html#_2014-03-10_08_19_39_568
 |
2014-03-10

Re: [openstack-dev] [Nova client] gate-python-novaclient-pypy

2014-03-10 Thread Chmouel Boudjnah 
FYI: this is all over for all clients that gates with pypy :

http://logs.openstack.org/28/74328/2/check/gate-python-swiftclient-pypy/c0058f2/console.html


On Mon, Mar 10, 2014 at 10:37 AM, Gary Kotton gkot...@vmware.com wrote:

 Hi,
 The client gate seems to be broken with the following error:

 2014-03-10 08:19:39.566 
 http://logs.openstack.org/74/67074/8/check/gate-python-novaclient-pypy/44c12e7/console.html#_2014-03-10_08_19_39_566
  |   Running setup.py install for python-mimeparse2014-03-10 08:19:39.567 
 http://logs.openstack.org/74/67074/8/check/gate-python-novaclient-pypy/44c12e7/console.html#_2014-03-10_08_19_39_567
  | 2014-03-10 08:19:39.567 
 http://logs.openstack.org/74/67074/8/check/gate-python-novaclient-pypy/44c12e7/console.html#_2014-03-10_08_19_39_567
  |   Found existing installation: setuptools 2.22014-03-10 08:19:39.567 
 http://logs.openstack.org/74/67074/8/check/gate-python-novaclient-pypy/44c12e7/console.html#_2014-03-10_08_19_39_567
  | Uninstalling setuptools:2014-03-10 08:19:39.567 
 http://logs.openstack.org/74/67074/8/check/gate-python-novaclient-pypy/44c12e7/console.html#_2014-03-10_08_19_39_567
  |   Successfully uninstalled setuptools2014-03-10 08:19:39.567 
 http://logs.openstack.org/74/67074/8/check/gate-python-novaclient-pypy/44c12e7/console.html#_2014-03-10_08_19_39_567
  |   Running setup.py install for mccabe2014-03-10 08:19:39.567 
 http://logs.openstack.org/74/67074/8/check/gate-python-novaclient-pypy/44c12e7/console.html#_2014-03-10_08_19_39_567
  | /usr/lib/pypy/lib-python/2.7/distutils/dist.py:267: UserWarning: 
 Unknown distribution option: 'entry_points'2014-03-10 08:19:39.567 
 http://logs.openstack.org/74/67074/8/check/gate-python-novaclient-pypy/44c12e7/console.html#_2014-03-10_08_19_39_567
  |   warnings.warn(msg)2014-03-10 08:19:39.567 
 http://logs.openstack.org/74/67074/8/check/gate-python-novaclient-pypy/44c12e7/console.html#_2014-03-10_08_19_39_567
  | /usr/lib/pypy/lib-python/2.7/distutils/dist.py:267: UserWarning: 
 Unknown distribution option: 'zip_safe'2014-03-10 08:19:39.567 
 http://logs.openstack.org/74/67074/8/check/gate-python-novaclient-pypy/44c12e7/console.html#_2014-03-10_08_19_39_567
  |   warnings.warn(msg)2014-03-10 08:19:39.567 
 http://logs.openstack.org/74/67074/8/check/gate-python-novaclient-pypy/44c12e7/console.html#_2014-03-10_08_19_39_567
  | usage: -c [global_opts] cmd1 [cmd1_opts] [cmd2 [cmd2_opts] 
 ...]2014-03-10 08:19:39.567 
 http://logs.openstack.org/74/67074/8/check/gate-python-novaclient-pypy/44c12e7/console.html#_2014-03-10_08_19_39_567
  |or: -c --help [cmd1 cmd2 ...]2014-03-10 08:19:39.567 
 http://logs.openstack.org/74/67074/8/check/gate-python-novaclient-pypy/44c12e7/console.html#_2014-03-10_08_19_39_567
  |or: -c --help-commands2014-03-10 08:19:39.568 
 http://logs.openstack.org/74/67074/8/check/gate-python-novaclient-pypy/44c12e7/console.html#_2014-03-10_08_19_39_568
  |or: -c cmd --help2014-03-10 08:19:39.568 
 http://logs.openstack.org/74/67074/8/check/gate-python-novaclient-pypy/44c12e7/console.html#_2014-03-10_08_19_39_568
  | 2014-03-10 08:19:39.568 
 http://logs.openstack.org/74/67074/8/check/gate-python-novaclient-pypy/44c12e7/console.html#_2014-03-10_08_19_39_568
  | error: option --single-version-externally-managed not 
 recognized2014-03-10 08:19:39.568 
 http://logs.openstack.org/74/67074/8/check/gate-python-novaclient-pypy/44c12e7/console.html#_2014-03-10_08_19_39_568
  | Complete output from command 
 /home/jenkins/workspace/gate-python-novaclient-pypy/.tox/pypy/bin/pypy -c 
 import setuptools, 
 tokenize;__file__='/home/jenkins/workspace/gate-python-novaclient-pypy/.tox/pypy/build/mccabe/setup.py';exec(compile(getattr(tokenize,
  'open', open)(__file__).read().replace('\r\n', '\n'), __file__, 'exec')) 
 install --record /tmp/tmp.l53ekBaPmF/pip-5i1oDp-record/install-record.txt 
 --single-version-externally-managed --compile --install-headers 
 /home/jenkins/workspace/gate-python-novaclient-pypy/.tox/pypy/include/site/python2.7:2014-03-10
  08:19:39.568 
 http://logs.openstack.org/74/67074/8/check/gate-python-novaclient-pypy/44c12e7/console.html#_2014-03-10_08_19_39_568
  | /usr/lib/pypy/lib-python/2.7/distutils/dist.py:267: UserWarning: 
 Unknown distribution option: 'entry_points'2014-03-10 08:19:39.568 
 http://logs.openstack.org/74/67074/8/check/gate-python-novaclient-pypy/44c12e7/console.html#_2014-03-10_08_19_39_568
  | 2014-03-10 08:19:39.568 
 http://logs.openstack.org/74/67074/8/check/gate-python-novaclient-pypy/44c12e7/console.html#_2014-03-10_08_19_39_568
  |   warnings.warn(msg)2014-03-10 08:19:39.568 
 http://logs.openstack.org/74/67074/8/check/gate-python-novaclient-pypy/44c12e7/console.html#_2014-03-10_08_19_39_568
  | 2014-03-10 08:19:39.568 
 http://logs.openstack.org/74/67074/8/check/gate-python-novaclient-pypy/44c12e7/console.html#_2014-03-10_08_19_39_568
  | /usr/lib/pypy/lib-python/2.7/distutils/dist.py:267:

Re: [openstack-dev] [Nova client] gate-python-novaclient-pypy

2014-03-10 Thread David Ripton 

On 03/10/2014 05:37 AM, Gary Kotton wrote:

Hi,
The client gate seems to be broken with the following error:

2014-03-10 08:19:39.566  
http://logs.openstack.org/74/67074/8/check/gate-python-novaclient-pypy/44c12e7/console.html#_2014-03-10_08_19_39_566
  |   Running setup.py install for python-mimeparse
2014-03-10 08:19:39.567  
http://logs.openstack.org/74/67074/8/check/gate-python-novaclient-pypy/44c12e7/console.html#_2014-03-10_08_19_39_567
  |
2014-03-10 08:19:39.567  
http://logs.openstack.org/74/67074/8/check/gate-python-novaclient-pypy/44c12e7/console.html#_2014-03-10_08_19_39_567
  |   Found existing installation: setuptools 2.2
2014-03-10 08:19:39.567  
http://logs.openstack.org/74/67074/8/check/gate-python-novaclient-pypy/44c12e7/console.html#_2014-03-10_08_19_39_567
  | Uninstalling setuptools:
2014-03-10 08:19:39.567  
http://logs.openstack.org/74/67074/8/check/gate-python-novaclient-pypy/44c12e7/console.html#_2014-03-10_08_19_39_567
  |   Successfully uninstalled setuptools
2014-03-10 08:19:39.567  
http://logs.openstack.org/74/67074/8/check/gate-python-novaclient-pypy/44c12e7/console.html#_2014-03-10_08_19_39_567
  |   Running setup.py install for mccabe
2014-03-10 08:19:39.567  
http://logs.openstack.org/74/67074/8/check/gate-python-novaclient-pypy/44c12e7/console.html#_2014-03-10_08_19_39_567
  | /usr/lib/pypy/lib-python/2.7/distutils/dist.py:267: UserWarning: Unknown 
distribution option: 'entry_points'
2014-03-10 08:19:39.567  
http://logs.openstack.org/74/67074/8/check/gate-python-novaclient-pypy/44c12e7/console.html#_2014-03-10_08_19_39_567
  |   warnings.warn(msg)
2014-03-10 08:19:39.567  
http://logs.openstack.org/74/67074/8/check/gate-python-novaclient-pypy/44c12e7/console.html#_2014-03-10_08_19_39_567
  | /usr/lib/pypy/lib-python/2.7/distutils/dist.py:267: UserWarning: Unknown 
distribution option: 'zip_safe'
2014-03-10 08:19:39.567  
http://logs.openstack.org/74/67074/8/check/gate-python-novaclient-pypy/44c12e7/console.html#_2014-03-10_08_19_39_567
  |   warnings.warn(msg)
2014-03-10 08:19:39.567  
http://logs.openstack.org/74/67074/8/check/gate-python-novaclient-pypy/44c12e7/console.html#_2014-03-10_08_19_39_567
  | usage: -c [global_opts] cmd1 [cmd1_opts] [cmd2 [cmd2_opts] ...]
2014-03-10 08:19:39.567  
http://logs.openstack.org/74/67074/8/check/gate-python-novaclient-pypy/44c12e7/console.html#_2014-03-10_08_19_39_567
  |or: -c --help [cmd1 cmd2 ...]
2014-03-10 08:19:39.567  
http://logs.openstack.org/74/67074/8/check/gate-python-novaclient-pypy/44c12e7/console.html#_2014-03-10_08_19_39_567
  |or: -c --help-commands
2014-03-10 08:19:39.568  
http://logs.openstack.org/74/67074/8/check/gate-python-novaclient-pypy/44c12e7/console.html#_2014-03-10_08_19_39_568
  |or: -c cmd --help
2014-03-10 08:19:39.568  
http://logs.openstack.org/74/67074/8/check/gate-python-novaclient-pypy/44c12e7/console.html#_2014-03-10_08_19_39_568
  |
2014-03-10 08:19:39.568  
http://logs.openstack.org/74/67074/8/check/gate-python-novaclient-pypy/44c12e7/console.html#_2014-03-10_08_19_39_568
  | error: option --single-version-externally-managed not recognized
2014-03-10 08:19:39.568  
http://logs.openstack.org/74/67074/8/check/gate-python-novaclient-pypy/44c12e7/console.html#_2014-03-10_08_19_39_568
  | Complete output from command 
/home/jenkins/workspace/gate-python-novaclient-pypy/.tox/pypy/bin/pypy -c import 
setuptools, 
tokenize;__file__='/home/jenkins/workspace/gate-python-novaclient-pypy/.tox/pypy/build/mccabe/setup.py';exec(compile(getattr(tokenize,
 'open', open)(__file__).read().replace('\r\n', '\n'), __file__, 'exec')) install 
--record /tmp/tmp.l53ekBaPmF/pip-5i1oDp-record/install-record.txt 
--single-version-externally-managed --compile --install-headers 
/home/jenkins/workspace/gate-python-novaclient-pypy/.tox/pypy/include/site/python2.7:
2014-03-10 08:19:39.568  
http://logs.openstack.org/74/67074/8/check/gate-python-novaclient-pypy/44c12e7/console.html#_2014-03-10_08_19_39_568
  | /usr/lib/pypy/lib-python/2.7/distutils/dist.py:267: UserWarning: Unknown 
distribution option: 'entry_points'
2014-03-10 08:19:39.568  
http://logs.openstack.org/74/67074/8/check/gate-python-novaclient-pypy/44c12e7/console.html#_2014-03-10_08_19_39_568
  |
2014-03-10 08:19:39.568  
http://logs.openstack.org/74/67074/8/check/gate-python-novaclient-pypy/44c12e7/console.html#_2014-03-10_08_19_39_568
  |   warnings.warn(msg)
2014-03-10 08:19:39.568  
http://logs.openstack.org/74/67074/8/check/gate-python-novaclient-pypy/44c12e7/console.html#_2014-03-10_08_19_39_568
  |
2014-03-10 08:19:39.568  
http://logs.openstack.org/74/67074/8/check/gate-python-novaclient-pypy/44c12e7/console.html#_2014-03-10_08_19_39_568
  | /usr/lib/pypy/lib-python/2.7/distutils/dist.py:267: UserWarning: Unknown 
distribution option: 'zip_safe'
2014-03-10 08:19:39.568

Re: [openstack-dev] [Nova client] gate-python-novaclient-pypy

2014-03-10 Thread Jeremy Stanley 
On 2014-03-10 02:37:02 -0700 (-0700), Gary Kotton wrote:
 The client gate seems to be broken with the following error:
[...]
 2014-03-10 08:19:39.568 | error: option 
 --single-version-externally-managed not recognized
 
 Any ideas?

I originally saw this setuptools bootstrapping issue when I first
tried to move PyPy-based unit tests from our older static workers to
single-use systems managed by nodepool. It was happening under
setuptools 2.1 but then I was unable to reproduce it once setuptools
2.2 came out so went ahead with moving the jobs. This issue seems to
be recurring and started (from what I can see in test logs)
coincident with the release of setuptools 3.1 on Saturday. Monty
originally proposed an improvement to the way we bootstrap
setuptools on our job workers which ought to help with this, so I'll
see whether it's in shape and still resolves the issue. If so, I'll
make sure we prioritize merging it ASAP to get client gating
unwedged and follow up to this thread with relevant updates.
-- 
Jeremy Stanley

___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

Re: [openstack-dev] [Nova client] gate-python-novaclient-pypy

2014-03-10 Thread Jeremy Stanley 
On 2014-03-10 18:33:14 + (+), Jeremy Stanley wrote:
[...]
 Monty originally proposed an improvement to the way we bootstrap
 setuptools on our job workers which ought to help with this, so
 I'll see whether it's in shape and still resolves the issue. If
 so, I'll make sure we prioritize merging it ASAP to get client
 gating unwedged and follow up to this thread with relevant
 updates.

That patch turned out not to help with this issue anyway. I've
determined that (for reasons as of yet unknown) this is only
happening in one of our two providers, so I'm temporarily removing
the problem nodes while I continue to debug this. Hopefully that
un-breaks gating for clients in the near term.

I've opened https://launchpad.net/bugs/1290562 for now which these
failures can be rechecked against while I work out the underlying
problem.
-- 
Jeremy Stanley

___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev