Re: [openstack-dev] pip 6.0.6 breaking py2* jobs - bug 1407736

2015-01-07 Thread Matt Riedemann



On 1/6/2015 11:07 AM, Matt Riedemann wrote:



On 1/6/2015 7:27 AM, Ihar Hrachyshka wrote:


On 01/06/2015 03:09 AM, Matt Riedemann wrote:



On 1/5/2015 2:16 PM, Doug Hellmann wrote:


On Jan 5, 2015, at 12:22 PM, Doug Hellmann d...@doughellmann.com
wrote:



On Jan 5, 2015, at 12:00 PM, Matt Riedemann
mrie...@linux.vnet.ibm.com wrote:


There is a deprecation warning in pip 6.0.6 which is making the
py26 (on stable branches) and py27 jobs hit subunit log sizes of
over 50 MB which makes the job fail.

A logstash query shows this started happening around 1/3 which is
when pip 6.0.6 was released. In Nova alone there are nearly 18
million hits of the deprecation warning.

Should we temporarily block so that pip  6.0.6?

https://bugs.launchpad.net/nova/+bug/1407736


I think this is actually a change in pkg_resources (in the
setuptools dist) [1], being triggered by stevedore using
require=False to avoid checking dependencies when plugins are loaded.

Doug

[1]
https://bitbucket.org/pypa/setuptools/commits/b1c7a311fb8e167d026126f557f849450b859502




After some discussion with Jason Coombs and dstufft, a version of
setuptools with a split API to replace the deprecated option was
released. I have a patch up to teach stevedore about the new
methods[1].

Doug

[1] https://review.openstack.org/#/c/145042/1






--

Thanks,

Matt Riedemann


___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev



___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev



___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev



The stevedore patch was merged. Do we need a release of stevedore and
a global-requirements update to then get the deprecation warnings
fixed in nova (on master and stable/juno)?



I guess so. Also, Icehouse is affected too. I've checked Nova
requirements.txt for Icehouse, and we don't cap steverore version, so a
new release will be automatically propagated to all new jobs.

/Ihar

___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev



I've closed the nova bug as a duplicate of the stevedore bug since the
latest release of stevedore fixed the problem for my nova change on
stable/juno, thanks Doug!



I just noticed that this is still an issue with the paste library, 
unfortunately.  You can see the hits in a nova stable/juno run here [1].


There are 20736 instances of the deprecation warning in that run.

[1] 
http://logs.openstack.org/74/145374/1/check/gate-nova-python27/6201323/console.html#_2015-01-06_23_34_35_477


--

Thanks,

Matt Riedemann


___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] pip 6.0.6 breaking py2* jobs - bug 1407736

2015-01-06 Thread Ihar Hrachyshka


On 01/06/2015 03:09 AM, Matt Riedemann wrote:



On 1/5/2015 2:16 PM, Doug Hellmann wrote:


On Jan 5, 2015, at 12:22 PM, Doug Hellmann d...@doughellmann.com 
wrote:




On Jan 5, 2015, at 12:00 PM, Matt Riedemann 
mrie...@linux.vnet.ibm.com wrote:


There is a deprecation warning in pip 6.0.6 which is making the 
py26 (on stable branches) and py27 jobs hit subunit log sizes of 
over 50 MB which makes the job fail.


A logstash query shows this started happening around 1/3 which is 
when pip 6.0.6 was released. In Nova alone there are nearly 18 
million hits of the deprecation warning.


Should we temporarily block so that pip  6.0.6?

https://bugs.launchpad.net/nova/+bug/1407736


I think this is actually a change in pkg_resources (in the 
setuptools dist) [1], being triggered by stevedore using 
require=False to avoid checking dependencies when plugins are loaded.


Doug

[1] 
https://bitbucket.org/pypa/setuptools/commits/b1c7a311fb8e167d026126f557f849450b859502


After some discussion with Jason Coombs and dstufft, a version of 
setuptools with a split API to replace the deprecated option was 
released. I have a patch up to teach stevedore about the new methods[1].


Doug

[1] https://review.openstack.org/#/c/145042/1






--

Thanks,

Matt Riedemann


___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev



___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev



___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev



The stevedore patch was merged. Do we need a release of stevedore and 
a global-requirements update to then get the deprecation warnings 
fixed in nova (on master and stable/juno)?




I guess so. Also, Icehouse is affected too. I've checked Nova 
requirements.txt for Icehouse, and we don't cap steverore version, so a 
new release will be automatically propagated to all new jobs.


/Ihar

___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] pip 6.0.6 breaking py2* jobs - bug 1407736

2015-01-06 Thread Matt Riedemann



On 1/6/2015 7:27 AM, Ihar Hrachyshka wrote:


On 01/06/2015 03:09 AM, Matt Riedemann wrote:



On 1/5/2015 2:16 PM, Doug Hellmann wrote:


On Jan 5, 2015, at 12:22 PM, Doug Hellmann d...@doughellmann.com
wrote:



On Jan 5, 2015, at 12:00 PM, Matt Riedemann
mrie...@linux.vnet.ibm.com wrote:


There is a deprecation warning in pip 6.0.6 which is making the
py26 (on stable branches) and py27 jobs hit subunit log sizes of
over 50 MB which makes the job fail.

A logstash query shows this started happening around 1/3 which is
when pip 6.0.6 was released. In Nova alone there are nearly 18
million hits of the deprecation warning.

Should we temporarily block so that pip  6.0.6?

https://bugs.launchpad.net/nova/+bug/1407736


I think this is actually a change in pkg_resources (in the
setuptools dist) [1], being triggered by stevedore using
require=False to avoid checking dependencies when plugins are loaded.

Doug

[1]
https://bitbucket.org/pypa/setuptools/commits/b1c7a311fb8e167d026126f557f849450b859502



After some discussion with Jason Coombs and dstufft, a version of
setuptools with a split API to replace the deprecated option was
released. I have a patch up to teach stevedore about the new methods[1].

Doug

[1] https://review.openstack.org/#/c/145042/1






--

Thanks,

Matt Riedemann


___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev



___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev



___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev



The stevedore patch was merged. Do we need a release of stevedore and
a global-requirements update to then get the deprecation warnings
fixed in nova (on master and stable/juno)?



I guess so. Also, Icehouse is affected too. I've checked Nova
requirements.txt for Icehouse, and we don't cap steverore version, so a
new release will be automatically propagated to all new jobs.

/Ihar

___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev



I've closed the nova bug as a duplicate of the stevedore bug since the 
latest release of stevedore fixed the problem for my nova change on 
stable/juno, thanks Doug!


--

Thanks,

Matt Riedemann


___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] pip 6.0.6 breaking py2* jobs - bug 1407736

2015-01-05 Thread Doug Hellmann

On Jan 5, 2015, at 12:00 PM, Matt Riedemann mrie...@linux.vnet.ibm.com wrote:

 There is a deprecation warning in pip 6.0.6 which is making the py26 (on 
 stable branches) and py27 jobs hit subunit log sizes of over 50 MB which 
 makes the job fail.
 
 A logstash query shows this started happening around 1/3 which is when pip 
 6.0.6 was released. In Nova alone there are nearly 18 million hits of the 
 deprecation warning.
 
 Should we temporarily block so that pip  6.0.6?
 
 https://bugs.launchpad.net/nova/+bug/1407736

I think this is actually a change in pkg_resources (in the setuptools dist) 
[1], being triggered by stevedore using require=False to avoid checking 
dependencies when plugins are loaded.

Doug

[1] 
https://bitbucket.org/pypa/setuptools/commits/b1c7a311fb8e167d026126f557f849450b859502


 
 -- 
 
 Thanks,
 
 Matt Riedemann
 
 
 ___
 OpenStack-dev mailing list
 OpenStack-dev@lists.openstack.org
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] pip 6.0.6 breaking py2* jobs - bug 1407736

2015-01-05 Thread Sean Dague
On 01/05/2015 12:00 PM, Matt Riedemann wrote:
 There is a deprecation warning in pip 6.0.6 which is making the py26 (on
 stable branches) and py27 jobs hit subunit log sizes of over 50 MB which
 makes the job fail.
 
 A logstash query shows this started happening around 1/3 which is when
 pip 6.0.6 was released. In Nova alone there are nearly 18 million hits
 of the deprecation warning.
 
 Should we temporarily block so that pip  6.0.6?
 
 https://bugs.launchpad.net/nova/+bug/1407736
 

Upstream bug filed here - https://github.com/pypa/pip/issues/2326

-Sean

-- 
Sean Dague
http://dague.net

___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] pip 6.0.6 breaking py2* jobs - bug 1407736

2015-01-05 Thread Brant Knudson
I think this started happening with setuptools 10.2. We had a similar
problem in Keystone -- a change was merged that caused any use of
deprecated function to fail[1]. This caused all keystone-python27 jobs to
fail when 10.2 was used because of the now deprecated function used by
paste. I thought this would actually last for longer then a week before it
broke. To get keystone tests working again, a change was merged to only
fail for deprecation warnings from keystone[2].

An example way to fix this is to add a warnings filter to ignore
deprecations rather than logging them.

[1] https://review.openstack.org/#/c/143183/2/keystone/tests/core.py
[2] https://review.openstack.org/#/c/144810/2/keystone/tests/core.py

- Brant



On Mon, Jan 5, 2015 at 11:00 AM, Matt Riedemann mrie...@linux.vnet.ibm.com
wrote:

 There is a deprecation warning in pip 6.0.6 which is making the py26 (on
 stable branches) and py27 jobs hit subunit log sizes of over 50 MB which
 makes the job fail.

 A logstash query shows this started happening around 1/3 which is when pip
 6.0.6 was released. In Nova alone there are nearly 18 million hits of the
 deprecation warning.

 Should we temporarily block so that pip  6.0.6?

 https://bugs.launchpad.net/nova/+bug/1407736

 --

 Thanks,

 Matt Riedemann


 ___
 OpenStack-dev mailing list
 OpenStack-dev@lists.openstack.org
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] pip 6.0.6 breaking py2* jobs - bug 1407736

2015-01-05 Thread Matt Riedemann



On 1/5/2015 2:16 PM, Doug Hellmann wrote:


On Jan 5, 2015, at 12:22 PM, Doug Hellmann d...@doughellmann.com wrote:



On Jan 5, 2015, at 12:00 PM, Matt Riedemann mrie...@linux.vnet.ibm.com wrote:


There is a deprecation warning in pip 6.0.6 which is making the py26 (on stable 
branches) and py27 jobs hit subunit log sizes of over 50 MB which makes the job 
fail.

A logstash query shows this started happening around 1/3 which is when pip 
6.0.6 was released. In Nova alone there are nearly 18 million hits of the 
deprecation warning.

Should we temporarily block so that pip  6.0.6?

https://bugs.launchpad.net/nova/+bug/1407736


I think this is actually a change in pkg_resources (in the setuptools dist) 
[1], being triggered by stevedore using require=False to avoid checking 
dependencies when plugins are loaded.

Doug

[1] 
https://bitbucket.org/pypa/setuptools/commits/b1c7a311fb8e167d026126f557f849450b859502


After some discussion with Jason Coombs and dstufft, a version of setuptools 
with a split API to replace the deprecated option was released. I have a patch 
up to teach stevedore about the new methods[1].

Doug

[1] https://review.openstack.org/#/c/145042/1






--

Thanks,

Matt Riedemann


___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev



___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev



___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev



The stevedore patch was merged. Do we need a release of stevedore and a 
global-requirements update to then get the deprecation warnings fixed in 
nova (on master and stable/juno)?


--

Thanks,

Matt Riedemann


___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] pip 6.0.6 breaking py2* jobs - bug 1407736

2015-01-05 Thread Doug Hellmann

On Jan 5, 2015, at 12:22 PM, Doug Hellmann d...@doughellmann.com wrote:

 
 On Jan 5, 2015, at 12:00 PM, Matt Riedemann mrie...@linux.vnet.ibm.com 
 wrote:
 
 There is a deprecation warning in pip 6.0.6 which is making the py26 (on 
 stable branches) and py27 jobs hit subunit log sizes of over 50 MB which 
 makes the job fail.
 
 A logstash query shows this started happening around 1/3 which is when pip 
 6.0.6 was released. In Nova alone there are nearly 18 million hits of the 
 deprecation warning.
 
 Should we temporarily block so that pip  6.0.6?
 
 https://bugs.launchpad.net/nova/+bug/1407736
 
 I think this is actually a change in pkg_resources (in the setuptools dist) 
 [1], being triggered by stevedore using require=False to avoid checking 
 dependencies when plugins are loaded.
 
 Doug
 
 [1] 
 https://bitbucket.org/pypa/setuptools/commits/b1c7a311fb8e167d026126f557f849450b859502

After some discussion with Jason Coombs and dstufft, a version of setuptools 
with a split API to replace the deprecated option was released. I have a patch 
up to teach stevedore about the new methods[1].

Doug

[1] https://review.openstack.org/#/c/145042/1

 
 
 
 -- 
 
 Thanks,
 
 Matt Riedemann
 
 
 ___
 OpenStack-dev mailing list
 OpenStack-dev@lists.openstack.org
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
 
 
 ___
 OpenStack-dev mailing list
 OpenStack-dev@lists.openstack.org
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev