Re: [easybuild] Python extensions at Pypi relocated, download fails
You can also use their re-director: https://files.pythonhosted.org/packages/source/p//-.tar.gz On 06/23/2016 08:17 AM, Kenneth Hoste wrote: > Hi Olaf, > > You're hitting a very annoying change in the way PyPI serves source tarballs, > see also https://bitbucket.org/pypa/pypi/issues/438 . > > We've implemented a workaround for this in EasyBuild v2.8.0, where we > translate 'normal' old-style URLs to the equivalent one that includes a hash > in it, cfr. https://github.com/hpcugent/easybuild-framework/pull/1749 . > > > regards, > > Kenneth > > On 23/06/16 16:10, Olaf Walter wrote: >> >> Dear easybuilders, >> >> >> >> I just tried building the latest Python and noticed that extensions do not >> longer download. The URL seems to have changed. For example: >> >> >> >> exts_list = [ >> >> ('pip', '8.1.2', { >> >> 'source_urls': ['http://pypi.python.org/packages/source/p/pip/'], >> >> }), >> >> >> >> results in: >> >> == 2016-06-23 14:58:21,666 filetools.py:273 WARNING URL >> https://pypi.python.org/packages/source/p/pip/pip-8.1.2.tar.gz was not found >> (HTTP response code 404), not trying again >> >> == 2016-06-23 14:58:21,666 filetools.py:291 WARNING Download of >> https://pypi.python.org/packages/source/p/pip/pip-8.1.2.tar.gz to >> /gpfs01/sw/SOURCES/p/Python/extensions/pip-8.1.2.tar.gz failed, done trying >> >> == 2016-06-23 14:58:21,984 filetools.py:273 WARNING URL >> http://www.python.org/ftp/python/2.7.11/pip-8.1.2.tar.gz was not found (HTTP >> response code 404), not trying again >> >> == 2016-06-23 14:58:21,984 filetools.py:291 WARNING Download of >> http://www.python.org/ftp/python/2.7.11/pip-8.1.2.tar.gz to >> /gpfs01/sw/SOURCES/p/Python/extensions/pip-8.1.2.tar.gz failed, done trying >> >> >> >> I also tried changing the URL to https, which did not help in my test. >> >> >> >> When I check the pip home page on pypi, I get the following download link: >> >> https://pypi.python.org/packages/e7/a8/7556133689add8d1a54c0b14aeff0acb03c64707ce100ecd53934da1aa13/pip-8.1.2.tar.gz#md5=87083c0b9867963b29f7aba3613e8f4a >> >> >> >> Then I found the following thread, where Kenneth already has contributed. >> The issue is marked as “resolved”, though. >> >> https://bitbucket.org/pypa/pypi/issues/438/backwards-compatible-un-hashed-package >> >> >> >> Can anybody update me please on what’s going on? Is there something we can >> do in the easybuild scope? >> >> >> >> Thank you! >> >> Olaf >> >> >> >> >> > -- Orion Poplawski Technical Manager 303-415-9701 x222 NWRA, Boulder/CoRA Office FAX: 303-415-9702 3380 Mitchell Lane or...@nwra.com Boulder, CO 80301 http://www.nwra.com
Re: [easybuild] Python extensions at Pypi relocated, download fails
Hi Olaf, You're hitting a very annoying change in the way PyPI serves source tarballs, see also https://bitbucket.org/pypa/pypi/issues/438 . We've implemented a workaround for this in EasyBuild v2.8.0, where we translate 'normal' old-style URLs to the equivalent one that includes a hash in it, cfr. https://github.com/hpcugent/easybuild-framework/pull/1749 . regards, Kenneth On 23/06/16 16:10, Olaf Walter wrote: Dear easybuilders, I just tried building the latest Python and noticed that extensions do not longer download. The URL seems to have changed. For example: exts_list = [ ('pip', '8.1.2', { 'source_urls': ['http://pypi.python.org/packages/source/p/pip/'], }), results in: == 2016-06-23 14:58:21,666 filetools.py:273 WARNING URL https://pypi.python.org/packages/source/p/pip/pip-8.1.2.tar.gz was not found (HTTP response code 404), not trying again == 2016-06-23 14:58:21,666 filetools.py:291 WARNING Download of https://pypi.python.org/packages/source/p/pip/pip-8.1.2.tar.gz to /gpfs01/sw/SOURCES/p/Python/extensions/pip-8.1.2.tar.gz failed, done trying == 2016-06-23 14:58:21,984 filetools.py:273 WARNING URL http://www.python.org/ftp/python/2.7.11/pip-8.1.2.tar.gz was not found (HTTP response code 404), not trying again == 2016-06-23 14:58:21,984 filetools.py:291 WARNING Download of http://www.python.org/ftp/python/2.7.11/pip-8.1.2.tar.gz to /gpfs01/sw/SOURCES/p/Python/extensions/pip-8.1.2.tar.gz failed, done trying I also tried changing the URL to https, which did not help in my test. When I check the pip home page on pypi, I get the following download link: https://pypi.python.org/packages/e7/a8/7556133689add8d1a54c0b14aeff0acb03c64707ce100ecd53934da1aa13/pip-8.1.2.tar.gz#md5=87083c0b9867963b29f7aba3613e8f4a Then I found the following thread, where Kenneth already has contributed. The issue is marked as “resolved”, though. https://bitbucket.org/pypa/pypi/issues/438/backwards-compatible-un-hashed-package Can anybody update me please on what’s going on? Is there something we can do in the easybuild scope? Thank you! Olaf
[easybuild] Python extensions at Pypi relocated, download fails
Dear easybuilders, I just tried building the latest Python and noticed that extensions do not longer download. The URL seems to have changed. For example: exts_list = [ ('pip', '8.1.2', { 'source_urls': ['http://pypi.python.org/packages/source/p/pip/'], }), results in: == 2016-06-23 14:58:21,666 filetools.py:273 WARNING URL https://pypi.python.org/packages/source/p/pip/pip-8.1.2.tar.gz was not found (HTTP response code 404), not trying again == 2016-06-23 14:58:21,666 filetools.py:291 WARNING Download of https://pypi.python.org/packages/source/p/pip/pip-8.1.2.tar.gz to /gpfs01/sw/SOURCES/p/Python/extensions/pip-8.1.2.tar.gz failed, done trying == 2016-06-23 14:58:21,984 filetools.py:273 WARNING URL http://www.python.org/ftp/python/2.7.11/pip-8.1.2.tar.gz was not found (HTTP response code 404), not trying again == 2016-06-23 14:58:21,984 filetools.py:291 WARNING Download of http://www.python.org/ftp/python/2.7.11/pip-8.1.2.tar.gz to /gpfs01/sw/SOURCES/p/Python/extensions/pip-8.1.2.tar.gz failed, done trying I also tried changing the URL to https, which did not help in my test. When I check the pip home page on pypi, I get the following download link: https://pypi.python.org/packages/e7/a8/7556133689add8d1a54c0b14aeff0acb03c64707ce100ecd53934da1aa13/pip-8.1.2.tar.gz#md5=87083c0b9867963b29f7aba3613e8f4a Then I found the following thread, where Kenneth already has contributed. The issue is marked as "resolved", though. https://bitbucket.org/pypa/pypi/issues/438/backwards-compatible-un-hashed-package Can anybody update me please on what's going on? Is there something we can do in the easybuild scope? Thank you! Olaf