[Bug 1833229] Re: `--extra-index-url` not working for PIP
@james-page -- Please ping me on freenode (Daemoen) on the ubuntu channel. I have created a user for you to test against our repository host, as hopefully that should simplify this a bit. I can provide you all of the details for the configuration needed, but don't want to provide them here as this is a public medium. I just tested the credentials and ensured that it will allow you to replicate the issue as the rest of us see it. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1833229 Title: `--extra-index-url` not working for PIP To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/python-pip/+bug/1833229/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1833229] Re: `--extra-index-url` not working for PIP
@james-page Tested -- not fixed root@vagrant:/etc# dpkg -l | grep pip ii libpipeline1:amd641.5.0-1 amd64pipeline manipulation library ii python-pip 9.0.1-2.3~ubuntu1.18.04.2~ubuntu18.04.1~ppa201909251252 all Python package installer ii python-pip-whl 9.0.1-2.3~ubuntu1.18.04.2~ubuntu18.04.1~ppa201909251252 all Python package installer ii python3-pip 9.0.1-2.3~ubuntu1.18.04.2~ubuntu18.04.1~ppa201909251252 all Python package installer root@vagrant:/etc# pip install ansible==2.8.0 Collecting ansible==2.8.0 Exception: Traceback (most recent call last): File "/usr/lib/python2.7/dist-packages/pip/basecommand.py", line 215, in main status = self.run(options, args) File "/usr/lib/python2.7/dist-packages/pip/commands/install.py", line 353, in run wb.build(autobuilding=True) File "/usr/lib/python2.7/dist-packages/pip/wheel.py", line 749, in build self.requirement_set.prepare_files(self.finder) File "/usr/lib/python2.7/dist-packages/pip/req/req_set.py", line 380, in prepare_files ignore_dependencies=self.ignore_dependencies)) File "/usr/lib/python2.7/dist-packages/pip/req/req_set.py", line 554, in _prepare_file require_hashes File "/usr/lib/python2.7/dist-packages/pip/req/req_install.py", line 278, in populate_link self.link = finder.find_requirement(self, upgrade) File "/usr/lib/python2.7/dist-packages/pip/index.py", line 465, in find_requirement all_candidates = self.find_all_candidates(req.name) File "/usr/lib/python2.7/dist-packages/pip/index.py", line 423, in find_all_candidates for page in self._get_pages(url_locations, project_name): File "/usr/lib/python2.7/dist-packages/pip/index.py", line 568, in _get_pages page = self._get_page(location) File "/usr/lib/python2.7/dist-packages/pip/index.py", line 683, in _get_page return HTMLPage.get_page(link, session=self.session) File "/usr/lib/python2.7/dist-packages/pip/index.py", line 795, in get_page resp.raise_for_status() File "/usr/share/python-wheels/requests-2.18.4-py2.py3-none-any.whl/requests/models.py", line 935, in raise_for_status raise HTTPError(http_error_msg, response=self) HTTPError: 404 Client Error: Not Found for url: https://artifacts.ourdomain.com/repository/pypi-release/simple/ansible/ -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1833229 Title: `--extra-index-url` not working for PIP To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/python-pip/+bug/1833229/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1833229] Re: `--extra-index-url` not working for PIP
@james-page I think the thing being overlooked is what it is doing, not wether or not the exception is correct. In our case, we have repositories that have some artifacts, and repositories that may have other artifacts... (and once in a rare while, overlap with different versions).. If we request a package that does *not* exist in the custom urls, then it will fail completely, instead of passing with the only failure being on that one repository. By default, it should check each of the repositories, see if they have it, etc.. It seems to be checking them all, but if *any* of them fails to have an artifact being requested, the entire pip operation implodes, even if the package *is* available in a different repository successfully prior to the fetching of the failed repo. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1833229 Title: `--extra-index-url` not working for PIP To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/python-pip/+bug/1833229/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1833229] Re: `--extra-index-url` not working for PIP
Can confirm here as well. I also tested the pip/whl builds from universal which are at 18.x -- these unfortunately have the exact same issue. Was hoping maybe they had moved past it, which suggests that the issue is with the unvendored requests, as opposed to pip itself. https://bugs.launchpad.net/ubuntu/+source/python-pip/+bug/1842120 can be marked as a duplicate of this. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1833229 Title: `--extra-index-url` not working for PIP To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/python-pip/+bug/1833229/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1842120] Re: python-pip fails to retrieve package manifest from extra-index on ubuntu18 python-pip python3-pip
This is a duplicate, found the original -- https://bugs.launchpad.net/ubuntu/+source/python-pip/+bug/1833229, which unfortunately goes even further back, to https://bugs.launchpad.net/ubuntu/+source/python-pip/+bug/1822842 which was closed, even though it created a new issue that was revealed during testing. This bug dates back to 2019-06-18, and in 2.5 months doesn't appear to be getting any traction, which is concerning. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1842120 Title: python-pip fails to retrieve package manifest from extra-index on ubuntu18 python-pip python3-pip To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/python-pip/+bug/1842120/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1842120] Re: python-pip fails to retrieve package manifest from extra-index on ubuntu16 python-pip python3-pip
Meant to say u18 in the title, not u16 ** Summary changed: - python-pip fails to retrieve package manifest from extra-index on ubuntu16 python-pip python3-pip + python-pip fails to retrieve package manifest from extra-index on ubuntu18 python-pip python3-pip -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1842120 Title: python-pip fails to retrieve package manifest from extra-index on ubuntu18 python-pip python3-pip To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/python-pip/+bug/1842120/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1842120] [NEW] python-pip fails to retrieve package manifest from extra-index on ubuntu18 python-pip python3-pip
Public bug reported: /etc/pip.conf [global] timeout = 60 index = https://artifacts.somewhere.com/repository/pypi-public/pypi index-url = https://artifacts.somewhere.com/repository/pypi-public/simple extra-index = https://artifacts.somewhere.com/repository/pypi-release/pypi https://artifacts.somewhere.com/repository/pypi-test/pypi extra-index-url = https://artifacts.somewhere.com/repository/pypi-release/simple https://artifacts.somewhere.com/repository/pypi-test/simple https://pypi.somewhere.com https://pypi-test.somewhere.com ## ## ## We have nexus (competitor to artifactory) setup to proxy / cache the public pypi.org as 'pypi-public' pypi-release and pypi-test are our own internal package repos (hosted) for our python packages the last 2 (pypi/pypi-test.somewhere) are old s3 bucket configs of ours that im in the process of deprecating. Our nexus requires authorization, so we have /root/.netrc configured, since that would be used for system level installs. Users can of course configure a ~/.netrc with the proper login details. Actual issue when doing a pip install on 9.0.1 on debian/ubuntu: root@vagrant:/etc# pip install ansible== Collecting ansible== Exception: Traceback (most recent call last): File "/usr/lib/python2.7/dist-packages/pip/basecommand.py", line 215, in main status = self.run(options, args) File "/usr/lib/python2.7/dist-packages/pip/commands/install.py", line 353, in run wb.build(autobuilding=True) File "/usr/lib/python2.7/dist-packages/pip/wheel.py", line 749, in build self.requirement_set.prepare_files(self.finder) File "/usr/lib/python2.7/dist-packages/pip/req/req_set.py", line 380, in prepare_files ignore_dependencies=self.ignore_dependencies)) File "/usr/lib/python2.7/dist-packages/pip/req/req_set.py", line 554, in _prepare_file require_hashes File "/usr/lib/python2.7/dist-packages/pip/req/req_install.py", line 278, in populate_link self.link = finder.find_requirement(self, upgrade) File "/usr/lib/python2.7/dist-packages/pip/index.py", line 465, in find_requirement all_candidates = self.find_all_candidates(req.name) File "/usr/lib/python2.7/dist-packages/pip/index.py", line 423, in find_all_candidates for page in self._get_pages(url_locations, project_name): File "/usr/lib/python2.7/dist-packages/pip/index.py", line 568, in _get_pages page = self._get_page(location) File "/usr/lib/python2.7/dist-packages/pip/index.py", line 683, in _get_page return HTMLPage.get_page(link, session=self.session) File "/usr/lib/python2.7/dist-packages/pip/index.py", line 795, in get_page resp.raise_for_status() File "/usr/share/python-wheels/requests-2.18.4-py2.py3-none-any.whl/requests/models.py", line 935, in raise_for_status raise HTTPError(http_error_msg, response=self) HTTPError: 404 Client Error: Not Found for url: https://our.internal.repo/repository/pypi-release/simple/ansible/ Works on centos, and ubuntu 16 with repackaged Pip 8.1.2. Unfortunately, debian handles things like vendored libs in pip differently than other distros, so it appears to be a bug in deb/ubu requests? https://bugs.launchpad.net/ubuntu/+source/python- pip/+bug/1772746 The issue is different, but I have a feeling that the cause is the same, the underlying requests library is stuck and has issues. ProblemType: Bug DistroRelease: Ubuntu 18.04 Package: python-pip 9.0.1-2.3~ubuntu1.18.04.1 ProcVersionSignature: Ubuntu 4.15.0-58.64-generic 4.15.18 Uname: Linux 4.15.0-58-generic x86_64 ApportVersion: 2.20.9-0ubuntu7.7 Architecture: amd64 Date: Fri Aug 30 18:29:14 2019 InstallationDate: Installed on 2019-08-16 (14 days ago) InstallationMedia: Ubuntu-Server 18.04.2 LTS "Bionic Beaver" - Release amd64 (20190210) PackageArchitecture: all ProcEnviron: LANGUAGE=en_US: TERM=xterm-256color PATH=(custom, no user) LANG=en_US.UTF-8 SHELL=/bin/bash SourcePackage: python-pip UpgradeStatus: No upgrade log present (probably fresh install) ** Affects: python-pip (Ubuntu) Importance: Undecided Status: New ** Tags: amd64 apport-bug bionic -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1842120 Title: python-pip fails to retrieve package manifest f
