Re: [Distutils] Outdated packages on pypi

2016-07-13 Thread Steve Dower
On 13Jul2016 1456, Glyph Lefkowitz wrote: On Jul 13, 2016, at 1:54 PM, Steve Dower > wrote: Possibly such user-contributed content would be valuable anyway https://alternativeto.net but for PyPI? :) Or just more general

Re: [Distutils] Outdated packages on pypi

2016-07-13 Thread Glyph Lefkowitz
> On Jul 13, 2016, at 1:54 PM, Steve Dower wrote: > > Possibly such user-contributed content would be valuable anyway https://alternativeto.net but for PyPI? :) -glyph___ Distutils-SIG maillist - Distutils-SIG@python.org

Re: [Distutils] Outdated packages on pypi

2016-07-13 Thread Steve Dower
On 13Jul2016 1252, Glyph Lefkowitz wrote: The primary thing would be to have a banner on the page and a warning from `pip install´. Those of us close to the heart of the Python community already have various ways of reading the tea leaves to know that things are likely to be unmaintained or

Re: [Distutils] PyPI index workaround

2016-07-13 Thread Donald Stufft
> On Jul 13, 2016, at 4:21 PM, Михаил Голубев wrote: > > Can you handle that? Oh, and just to put things in scale in the past 30 days: * PyPI has served > 3 billion HTTP requests. * PyPI has served > 327TB of bandwidth. * The 95%tile for cache hit vs cache miss is 92%. *

Re: [Distutils] PyPI index workaround

2016-07-13 Thread Donald Stufft
> On Jul 13, 2016, at 4:21 PM, Михаил Голубев wrote: > > Right, sorry, that initial question wasn't clear about that. > > We need the latest versions only for installed packages. Nonetheless, as you > noted, it's still several dozens consecutive requests to > "/simple/"

Re: [Distutils] PyPI index workaround

2016-07-13 Thread Steve Dower
I'm also interested (for the same support in Visual Studio) though we're unaffected by this change. A batch API to get info for many packages would be great. Currently we scrape simple and then post JSON queries for individual packages. Cheers, Steve Top-posted from my Windows Phone

Re: [Distutils] PyPI index workaround

2016-07-13 Thread Михаил Голубев
Right, sorry, that initial question wasn't clear about that. We need the latest versions only for installed packages. Nonetheless, as you noted, it's still several dozens consecutive requests to "/simple/" for each PyCharm session of every user. Can you handle that? 2016-07-13 22:56 GMT+03:00

Re: [Distutils] PyPI index workaround

2016-07-13 Thread Михаил Голубев
I'm sorry, I should have posted my commentary here, not in the separate thread. > We have some issues with suggested "/simple" endpoint. Despite the need to > scrap the web page, old endpoint allowed us to quickly find latest versions > of the packages hosted on PyPI. We did a single request on

[Distutils] Deprecation of the endpoint "/pypi?%3Aaction=index"

2016-07-13 Thread Михаил Голубев
Hi guys. I'd like to clarify Dmitry's question a bit. We have some issues with suggested "/simple" endpoint. Despite the need to scrap the web page, old endpoint allowed us to quickly find latest versions of the packages hosted on PyPI. We did a single request on IDE startup and showed outdated

Re: [Distutils] PyPI index workaround

2016-07-13 Thread Donald Stufft
> On Jul 13, 2016, at 3:40 PM, Dmitry Trofimov > wrote: > > Does that mean that PyPI index page will live for a while until the new API > is implemented? Yes, though I’m looking at this right now. I do have a question here though. If I understand the dialog,

Re: [Distutils] Outdated packages on pypi

2016-07-13 Thread Glyph Lefkowitz
> On Jul 12, 2016, at 9:54 PM, Donald Stufft wrote: > > >> On Jul 12, 2016, at 4:45 PM, Glyph Lefkowitz wrote: >> >> My feeling is that there should be a "dead man's switch" sort of mechanism >> for this. Require manual intervention from at least

Re: [Distutils] PyPI index workaround

2016-07-13 Thread Dmitry Trofimov
> > > Ok, we don’t currently have an API like that (largely because nobody has > come up with a use case that was pressing enough to need to devote > resources to it). It was requested though, and is being tracked by > https://github.com/pypa/warehouse/issues/347. This is likely enough to > pull

Re: [Distutils] PyPI index workaround

2016-07-13 Thread Donald Stufft
> On Jul 13, 2016, at 3:12 PM, Михаил Голубев wrote: > > I'm sorry, I should have posted my commentary here, not in the separate > thread. > > We have some issues with suggested "/simple" endpoint. Despite the need to > scrap the web page, old endpoint allowed us to

Re: [Distutils] Outdated packages on pypi

2016-07-13 Thread Donald Stufft
> On Jul 13, 2016, at 2:08 PM, Dima Tisnek wrote: > > I'd rather see something similar to Linux distributions where there's > a curated repository "core" and a few semi-official, like "extra" and > "community," and for some, "testing." > A name foobar resolves to core/foobar-

Re: [Distutils] Outdated packages on pypi

2016-07-13 Thread Paul Moore
On 13 July 2016 at 19:08, Dima Tisnek wrote: > I'd rather see something similar to Linux distributions where there's > a curated repository "core" and a few semi-official, like "extra" and > "community," and for some, "testing." > A name foobar resolves to core/foobar- if that

Re: [Distutils] PyPI index workaround

2016-07-13 Thread Donald Stufft
> On Jul 13, 2016, at 2:43 PM, Dmitry Trofimov > wrote: > > Hi, > > to have information about available packages, PyCharm IDE currently parses > the PyPI index page (https://pypi.python.org/pypi?%3Aaction=index > ).

Re: [Distutils] Outdated packages on pypi

2016-07-13 Thread Dima Tisnek
I came across a package by accident. A mate made a reasonable mistake typing in a pip command, and something odd got installed. For a moment I even suspected that package in question was some kind of malware, so I went to download it manually (not via pip install), and realised that the package

[Distutils] PyPI index workaround

2016-07-13 Thread Dmitry Trofimov
Hi, to have information about available packages, PyCharm IDE currently parses the PyPI index page (https://pypi.python.org/pypi?%3Aaction=index). As it is going to be deprecated soon, we are looking for a workaround. What we need is, making one request, to get the name and the version of all

Re: [Distutils] Outdated packages on pypi

2016-07-13 Thread Jim Fulton
Well said. IMO, package names shouldn't be reused. Also, IMO, we have a namespace problem, for which there's a common solution that we avoid (domain based names, which can also be reused, but ...). OTOH, here's an idea. What if in addition to the project name, we also assigned a unique id. When

Re: [Distutils] Missing IPv6 support on pypi.python.org

2016-07-13 Thread Donald Stufft
> On Jul 13, 2016, at 8:42 AM, Baptiste Jonglez > wrote: > > As a follow-up, Fastly now provides an option to enable IPv6 (but this is > not enabled by default). > > See: https://github.com/pypa/pypi-legacy/issues/90#issuecomment-231240046 > > Does pypi plan to

Re: [Distutils] Outdated packages on pypi

2016-07-13 Thread Jim Fulton
On Tue, Jul 12, 2016 at 7:55 AM, Dima Tisnek wrote: > Hi all, > > Is anyone working on pruning old packages from pypi? > > I found something last updated in 2014, which, looking at the source > appears half-done. > Github link doesn't work any longer, no description, etc. > > I

Re: [Distutils] Outdated packages on pypi

2016-07-13 Thread Brett Cannon
On Tue, 12 Jul 2016 at 21:54 Donald Stufft wrote: > > > On Jul 12, 2016, at 4:45 PM, Glyph Lefkowitz > wrote: > > > > My feeling is that there should be a "dead man's switch" sort of > mechanism for this. Require manual intervention from at least one

Re: [Distutils] Missing IPv6 support on pypi.python.org

2016-07-13 Thread Chris Withers
Out of curiosity, how's that coming? On 13/07/2016 14:08, Alex Grönholm wrote: The legacy software might have issues with IPv6 so I doubt this will happen before Warehouse replaces Cheeseshop as the new PyPI. 13.07.2016,

Re: [Distutils] Missing IPv6 support on pypi.python.org

2016-07-13 Thread Alex Grönholm
The legacy software might have issues with IPv6 so I doubt this will happen before Warehouse replaces Cheeseshop as the new PyPI. 13.07.2016, 15:42, Baptiste Jonglez kirjoitti: As a follow-up, Fastly now provides an option to enable IPv6 (but this is not enabled by default). See:

Re: [Distutils] Missing IPv6 support on pypi.python.org

2016-07-13 Thread Baptiste Jonglez
As a follow-up, Fastly now provides an option to enable IPv6 (but this is not enabled by default). See: https://github.com/pypa/pypi-legacy/issues/90#issuecomment-231240046 Does pypi plan to participate in this program? It would be nice! Thanks, Baptiste On Sun, Nov 08, 2015 at 09:13:49PM