Re: [Distutils] PyPI Rate Limiting

2014-02-10 Thread Chris Jerdonek
On Sun, Feb 9, 2014 at 12:16 PM, Noah Kantrowitz n...@coderanger.net wrote: On Feb 9, 2014, at 1:13 AM, Robert Collins robe...@robertcollins.net wrote: On 9 February 2014 19:28, Noah Kantrowitz n...@coderanger.net wrote: On Feb 8, 2014, at 6:25 PM, Robert Collins robe...@robertcollins.net

Re: [Distutils] PyPI Rate Limiting

2014-02-10 Thread Noah Kantrowitz
On Feb 10, 2014, at 1:48 AM, Chris Jerdonek chris.jerdo...@gmail.com wrote: On Sun, Feb 9, 2014 at 12:16 PM, Noah Kantrowitz n...@coderanger.net wrote: On Feb 9, 2014, at 1:13 AM, Robert Collins robe...@robertcollins.net wrote: On 9 February 2014 19:28, Noah Kantrowitz n...@coderanger.net

Re: [Distutils] PyPI Rate Limiting

2014-02-10 Thread Marius Gedminas
On Sat, Feb 08, 2014 at 05:15:21PM -0500, Ernest W. Durbin III wrote: The initial rates will be limited to 5 req/s per IP with bursts of 10 requests allowed. Client requests up to the burst limit will be delayed to maintain a 5 req/s maximum. Any requests past the 10 request burst will receive

Re: [Distutils] PyPI Rate Limiting

2014-02-09 Thread Robert Collins
On 9 February 2014 19:28, Noah Kantrowitz n...@coderanger.net wrote: On Feb 8, 2014, at 6:25 PM, Robert Collins robe...@robertcollins.net wrote: 5/s sounds really low - if the RPC's take less than 200ms to answer (and I sure hope they do), a single threaded mirroring client (with low

Re: [Distutils] PyPI Rate Limiting

2014-02-09 Thread Donald Stufft
On Feb 9, 2014, at 4:13 AM, Robert Collins robe...@robertcollins.net wrote: On 9 February 2014 19:28, Noah Kantrowitz n...@coderanger.net wrote: On Feb 8, 2014, at 6:25 PM, Robert Collins robe...@robertcollins.net wrote: 5/s sounds really low - if the RPC's take less than 200ms to

Re: [Distutils] PyPI Rate Limiting

2014-02-09 Thread Noah Kantrowitz
On Feb 9, 2014, at 1:13 AM, Robert Collins robe...@robertcollins.net wrote: On 9 February 2014 19:28, Noah Kantrowitz n...@coderanger.net wrote: On Feb 8, 2014, at 6:25 PM, Robert Collins robe...@robertcollins.net wrote: 5/s sounds really low - if the RPC's take less than 200ms to

[Distutils] PyPI Rate Limiting

2014-02-08 Thread Ernest W. Durbin III
Since the launch of the new infrastructure for PyPI two weeks ago, I’ve been monitoring overall performance and reliability of PyPI for browsers, uploads, installers, and mirrors. Overall I am very happy, but have noticed an ongoing issue with latency spikes and 5xx errors. I believe these

Re: [Distutils] PyPI Rate Limiting

2014-02-08 Thread Robert Collins
On 9 February 2014 11:15, Ernest W. Durbin III ewdur...@gmail.com wrote: Since the launch of the new infrastructure for PyPI two weeks ago, I've been monitoring overall performance and reliability of PyPI for browsers, uploads, installers, and mirrors. The initial rates will be limited to 5

Re: [Distutils] PyPI Rate Limiting

2014-02-08 Thread Noah Kantrowitz
On Feb 8, 2014, at 6:25 PM, Robert Collins robe...@robertcollins.net wrote: On 9 February 2014 11:15, Ernest W. Durbin III ewdur...@gmail.com wrote: Since the launch of the new infrastructure for PyPI two weeks ago, I've been monitoring overall performance and reliability of PyPI for