Re: [pypy-dev] Unicode encode/decode speed (cont)

2013/2/19 Maciej Fijalkowski > On Tue, Feb 19, 2013 at 2:09 PM, Eleytherios Stamatogiannakis > wrote: > > > > So the main culprit of PyPy's slowdown is 'rU' option in open. > > > > Thanks for looking into it. > > Is this yet-another-fault-of-streamio? Not quite. Even a implementation based on

Re: [pypy-dev] Unicode encode/decode speed (cont)

On Tue, Feb 19, 2013 at 2:09 PM, Eleytherios Stamatogiannakis wrote: > On 18/02/13 21:15, Amaury Forgeot d'Arc wrote: >> >> 2013/2/18 Alex Gaynor > > >> >> >> So, iter(file).next() is slow? >> >> >> Yes, but only with "rU" mode. >> My benchmark with yesterday's bu

Re: [pypy-dev] Unicode encode/decode speed (cont)

On 18/02/13 21:15, Amaury Forgeot d'Arc wrote: 2013/2/18 Alex Gaynor mailto:alex.gay...@gmail.com>> So, iter(file).next() is slow? Yes, but only with "rU" mode. My benchmark with yesterday's build: $ ~/pypy/pypy-c-jit-60005-0f1e91da6cb2-linux64/bin/pypy -m timeit "fp = open('/tmp/large-te

Re: [pypy-dev] Unicode encode/decode speed (cont)

2013/2/18 Alex Gaynor > So, iter(file).next() is slow? Yes, but only with "rU" mode. My benchmark with yesterday's build: $ ~/pypy/pypy-c-jit-60005-0f1e91da6cb2-linux64/bin/pypy -m timeit "fp = open('/tmp/large-text-file'); list(fp)" 10 loops, best of 3: 43.5 msec per loop $ ~/pypy/pypy-c-jit-

Re: [pypy-dev] Unicode encode/decode speed (cont)

So, iter(file).next() is slow? Alex On Mon, Feb 18, 2013 at 10:51 AM, Amaury Forgeot d'Arc wrote: > 2013/2/18 Eleytherios Stamatogiannakis > >> On 18/02/13 18:44, Maciej Fijalkowski wrote: >> >>> On Mon, Feb 18, 2013 at 6:20 PM, Eleytherios Stamatogiannakis >>> wrote: >>> We have found a

Re: [pypy-dev] Unicode encode/decode speed (cont)

2013/2/18 Eleytherios Stamatogiannakis > On 18/02/13 18:44, Maciej Fijalkowski wrote: > >> On Mon, Feb 18, 2013 at 6:20 PM, Eleytherios Stamatogiannakis >> wrote: >> >>> We have found another (very simple) madIS query where PyPy is around 250x >>> slower that CPython: >>> >>> CPython: 314msec >>

Re: [pypy-dev] Unicode encode/decode speed (cont)

On 18/02/13 18:44, Maciej Fijalkowski wrote: On Mon, Feb 18, 2013 at 6:20 PM, Eleytherios Stamatogiannakis wrote: We have found another (very simple) madIS query where PyPy is around 250x slower that CPython: CPython: 314msec PyPy: 1min 16sec The query if you would like to test it yourself is

Re: [pypy-dev] Unicode encode/decode speed (cont)

On 18/02/13 20:21, Amaury Forgeot d'Arc wrote: 2013/2/18 Eleytherios Stamatogiannakis mailto:est...@gmail.com>> We have found another (very simple) madIS query where PyPy is around 250x slower that CPython: CPython: 314msec PyPy: 1min 16sec The query if you would like to t

Re: [pypy-dev] Unicode encode/decode speed (cont)

2013/2/18 Eleytherios Stamatogiannakis > We have found another (very simple) madIS query where PyPy is around 250x > slower that CPython: > > CPython: 314msec > PyPy: 1min 16sec > > The query if you would like to test it yourself is the following: > > select count(*) from (file 'some_big_tex

Re: [pypy-dev] Unicode encode/decode speed (cont)

On Mon, Feb 18, 2013 at 6:20 PM, Eleytherios Stamatogiannakis wrote: > We have found another (very simple) madIS query where PyPy is around 250x > slower that CPython: > > CPython: 314msec > PyPy: 1min 16sec > > The query if you would like to test it yourself is the following: > > select count(*)

[pypy-dev] Unicode encode/decode speed (cont)

We have found another (very simple) madIS query where PyPy is around 250x slower that CPython: CPython: 314msec PyPy: 1min 16sec The query if you would like to test it yourself is the following: select count(*) from (file 'some_big_text_file.txt' limit 10); To run it you'll need some