[issue14624] Faster utf-16 decoder

2012-05-19 Thread Serhiy Storchaka
Serhiy Storchaka storch...@gmail.com added the comment: Thank you, Antoine. Now only issue14625 waits for review. changeset: 77012:3430d7329a3b +* UTF-8 and UTF-16 decoding is now 2x to 4x faster. In fact now UTF-16 decoding faster for a maximum of +25% compared to Python 3.2 on my

[issue14624] Faster utf-16 decoder

2012-05-15 Thread Serhiy Storchaka
Serhiy Storchaka storch...@gmail.com added the comment: Here are two new patch. Checking for characters out-of-range moved, making the code simpler. Theoretically it is a bit slow down decoding of short UCS1 strings (up to 1 and 3 chars on 32- and 64-bit), but practically there is no difference.

[issue14624] Faster utf-16 decoder

2012-05-15 Thread Roundup Robot
Roundup Robot devn...@psf.upfronthosting.co.za added the comment: New changeset cdcc816dea85 by Antoine Pitrou in branch 'default': Issue #14624: UTF-16 decoding is now 3x to 4x faster on various inputs. http://hg.python.org/cpython/rev/cdcc816dea85 --

[issue14624] Faster utf-16 decoder

2012-05-15 Thread Antoine Pitrou
Antoine Pitrou pit...@free.fr added the comment: Thank you Serhiy! Now committed. -- resolution: - fixed stage: - committed/rejected status: open - closed ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue14624

[issue14624] Faster utf-16 decoder

2012-05-14 Thread Serhiy Storchaka
Serhiy Storchaka storch...@gmail.com added the comment: The patch updated with a little clarified code and added comments. -- Added file: http://bugs.python.org/file25590/decode_utf16_4.patch ___ Python tracker rep...@bugs.python.org

[issue14624] Faster utf-16 decoder

2012-05-13 Thread Antoine Pitrou
Antoine Pitrou pit...@free.fr added the comment: New performance figures under 64 bit Linux, Intel Core i5-2500K @ 3.30GHz: vanilla 3.3 patched utf-16le 'A'*1 1411 (+290%) 5504 utf-16le 'A'*+'\x80'

[issue14624] Faster utf-16 decoder

2012-05-11 Thread Serhiy Storchaka
Serhiy Storchaka storch...@gmail.com added the comment: The patch updated to stylistic conformity of the UTF-8 decoder. The decoding of the UCS2 non-surrogate characters a little speed up (+15%). -- Added file: http://bugs.python.org/file25536/decode_utf16_3.patch

[issue14624] Faster utf-16 decoder

2012-05-11 Thread Serhiy Storchaka
Changes by Serhiy Storchaka storch...@gmail.com: -- components: +Unicode nosy: +ezio.melotti ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue14624 ___

[issue14624] Faster utf-16 decoder

2012-05-03 Thread Roundup Robot
Roundup Robot devn...@psf.upfronthosting.co.za added the comment: New changeset 830eeff4fe8f by Victor Stinner in branch 'default': Issue #14624, #14687: Optimize unicode_widen() http://hg.python.org/cpython/rev/830eeff4fe8f -- nosy: +python-dev ___

[issue14624] Faster utf-16 decoder

2012-05-03 Thread Serhiy Storchaka
Serhiy Storchaka storch...@gmail.com added the comment: Here is updated patch, taking into account that unicode_widen is already optimized. -- Added file: http://bugs.python.org/file25443/decode_utf16_2.patch ___ Python tracker rep...@bugs.python.org

[issue14624] Faster utf-16 decoder

2012-04-23 Thread Serhiy Storchaka
Serhiy Storchaka storch...@gmail.com added the comment: Here are the results of benchmarking (numbers in MB/s). On 32-bit Linux, AMD Athlon 64 X2 4600+ @ 2.4GHz: Py2.7Py3.2Py3.3 patch utf-16le 'A'*1

[issue14624] Faster utf-16 decoder

2012-04-23 Thread Antoine Pitrou
Antoine Pitrou pit...@free.fr added the comment: 64 bit Linux, Intel Core i5-2500K @ 3.30GHz: vanilla 3.3 patched utf-16le 'A'*1 1384 (+278%) 5233 utf-16le 'A'*+'\x80' 1303 (+259%) 4684 utf-16le

[issue14624] Faster utf-16 decoder

2012-04-20 Thread Arfrever Frehtes Taifersar Arahesis
Changes by Arfrever Frehtes Taifersar Arahesis arfrever@gmail.com: -- nosy: +Arfrever ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue14624 ___

[issue14624] Faster utf-16 decoder

2012-04-20 Thread Andrew Svetlov
Changes by Andrew Svetlov andrew.svet...@gmail.com: -- nosy: +asvetlov ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue14624 ___ ___

[issue14624] Faster utf-16 decoder

2012-04-19 Thread Serhiy Storchaka
New submission from Serhiy Storchaka storch...@gmail.com: I propose a patch, which accelerates the utf-16 decoder. With PEP 393 utf-16 decoder slowed down a few times (3-4x), this patch returns the performance at the level of Python 3.2 and even higher (+10-30% over 3.2). In addition, it

[issue14624] Faster utf-16 decoder

2012-04-19 Thread STINNER Victor
Changes by STINNER Victor victor.stin...@gmail.com: -- nosy: +pitrou ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue14624 ___ ___ Python-bugs-list

[issue14624] Faster utf-16 decoder

2012-04-19 Thread STINNER Victor
Changes by STINNER Victor victor.stin...@gmail.com: -- nosy: +haypo ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue14624 ___ ___ Python-bugs-list

[issue14624] Faster utf-16 decoder

2012-04-19 Thread STINNER Victor
STINNER Victor victor.stin...@gmail.com added the comment: See also #14625 for UTF-32 decoder. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue14624 ___

[issue14624] Faster utf-16 decoder

2012-04-19 Thread Serhiy Storchaka
Serhiy Storchaka storch...@gmail.com added the comment: See also issue #14579 for utf-16 decoder bugs. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue14624 ___

[issue14624] Faster utf-16 decoder

2012-04-19 Thread Martin v . Löwis
Martin v. Löwis mar...@v.loewis.de added the comment: Serhiy: can you please submit a contributor form? -- nosy: +loewis ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue14624 ___