Serhiy Storchaka storch...@gmail.com added the comment:
Thank you, Antoine. Now only issue14625 waits for review.
changeset: 77012:3430d7329a3b
+* UTF-8 and UTF-16 decoding is now 2x to 4x faster.
In fact now UTF-16 decoding faster for a maximum of +25% compared to Python 3.2
on my
Serhiy Storchaka storch...@gmail.com added the comment:
Here are two new patch. Checking for characters out-of-range moved,
making the code simpler. Theoretically it is a bit slow down decoding of
short UCS1 strings (up to 1 and 3 chars on 32- and 64-bit), but
practically there is no difference.
Roundup Robot devn...@psf.upfronthosting.co.za added the comment:
New changeset cdcc816dea85 by Antoine Pitrou in branch 'default':
Issue #14624: UTF-16 decoding is now 3x to 4x faster on various inputs.
http://hg.python.org/cpython/rev/cdcc816dea85
--
Antoine Pitrou pit...@free.fr added the comment:
Thank you Serhiy! Now committed.
--
resolution: - fixed
stage: - committed/rejected
status: open - closed
___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue14624
Serhiy Storchaka storch...@gmail.com added the comment:
The patch updated with a little clarified code and added comments.
--
Added file: http://bugs.python.org/file25590/decode_utf16_4.patch
___
Python tracker rep...@bugs.python.org
Antoine Pitrou pit...@free.fr added the comment:
New performance figures under 64 bit Linux, Intel Core i5-2500K @ 3.30GHz:
vanilla 3.3 patched
utf-16le 'A'*1 1411 (+290%) 5504
utf-16le 'A'*+'\x80'
Serhiy Storchaka storch...@gmail.com added the comment:
The patch updated to stylistic conformity of the UTF-8 decoder. The decoding of
the UCS2 non-surrogate characters a little speed up (+15%).
--
Added file: http://bugs.python.org/file25536/decode_utf16_3.patch
Changes by Serhiy Storchaka storch...@gmail.com:
--
components: +Unicode
nosy: +ezio.melotti
___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue14624
___
Roundup Robot devn...@psf.upfronthosting.co.za added the comment:
New changeset 830eeff4fe8f by Victor Stinner in branch 'default':
Issue #14624, #14687: Optimize unicode_widen()
http://hg.python.org/cpython/rev/830eeff4fe8f
--
nosy: +python-dev
___
Serhiy Storchaka storch...@gmail.com added the comment:
Here is updated patch, taking into account that unicode_widen is already
optimized.
--
Added file: http://bugs.python.org/file25443/decode_utf16_2.patch
___
Python tracker rep...@bugs.python.org
Serhiy Storchaka storch...@gmail.com added the comment:
Here are the results of benchmarking (numbers in MB/s).
On 32-bit Linux, AMD Athlon 64 X2 4600+ @ 2.4GHz:
Py2.7Py3.2Py3.3
patch
utf-16le 'A'*1
Antoine Pitrou pit...@free.fr added the comment:
64 bit Linux, Intel Core i5-2500K @ 3.30GHz:
vanilla 3.3 patched
utf-16le 'A'*1 1384 (+278%) 5233
utf-16le 'A'*+'\x80' 1303 (+259%) 4684
utf-16le
Changes by Arfrever Frehtes Taifersar Arahesis arfrever@gmail.com:
--
nosy: +Arfrever
___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue14624
___
Changes by Andrew Svetlov andrew.svet...@gmail.com:
--
nosy: +asvetlov
___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue14624
___
___
New submission from Serhiy Storchaka storch...@gmail.com:
I propose a patch, which accelerates the utf-16 decoder. With PEP 393 utf-16
decoder slowed down a few times (3-4x), this patch returns the performance at
the level of Python 3.2 and even higher (+10-30% over 3.2).
In addition, it
Changes by STINNER Victor victor.stin...@gmail.com:
--
nosy: +pitrou
___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue14624
___
___
Python-bugs-list
Changes by STINNER Victor victor.stin...@gmail.com:
--
nosy: +haypo
___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue14624
___
___
Python-bugs-list
STINNER Victor victor.stin...@gmail.com added the comment:
See also #14625 for UTF-32 decoder.
--
___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue14624
___
Serhiy Storchaka storch...@gmail.com added the comment:
See also issue #14579 for utf-16 decoder bugs.
--
___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue14624
___
Martin v. Löwis mar...@v.loewis.de added the comment:
Serhiy: can you please submit a contributor form?
--
nosy: +loewis
___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue14624
___
20 matches
Mail list logo