[issue24339] iso6937 encoding missing
John Helour added the comment: Performance issue resolved, more info on error added. I've checked encoding and decoding on a two UTF-8 ~3MiB txt files. Except the first BOM mark (May I ignore it?) all seems work OK. -- ___ Python tracker <http://bugs.python.org/issue24339> ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue24339] iso6937 encoding missing
Changes by John Helour : Added file: http://bugs.python.org/file45750/iso6937.py ___ Python tracker <http://bugs.python.org/issue24339> ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue24339] iso6937 encoding missing
Changes by John Helour : Removed file: http://bugs.python.org/file45740/iso6937.py ___ Python tracker <http://bugs.python.org/issue24339> ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue24339] iso6937 encoding missing
Changes by John Helour : Added file: http://bugs.python.org/file45749/check_iso6937.py ___ Python tracker <http://bugs.python.org/issue24339> ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue24339] iso6937 encoding missing
Changes by John Helour : Added file: http://bugs.python.org/file45740/iso6937.py ___ Python tracker <http://bugs.python.org/issue24339> ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue24339] iso6937 encoding missing
Changes by John Helour : Removed file: http://bugs.python.org/file45708/iso6937.py ___ Python tracker <http://bugs.python.org/issue24339> ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue24339] iso6937 encoding missing
John Helour added the comment: Please ignore my previous question about: tmp += bytearray(encoding_map[c], 'latin1', 'ignore') The latest version don't needs such encoding ... -- Added file: http://bugs.python.org/file45708/iso6937.py ___ Python tracker <http://bugs.python.org/issue24339> ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue24339] iso6937 encoding missing
Changes by John Helour : Removed file: http://bugs.python.org/file45707/iso6937.py ___ Python tracker <http://bugs.python.org/issue24339> ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue24339] iso6937 encoding missing
Changes by John Helour : Added file: http://bugs.python.org/file45707/iso6937.py ___ Python tracker <http://bugs.python.org/issue24339> ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue24339] iso6937 encoding missing
Changes by John Helour : Added file: http://bugs.python.org/file45706/iso6937.py ___ Python tracker <http://bugs.python.org/issue24339> ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue24339] iso6937 encoding missing
Changes by John Helour : Removed file: http://bugs.python.org/file45706/iso6937.py ___ Python tracker <http://bugs.python.org/issue24339> ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue24339] iso6937 encoding missing
Changes by John Helour : Removed file: http://bugs.python.org/file45697/iso6937.py ___ Python tracker <http://bugs.python.org/issue24339> ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue24339] iso6937 encoding missing
John Helour added the comment: > Please also check whether it's not possible to reuse the charmap codec > functions we have I've found nothing useful, maybe you (as the author) can find something really useful which can improve code readability or increase the performance. Please look at the newest codec version, particularly on line: tmp += bytearray(encoding_map[c], 'latin1', 'ignore') It is about extended ascii inheritance. Is it reliable and fast enough? -- Added file: http://bugs.python.org/file45697/iso6937.py ___ Python tracker <http://bugs.python.org/issue24339> ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue24339] iso6937 encoding missing
John Helour added the comment: If I take the ISO_6937 file as a template for encoding table then increasing the range 0x20..0x7f to 0x00..0xA0 is the simplest solution. -- Added file: http://bugs.python.org/file45654/iso6937.py ___ Python tracker <http://bugs.python.org/issue24339> ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue24339] iso6937 encoding missing
John Helour added the comment: If I take the ISO_6937 file as a template for encoding table then increasing the range 0x20..0x7f to 0x00..0xA0 is the simplest solution. -- ___ Python tracker <http://bugs.python.org/issue24339> ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue24339] iso6937 encoding missing
Changes by John Helour : Removed file: http://bugs.python.org/file45647/iso6937.py ___ Python tracker <http://bugs.python.org/issue24339> ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue24339] iso6937 encoding missing
John Helour added the comment: @mdk Big thanks for the checker. >Looks like your implementation is missing some codepoints, like "\t": > >>>> >print("\t".encode(encoding='iso6937')) > >[...] >UnicodeError: encoding with 'iso6937' codec failed (UnicodeError: > Unacceptable utf-8 character) The '\t' character is undefined in the iso6937 table, like all chars within the range 0x00 - 0x1F. I don't know how to handle such input for conversion. -- ___ Python tracker <http://bugs.python.org/issue24339> ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue24339] iso6937 encoding missing
John Helour added the comment: PEP8 compliant, added missing codepoints, utf-8 to \u rewrited -- Added file: http://bugs.python.org/file45647/iso6937.py ___ Python tracker <http://bugs.python.org/issue24339> ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue24339] iso6937 encoding missing
Changes by John Helour : Removed file: http://bugs.python.org/file39575/iso6937.py ___ Python tracker <http://bugs.python.org/issue24339> ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue24339] iso6937 encoding missing
Changes by John Helour : Added file: http://bugs.python.org/file39633/iso6937.py ___ Python tracker <http://bugs.python.org/issue24339> ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue24339] iso6937 encoding missing
Changes by John Helour : Removed file: http://bugs.python.org/file39632/iso6937.py ___ Python tracker <http://bugs.python.org/issue24339> ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue24339] iso6937 encoding missing
Changes by John Helour : Removed file: http://bugs.python.org/file39583/iso6937.py ___ Python tracker <http://bugs.python.org/issue24339> ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue24339] iso6937 encoding missing
Changes by John Helour : Removed file: http://bugs.python.org/file39631/iso6937.py ___ Python tracker <http://bugs.python.org/issue24339> ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue24339] iso6937 encoding missing
Changes by John Helour : Added file: http://bugs.python.org/file39632/iso6937.py ___ Python tracker <http://bugs.python.org/issue24339> ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue24339] iso6937 encoding missing
Changes by John Helour : Added file: http://bugs.python.org/file39631/iso6937.py ___ Python tracker <http://bugs.python.org/issue24339> ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue24339] iso6937 encoding missing
John Helour added the comment: I've rewrote the iso6937 codec into Python 3. Could someone check it please? -- Added file: http://bugs.python.org/file39583/iso6937.py ___ Python tracker <http://bugs.python.org/issue24339> ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue24339] iso6937 encoding missing
New submission from John Helour: Please add encoding for the iso6937 charset. Many settopboxes (DVB-T/S) and relevant devices uses it for displaying EPG, videotext, etc. I've wrote (please look at the attached file) the encoding/decoding conversion codec some years ago. -- components: Library (Lib) files: iso6937.py messages: 244538 nosy: John Helour priority: normal severity: normal status: open title: iso6937 encoding missing type: enhancement versions: Python 2.7 Added file: http://bugs.python.org/file39575/iso6937.py ___ Python tracker <http://bugs.python.org/issue24339> ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com