[issue17909] Autodetecting JSON encoding

miss-islington added the comment: New changeset 21f2553482c3d6ec8beb8bfa0f1fb5d23c6a4c2f by Miss Islington (bot) in branch '3.6': bpo-17909: Document that json.load can accept a binary IO (GH-7366) https://github.com/python/cpython/commit/21f2553482c3d6ec8beb8bfa0f1fb5d23c6a4c2f --

[issue17909] Autodetecting JSON encoding

miss-islington added the comment: New changeset f38ace61a39e64f5fde6f8f402e258177bdf7ff4 by Miss Islington (bot) in branch '3.7': bpo-17909: Document that json.load can accept a binary IO (GH-7366) https://github.com/python/cpython/commit/f38ace61a39e64f5fde6f8f402e258177bdf7ff4 --

[issue17909] Autodetecting JSON encoding

Change by miss-islington : -- pull_requests: +7098 ___ Python tracker ___ ___ Python-bugs-list mailing list Unsubscribe:

[issue17909] Autodetecting JSON encoding

Change by miss-islington : -- pull_requests: +7097 ___ Python tracker ___ ___ Python-bugs-list mailing list Unsubscribe:

[issue17909] Autodetecting JSON encoding

INADA Naoki added the comment: New changeset bb6366bd7570ff3b74bc66095540bea78f31504e by INADA Naoki (Anthony Sottile) in branch 'master': bpo-17909: Document that json.load can accept a binary IO (GH-7366) https://github.com/python/cpython/commit/bb6366bd7570ff3b74bc66095540bea78f31504e

[issue17909] Autodetecting JSON encoding

Change by Anthony Sottile : -- pull_requests: +6992 ___ Python tracker ___ ___ Python-bugs-list mailing list Unsubscribe:

[issue17909] Autodetecting JSON encoding

Changes by Nick Coghlan : -- stage: commit review -> resolved status: open -> closed ___ Python tracker ___

[issue17909] Autodetecting JSON encoding

Nick Coghlan added the comment: Thanks for tackling this Serhiy! I removed issue 13916 from the dependency list, as while that's a reasonable suggestion, I don't think this fix is conditional on that change. -- dependencies: -disallow the "surrogatepass" handler for non utf-*

[issue17909] Autodetecting JSON encoding

Roundup Robot added the comment: New changeset e9e1bf9ec2ac by Nick Coghlan in branch 'default': Issue #17909: Accept binary input in json.loads https://hg.python.org/cpython/rev/e9e1bf9ec2ac -- nosy: +python-dev ___ Python tracker

[issue17909] Autodetecting JSON encoding

Nick Coghlan added the comment: Having hit the json.loads() problem recently when porting a project to Python 3, I'm keen to see this land for 3.6. Accodingly, assigning to myself to review and merge Serhiy's patch - if it proves necessary, we can tweak the details of the encoding detection

[issue17909] Autodetecting JSON encoding

Changes by Stéphane Wirtel : -- stage: patch review -> commit review ___ Python tracker ___

[issue17909] Autodetecting JSON encoding

Stéphane Wirtel added the comment: Hi Serhiy, I have reviewed your patch, it seems to be ok. -- nosy: +matrixise ___ Python tracker ___

[issue17909] Autodetecting JSON encoding

Changes by Serhiy Storchaka : -- versions: +Python 3.6 -Python 3.5 Added file: http://bugs.python.org/file43513/json_detect_encoding_3.patch ___ Python tracker

[issue17909] Autodetecting JSON encoding

Changes by Geoffrey Sneddon : -- nosy: +gsnedders ___ Python tracker ___ ___

[issue17909] Autodetecting JSON encoding

Changes by Berker Peksag berker.pek...@gmail.com: -- nosy: +berker.peksag ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue17909 ___ ___

[issue17909] Autodetecting JSON encoding

Martin Panter added the comment: If you adjusted the detect_encoding() logic according to Pete Cordell’s table at the bottom of http://www.ietf.org/mail-archive/web/json/current/msg01959.html, it might work for standalone strings. However since the RFC encourages UTF-8 for best

[issue17909] Autodetecting JSON encoding

Changes by Martin Panter vadmium...@gmail.com: -- nosy: +vadmium ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue17909 ___ ___ Python-bugs-list

[issue17909] Autodetecting JSON encoding

Changes by STINNER Victor victor.stin...@gmail.com: -- nosy: +haypo ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue17909 ___ ___ Python-bugs-list

[issue17909] Autodetecting JSON encoding

Serhiy Storchaka added the comment: All dependencies for this issue are resolved now. Here is updated patch, synchronized with tip. -- Added file: http://bugs.python.org/file35258/json_detect_encoding_2.patch ___ Python tracker

[issue17909] Autodetecting JSON encoding

Changes by Serhiy Storchaka storch...@gmail.com: Removed file: http://bugs.python.org/file30133/json_detect_encoding.patch ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue17909 ___

[issue17909] Autodetecting JSON encoding

Chris Rebert added the comment: You'll need to also update the Character Encodings subsection of the json docs. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue17909 ___

[issue17909] Autodetecting JSON encoding

akira added the comment: Both json standard (ECMA-404) [1] and the new json rfc 7159 [2] do not mention the encoding detection. [1] http://www.ecma-international.org/publications/files/ECMA-ST/ECMA-404.pdf [2] https://tools.ietf.org/html/rfc7159#section-8.1 From the rfc: JSON text SHALL be

[issue17909] Autodetecting JSON encoding

Chris Rebert added the comment: I agree that the state of encoding detection in the new RFC seems unclear, given that the old RFC prefaced the part about the encoding detection with: Since the first two characters of a JSON text will always be ASCII characters But in the new RFC: Appendix

[issue17909] Autodetecting JSON encoding

Changes by Chris Rebert pyb...@rebertia.com: -- nosy: +cvrebert ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue17909 ___ ___ Python-bugs-list

[issue17909] Autodetecting JSON encoding

Changes by Josh Lee jlee...@gmail.com: -- nosy: +jleedev ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue17909 ___ ___ Python-bugs-list mailing list

[issue17909] Autodetecting JSON encoding

Changes by Julian Berman julian+python@grayvines.com: -- nosy: +Julian ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue17909 ___ ___

[issue17909] Autodetecting JSON encoding

Changes by Antoine Pitrou pit...@free.fr: -- nosy: +ncoghlan ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue17909 ___ ___ Python-bugs-list mailing

[issue17909] Autodetecting JSON encoding

Changes by Antoine Pitrou pit...@free.fr: -- versions: +Python 3.5 -Python 3.4 ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue17909 ___ ___

[issue17909] Autodetecting JSON encoding

Changes by Serhiy Storchaka storch...@gmail.com: -- stage: - patch review ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue17909 ___ ___

[issue17909] Autodetecting JSON encoding

New submission from Serhiy Storchaka: RFC 4627 specifies a method to determine an encoding (one of UTF-8, UTF-16(BE|LE) or UTF-32(BE|LE)) of encoded JSON text. The proposed preliminary patch (it doesn't include the documentation yet) allows load() and loads() functions accept bytes data when

[issue17909] Autodetecting JSON encoding

Changes by Serhiy Storchaka storch...@gmail.com: -- dependencies: +UTF-16 and UTF-32 codecs should reject (lone) surrogates, disallow the surrogatepass handler for non utf-* encodings ___ Python tracker rep...@bugs.python.org