[issue34979] Python throws “SyntaxError: Non-UTF-8 code start with \xe8...” when parse source file

2019-11-16 Thread susaki
susaki added the comment: duplicated with #14811 -- resolution: -> duplicate stage: patch review -> resolved status: open -> closed ___ Python tracker <https://bugs.python.or

[issue34979] Python throws “SyntaxError: Non-UTF-8 code start with \xe8...” when parse source file

2019-11-15 Thread susaki
susaki added the comment: I think this issue is duplicated with #14811, I will close it. The key point of this issue is that the size of `tok->buf` is fixed and equals to `BUFSIZ`(defined in stdio.h, have different value depends on OS). one line of code will be truncated If it’s size exce

[issue34979] Python throws “SyntaxError: Non-UTF-8 code start with \xe8...” when parse source file

2018-10-17 Thread susaki
Change by susaki : -- keywords: +patch pull_requests: +9276 stage: -> patch review ___ Python tracker <https://bugs.python.org/issue34979> ___ ___ Python-