Gareth Rees <g...@garethrees.org> added the comment:

These errors are generated directly by the tokenizer. In tokenizer.c, the 
tokenizer generates ERRORTOKEN when it encounters something it can't tokenize. 
This causes parsetok() in parsetok.c to stop tokenizing and return an error.

----------

_______________________________________
Python tracker <rep...@bugs.python.org>
<http://bugs.python.org/issue12675>
_______________________________________
_______________________________________________
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

Reply via email to