Vlad Riscutia <riscutiav...@gmail.com> added the comment:

How come tokenizer module is not based on actual C tokenizer? Wouldn't that 
make more sense (and prevent this kind of issues)?

----------
nosy: +vladris

_______________________________________
Python tracker <rep...@bugs.python.org>
<http://bugs.python.org/issue12675>
_______________________________________
_______________________________________________
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

Reply via email to