Serhiy Storchaka added the comment:
The regular expression tokenize.Funny also can be generated. Information is not
enough for distinguish between Operator, Bracket and Special, but seems this
isn't needed.
Some token names can be generated from Grammar/Grammar. But needed an
additional mapping for relations between token strings and names ('+' <-> PLUS,
etc).
----------
_______________________________________
Python tracker <rep...@bugs.python.org>
<http://bugs.python.org/issue30455>
_______________________________________
_______________________________________________
Python-bugs-list mailing list
Unsubscribe:
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
