STINNER Victor added the comment:
Another example from Tools/i18n/pygettext.py, TokenEater::
def __call__(self, ttype, tstring, stup, etup, line):
# dispatch
## import token
## print >> sys.stderr, 'ttype:', token.tok_name[ttype], \
## 'tstring:', tstring
self.__state(ttype, tstring, stup[0])
...
eater.set_filename(filename)
try:
tokens = tokenize.tokenize(fp.readline)
for _token in tokens:
eater(*_token)
Another example using token.tok_name with token types coming from tokenize.
----------
_______________________________________
Python tracker <[email protected]>
<http://bugs.python.org/issue25324>
_______________________________________
_______________________________________________
Python-bugs-list mailing list
Unsubscribe:
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
