Yury Selivanov added the comment: Stéphane, sorry for not replying earlier, emails from bugs.python.org sometimes go to spam.
[TokenInfo(type=55 (ASYNC), string='async', start=(1, 0), end=(1, 5), line='async def foo(): pass'), TokenInfo(type=1 (NAME), string='def', start=(1, 6), end=(1, 9), line='async def foo(): pass'), ^-- this is indeed correct. Right now async/await are treated specially in tokenizer.c & parser, and tokenize.py simply mimics their behaviour. ---------- _______________________________________ Python tracker <rep...@bugs.python.org> <http://bugs.python.org/issue25579> _______________________________________ _______________________________________________ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
