Terry J. Reedy <tjre...@udel.edu> added the comment:
The question in the issue for tokenizer and virtual newlines is mimicking the C tokenizer versus consistency between and within token 5-tuples. As a tokenizer user, I would lean toward consistency but it is definitely not my call. https://github.com/python/cpython/pull/24260/files has several tokenize.c warnings like this: '=': conversion from '__int64' to 'int', possible loss of data ---------- nosy: +gvanrossum, lys.nikolaou, pablogsal, terry.reedy type: -> behavior versions: -Python 3.6, Python 3.7 _______________________________________ Python tracker <rep...@bugs.python.org> <https://bugs.python.org/issue42974> _______________________________________ _______________________________________________ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
