Thomas Kluyver <tho...@kluyver.me.uk> added the comment: I've opened a PR for issue #12486, which would make the existing but undocumented 'generate_tokens' function public:
https://github.com/python/cpython/pull/6957 I agree that it would be good to design a nicer API for this, but the perfect shouldn't be the enemy of the good. ---------- _______________________________________ Python tracker <rep...@bugs.python.org> <https://bugs.python.org/issue9969> _______________________________________ _______________________________________________ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com