[issue15054] bytes literals erroneously tokenized

2012-06-16 Thread Ezio Melotti
Changes by Ezio Melotti ezio.melo...@gmail.com: -- nosy: +ezio.melotti stage: - needs patch ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue15054 ___

[issue15054] bytes literals erroneously tokenized

2012-06-16 Thread Serhiy Storchaka
Serhiy Storchaka storch...@gmail.com added the comment: Here is a patch (for Python 3.3). -- keywords: +patch nosy: +storchaka Added file: http://bugs.python.org/file26025/tokenize_bytes.patch ___ Python tracker rep...@bugs.python.org

[issue15054] bytes literals erroneously tokenized

2012-06-16 Thread Serhiy Storchaka
Serhiy Storchaka storch...@gmail.com added the comment: Here is a patch for Python 2. -- Added file: http://bugs.python.org/file26026/tokenize_bytes_py2.patch ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue15054

[issue15054] bytes literals erroneously tokenized

2012-06-16 Thread Serhiy Storchaka
Changes by Serhiy Storchaka storch...@gmail.com: Removed file: http://bugs.python.org/file26025/tokenize_bytes.patch ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue15054 ___

[issue15054] bytes literals erroneously tokenized

2012-06-16 Thread Serhiy Storchaka
Serhiy Storchaka storch...@gmail.com added the comment: And here is a better patch for Python 3. -- Added file: http://bugs.python.org/file26027/tokenize_bytes_py3.patch ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue15054

[issue15054] bytes literals erroneously tokenized

2012-06-16 Thread Serhiy Storchaka
Changes by Serhiy Storchaka storch...@gmail.com: Removed file: http://bugs.python.org/file26027/tokenize_bytes_py3.patch ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue15054 ___

[issue15054] bytes literals erroneously tokenized

2012-06-16 Thread Serhiy Storchaka
Serhiy Storchaka storch...@gmail.com added the comment: And here is an even better patch for Python 3. -- Added file: http://bugs.python.org/file26028/tokenize_bytes_py3.patch ___ Python tracker rep...@bugs.python.org

[issue15054] bytes literals erroneously tokenized

2012-06-16 Thread Éric Araujo
Changes by Éric Araujo mer...@netwok.org: -- nosy: +meador.inge stage: needs patch - test needed ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue15054 ___

[issue15054] bytes literals erroneously tokenized

2012-06-16 Thread Serhiy Storchaka
Serhiy Storchaka storch...@gmail.com added the comment: Patches updated with tests. -- Added file: http://bugs.python.org/file26031/tokenize_bytes_py2-2.patch Added file: http://bugs.python.org/file26032/tokenize_bytes_py3-2.patch ___ Python tracker

[issue15054] bytes literals erroneously tokenized

2012-06-16 Thread Antoine Pitrou
Changes by Antoine Pitrou pit...@free.fr: -- stage: test needed - patch review ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue15054 ___ ___

[issue15054] bytes literals erroneously tokenized

2012-06-16 Thread Meador Inge
Meador Inge mead...@gmail.com added the comment: The Python 3 patch looks OK, except that several of the tests are duplicated. I am looking at the Python 2 patch now. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue15054

[issue15054] bytes literals erroneously tokenized

2012-06-16 Thread Meador Inge
Meador Inge mead...@gmail.com added the comment: Nevermind, the tests are OK. I missed the swapped quotes. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue15054 ___

[issue15054] bytes literals erroneously tokenized

2012-06-16 Thread Serhiy Storchaka
Serhiy Storchaka storch...@gmail.com added the comment: The Python 3 patch looks OK, except that several of the tests are duplicated. What tests? -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue15054

[issue15054] bytes literals erroneously tokenized

2012-06-16 Thread Meador Inge
Meador Inge mead...@gmail.com added the comment: Python 2 patch looks OK too. I will commit these later today. Thanks for the patches! -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue15054

[issue15054] bytes literals erroneously tokenized

2012-06-16 Thread Florent Xicluna
Florent Xicluna florent.xicl...@gmail.com added the comment: LGTM too. Thanks. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue15054 ___ ___

[issue15054] bytes literals erroneously tokenized

2012-06-16 Thread Roundup Robot
Roundup Robot devn...@psf.upfronthosting.co.za added the comment: New changeset 35d3a8ed7997 by Meador Inge in branch '2.7': Issue #15054: Fix incorrect tokenization of 'b' and 'br' string literals. http://hg.python.org/cpython/rev/35d3a8ed7997 New changeset 115b0cb52c6c by Meador Inge in

[issue15054] bytes literals erroneously tokenized

2012-06-16 Thread Meador Inge
Changes by Meador Inge mead...@gmail.com: -- resolution: - fixed stage: patch review - committed/rejected status: open - closed versions: -Python 3.2 ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue15054

[issue15054] bytes literals erroneously tokenized

2012-06-13 Thread Florent Xicluna
New submission from Florent Xicluna florent.xicl...@gmail.com: With Python 2.7, both b'hello' and br'hello' are wrong. With Python 3.3, b'hello' is wrong. $ python2.7 -m tokenize 'hello', u'hello', ur'hello', b'hello', br'hello' 1,0-1,7:STRING 'hello' 1,7-1,8:OP ','

[issue15054] bytes literals erroneously tokenized

2012-06-13 Thread Antoine Pitrou
Changes by Antoine Pitrou pit...@free.fr: -- nosy: +benjamin.peterson ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue15054 ___ ___ Python-bugs-list