Author: Sebastian Pawlu? <sebastian.paw...@gmail.com> Branch: lexer_token_position_class Changeset: r71041:401c05e2904d Date: 2014-04-28 15:55 +0200 http://bitbucket.org/pypy/pypy/changeset/401c05e2904d/
Log: new line diff --git a/rpython/rlib/parsing/lexer.py b/rpython/rlib/parsing/lexer.py --- a/rpython/rlib/parsing/lexer.py +++ b/rpython/rlib/parsing/lexer.py @@ -207,5 +207,6 @@ source_pos = self.token_position_class(index, self.lineno, self.columnno) if eof: return self.token_class("EOF", "EOF", source_pos) + return self.token_class(self.automaton.names[self.last_matched_state], text, source_pos) _______________________________________________ pypy-commit mailing list pypy-commit@python.org https://mail.python.org/mailman/listinfo/pypy-commit