Reviewers: dcarney,
Message:
Committed patchset #1 manually as r17282 (presubmit successful).
Description:
Experimental parser: unify regex handling with the baseline.
BUG=
[email protected]
Committed: https://code.google.com/p/v8/source/detail?r=17282
Please review this at https://codereview.chromium.org/32063002/
SVN Base: https://v8.googlecode.com/svn/branches/experimental/parser
Affected files (+5, -3 lines):
M src/lexer/lexer.re
Index: src/lexer/lexer.re
diff --git a/src/lexer/lexer.re b/src/lexer/lexer.re
index
774f5a74f0816e44aec0d7b2bf1869ab209bfece..b67acf27e84ba9b8af68a2aa056e53eb37e96314
100644
--- a/src/lexer/lexer.re
+++ b/src/lexer/lexer.re
@@ -195,9 +195,10 @@ start_:
any = [\000-\377];
whitespace_char = [ \t\v\f\r];
whitespace = whitespace_char+;
- identifier_start_ = [$_\\a-zA-Z];
- identifier_char = [$_\\a-zA-Z0-9];
+ identifier_start_ = [$_a-zA-Z];
+ identifier_char = [$_a-zA-Z0-9];
not_identifier_char = any\identifier_char;
+ illegal_after_identifier = [\\];
line_terminator = [\n\r]+;
digit = [0-9];
hex_digit = [0-9a-fA-F];
@@ -319,7 +320,7 @@ start_:
<Normal> identifier_start_ :=> Identifier
<Normal> eof { PUSH_EOF_AND_RETURN();}
- <Normal> any { TERMINATE_ILLEGAL(); }
+ <Normal> any { PUSH_TOKEN(Token::ILLEGAL); }
<DoubleQuoteString> "\\\"" { goto yy0; }
<DoubleQuoteString> '"' { PUSH_TOKEN(Token::STRING);}
@@ -338,6 +339,7 @@ start_:
<SingleQuoteString> any { goto yy0; }
<Identifier> identifier_char+ { goto yy0; }
+ <Identifier> illegal_after_identifier { PUSH_TOKEN(Token::ILLEGAL); }
<Identifier> any {
PUSH_TOKEN_LOOKAHEAD(Token::IDENTIFIER); }
<SingleLineComment> line_terminator { PUSH_LINE_TERMINATOR();}
--
--
v8-dev mailing list
[email protected]
http://groups.google.com/group/v8-dev
---
You received this message because you are subscribed to the Google Groups "v8-dev" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
For more options, visit https://groups.google.com/groups/opt_out.
