All of the lexer rules appear as alternatives (in order of definition) in a synthesized top-level Tokens rule; lexers do not use FOLLOW sets, and this sometimes causes problems.
--Loring > >From: "Sylvain, Gregory [USA]" <[email protected]> >To: "[email protected]" <[email protected]> >Sent: Thursday, September 10, 2009 11:02:22 AM >Subject: [antlr-interest] Looking for reference to how ANTLR performs >Lexing.... > > >Hello >all, > >I have a bunch of >questions about how ANTLR (v3) is lexing it's input stream. I am >continually chasing bugs about how ANTLR lexed some text as one token when I >was >expecting it to Lex it as another token. > >I've checked out >this list and elsewhere on the ANTLR.org site for references to lexical >analysis >and how ANTLR is doing it, but I have not found much. > >Specifically, I am >trying to understand the order of evaluation of the lexer rules and how ANTLR >combines them in order complete the analysis of it's given >input. > >Thanks in advance >for any clues or references. >Greg > --~--~---------~--~----~------------~-------~--~----~ You received this message because you are subscribed to the Google Groups "il-antlr-interest" group. To post to this group, send email to [email protected] To unsubscribe from this group, send email to [email protected] For more options, visit this group at http://groups.google.com/group/il-antlr-interest?hl=en -~----------~----~----~----~------~----~------~--~---
List: http://www.antlr.org/mailman/listinfo/antlr-interest Unsubscribe: http://www.antlr.org/mailman/options/antlr-interest/your-email-address
