On Saturday 16 May 2009 12:52:13 Jesper Larsson wrote: > On Sat, 2009-05-16 at 08:27 +0530, Indhu Bharathi wrote: > > This is because on seeing 'f' of foo lexer has two options - 1. IDENT > > 2. URL. And it takes the second options since that seems to be longer > > that the first alternative. Note that the lexer always tries to match > > the longest token possible.
but it fails to do so here. > > I can understand the motivation of this restriction in the interest of > keeping the lexer target code at a certain complexity level, but I have > not seen it stated in the documentation. It would have been nice if the > lexer generator had issued a warning. right. I don't like that behavior too, maybe it's because the antlr lexer is similar to a recursive descent parser. I think it should just return the longest match. Michael List: http://www.antlr.org/mailman/listinfo/antlr-interest Unsubscribe: http://www.antlr.org/mailman/options/antlr-interest/your-email-address --~--~---------~--~----~------------~-------~--~----~ You received this message because you are subscribed to the Google Groups "il-antlr-interest" group. To post to this group, send email to [email protected] To unsubscribe from this group, send email to [email protected] For more options, visit this group at http://groups.google.com/group/il-antlr-interest?hl=en -~----------~----~----~----~------~----~------~--~---
