On Tuesday, 31 July 2012 at 21:10:52 UTC, Philippe Sigaud wrote:
I've only glimpsed at your code. For most languages lexing is
far more
expensive then parsing
Is that so?
I have no numbers. It's a statement that I found in some (1-3)
sources about parsing. I'll share if I can find them.
and thus the lexer has to be very fast and I wouldn't
pursue your approach and instead use something like ragel. It
already has D
output but needs a separate build step.
Having std.lexer in Phobos would be quite good. With a
pre-compiled lexer for D.
Yeah.