Re: Perl's parser and lexer will likely be in Perl (was Re: RFC 334 (v1) I'm {STILL} trying to understand this...)

[Nicholas Clark]

On Tue, Oct 17, 2000 at 11:00:35AM +0100, Simon Cozens wrote:
> On Tue, Oct 17, 2000 at 10:37:24AM +0100, Simon Cozens wrote:
> > What should the tokeniser return for "foo"? 
> 
> Uh, tokenizer != lexer. Insert coffee. Yes, writing a tokeniser in a regexp
> should be very doable.

To allow the lexer to influence the tokeniser, what characters are we
going to use in (? ) for smoke and mirrors extensions? (?s) and (?m) are
already taken.

[Seriously, I was under the impression that the perl tokenizer was
influenced by the state of the lexer]

Nicholas Clark