> Ok, maybe I misled a point a bit. But Brian's proposal as I see it was to
> _group_ two tokenizers that differ in a single thing. 

I don't think that's what I was proposing...  I was recognizing that
sometimes the analysis process is a composite one, and I was advocating
that the composition be made explicit since there are some cases where
only tokenization, but not normalization, is desired.  


--
To unsubscribe, e-mail:   <mailto:[EMAIL PROTECTED]>
For additional commands, e-mail: <mailto:[EMAIL PROTECTED]>

Reply via email to