> This looks like a good idea, thanks! >> If a given Tokenizer does not need to do any character normalization (I would think most wouldn't) is there any added cost during tokenization with this change?
Thank you for your reply, Mike! There is no added cost if Tokenizer doesn't need to call correctOffset(). Koji --------------------------------------------------------------------- To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
