I need a tokenizer that tokenizes a keyword as follows: Consider an example "President day" - this should be tokenized as "President day", "President", "Day" This seems to be a functionality of a keyword tokenizer and whitespace tokenizer Do we have any tokenizer that does this job or we need to write a custom one?
-- View this message in context: http://www.nabble.com/Tokenizer-Question-tp21295325p21295325.html Sent from the Lucene - General mailing list archive at Nabble.com.
