Re: Retrieving Tokens

2007-12-20 Thread Erick Erickson
I think that what Yonik wants is a higher-level response. *Why* do you want to process the tokens later? What is the use case you're trying to satisfy? Best Erick On Dec 20, 2007 1:37 AM, Rishabh Joshi [EMAIL PROTECTED] wrote: What are you trying to do with the tokens? Yonik, we wanted a

Re: Retrieving Tokens

2007-12-20 Thread Eswar K
Yonik/Erick, We are building a custome Search which is to be done in 2 parts executed at different points of time. As a result of it, the first step we want tokenize the information and store it, which we want to retrieve a later point of time for further processing and then store it back into

Retrieving Tokens

2007-12-19 Thread Rishabh Joshi
Hi, I have created my own Tokenizer and I am indexing the documents using the same. I wanted to know if there is a way to retrieve the tokens (created by my custom tokenizer) from the index. Do we have to modify the code to get these tokens? Regards, Rishabh