On Feb 16, 2004, at 6:12 AM, [EMAIL PROTECTED] wrote:
On Monday 16 February 2004 12:02, Viparthi, Kiran (AFIS) wrote:
As mentioned I didn't use any information from index so I didn't uses any
TokenStream but let me check it out.

deprecated:


String description = doc.getField("contents").stringValue();

What is the value of description here?


final java.io.Reader r = new StringReader(description);
final TokenStream in = analyzer.tokenStream(r);

And what analyzer are you using here?


for (Token token; (token = in.next()) != null; )
{
        System.out.println(token.termText());
}

But the result is the same, the words are actually truncated (instead of
"has", "had", "have", etc. only "ha") :-(


---------------------------------------------------------------------
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]


---------------------------------------------------------------------
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]



Reply via email to