Re: Standard Tokenizer Question

2007-06-26 Thread John Paul Sondag
erence StandardTokenizer.java, about line 73. Andy -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of John Paul Sondag Sent: Wednesday, June 27, 2007 10:04 AM To: java-user@lucene.apache.org Subject: Re: Standard Tokenizer Question That solves getting the actual te

RE: Standard Tokenizer Question

2007-06-26 Thread Liu_Andy2
Behalf Of John Paul Sondag Sent: Wednesday, June 27, 2007 10:04 AM To: java-user@lucene.apache.org Subject: Re: Standard Tokenizer Question That solves getting the actual text but Token. My other problem is that Token also has "startOffset" and "endOffset" fields.Standard To

Re: Standard Tokenizer Question

2007-06-26 Thread John Paul Sondag
That solves getting the actual text but Token. My other problem is that Token also has "startOffset" and "endOffset" fields.Standard Token has "startColumn/Line" and "endColumn/Line" but I was not exactly sure how to use these. Could you possibly give me a small example of using these? I th

RE: Standard Tokenizer Question

2007-06-26 Thread Liu_Andy2
Token.termText() perhaps is the same as st.getToken(y).image Andy -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of John Paul Sondag Sent: Wednesday, June 27, 2007 9:32 AM To: java-user@lucene.apache.org Subject: Standard Tokenizer Question Hey, I Think th