Re: Standard Tokenizer Question

2007-06-26 Thread John Paul Sondag
erence StandardTokenizer.java, about line 73. Andy -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of John Paul Sondag Sent: Wednesday, June 27, 2007 10:04 AM To: [email protected] Subject: Re: Standard Tokenizer Question That solves getting the actual te

RE: Standard Tokenizer Question

2007-06-26 Thread Liu_Andy2
Behalf Of John Paul Sondag Sent: Wednesday, June 27, 2007 10:04 AM To: [email protected] Subject: Re: Standard Tokenizer Question That solves getting the actual text but Token. My other problem is that Token also has "startOffset" and "endOffset" fields.Standard To

Re: Standard Tokenizer Question

2007-06-26 Thread John Paul Sondag
--Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of John Paul Sondag Sent: Wednesday, June 27, 2007 9:32 AM To: [email protected] Subject: Standard Tokenizer Question Hey, I Think this is where I ask this. I'm pretty new to this so this is probably a du

RE: Standard Tokenizer Question

2007-06-26 Thread Liu_Andy2
Token.termText() perhaps is the same as st.getToken(y).image Andy -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of John Paul Sondag Sent: Wednesday, June 27, 2007 9:32 AM To: [email protected] Subject: Standard Tokenizer Question Hey, I Think

Standard Tokenizer Question

2007-06-26 Thread John Paul Sondag
Hey, I Think this is where I ask this. I'm pretty new to this so this is probably a dumb question. I'm using the StandardTokenizer class to turn a file into tokens. I then need to be able to later skip to a specific token in the file sent to me from another source. So say my StandardTokenizer