erence StandardTokenizer.java, about line 73.
Andy
-Original Message-
From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of John
Paul Sondag
Sent: Wednesday, June 27, 2007 10:04 AM
To: [email protected]
Subject: Re: Standard Tokenizer Question
That solves getting the actual te
Behalf Of John
Paul Sondag
Sent: Wednesday, June 27, 2007 10:04 AM
To: [email protected]
Subject: Re: Standard Tokenizer Question
That solves getting the actual text but Token. My other problem is that
Token also has "startOffset" and "endOffset" fields.Standard To
--Original Message-
From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of John
Paul Sondag
Sent: Wednesday, June 27, 2007 9:32 AM
To: [email protected]
Subject: Standard Tokenizer Question
Hey,
I Think this is where I ask this.
I'm pretty new to this so this is probably a du
Token.termText() perhaps is the same as st.getToken(y).image
Andy
-Original Message-
From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of John
Paul Sondag
Sent: Wednesday, June 27, 2007 9:32 AM
To: [email protected]
Subject: Standard Tokenizer Question
Hey,
I Think
Hey,
I Think this is where I ask this.
I'm pretty new to this so this is probably a dumb question.
I'm using the StandardTokenizer class to turn a file into tokens. I then
need to be able to later skip to a specific token in the file sent to me
from another source. So say my StandardTokenizer