: This is index of 1, is has index 2, an has index 3 Example has index 4.
: What I have is the actual "character position" in the original text. "This"
in that case, you'll have to do a while loop over next() calls and check
the startOffset (or endOffset) of each untill you find the one you are
I thought that went to the "index" of the token. I may not understand it
completely but this is how I currently view the TokenStream
For example if my text was the following:
This is an Example
This is index of 1, is has index 2, an has index 3 Example has index 4.
What I have is the actual "c
: I never got a response to this and thought maybe I was too wordy.
:
: I'm wondering if there's a way where given a position in the original text
: you can retrieve the token index that is nearest to that position using the
: StandardToken/StandardTokenizer classes?
i may not be understanding the
Hi,
I never got a response to this and thought maybe I was too wordy.
I'm wondering if there's a way where given a position in the original text
you can retrieve the token index that is nearest to that position using the
StandardToken/StandardTokenizer classes?
--JP
On 7/3/07, John Paul Sond
