[
https://issues.apache.org/jira/browse/LUCENE-1099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Doron Cohen resolved LUCENE-1099.
-
Resolution: Fixed
(http://www.nabble.com/Making-Tokenizer.reset%28Reader%29-public-tp14499883p14
[
https://issues.apache.org/jira/browse/LUCENE-770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12554405
]
Daniel Naber commented on LUCENE-770:
-
Otis, I've used it just once and noticed the problem. I'm not sure how to
Yeah, I think it can be made a separate issue.
-Grant
On Dec 23, 2007, at 2:36 AM, Shai Erera (JIRA) wrote:
[ https://issues.apache.org/jira/browse/LUCENE-1068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel
#action_12554174 ]
Shai Erera commented on LUCENE-1068:
-
StandardTokenizer incorrectly types certain values
--
Key: LUCENE-1100
URL: https://issues.apache.org/jira/browse/LUCENE-1100
Project: Lucene - Java
Issue Type: Bug
Components: Analys
Tokenizers should reset positionIncrement to 1 in their next(Token result)
---
Key: LUCENE-1101
URL: https://issues.apache.org/jira/browse/LUCENE-1101
Project: Lucene - Java
[
https://issues.apache.org/jira/browse/LUCENE-1101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Doron Cohen updated LUCENE-1101:
Attachment: lucene-1101.patch
Simple patch fixing this.
Planing to commit this shortly if no objec
[
https://issues.apache.org/jira/browse/LUCENE-1095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12554472
]
Doron Cohen commented on LUCENE-1095:
-
Ok I separated the tokenizers fix to LUCENE-1101.
Patch here stands-alone
[
https://issues.apache.org/jira/browse/LUCENE-1101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12554473
]
Yonik Seeley commented on LUCENE-1101:
--
Resetting tokens (including the position) is currently handled via
Tok
[
https://issues.apache.org/jira/browse/LUCENE-1101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12554474
]
Doron Cohen commented on LUCENE-1101:
-
I think I checked that and found that Token.clear() is too strong to be i
[
https://issues.apache.org/jira/browse/LUCENE-1101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12554481
]
Yonik Seeley commented on LUCENE-1101:
--
In what cases? The protocol we are currently using requires that the c
[
https://issues.apache.org/jira/browse/LUCENE-1101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12554482
]
Doron Cohen commented on LUCENE-1101:
-
Currently Token.clear() is used only for un-tokenized fields in DocmentsW
[
https://issues.apache.org/jira/browse/LUCENE-1101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Doron Cohen updated LUCENE-1101:
Attachment: lucene-1101.patch
Updated patch - Tokenizers now calling clear() as suggested.
This se
Working on Lucene-1101 I checked if SinkTokenizer.next(Token) should also
call Token.clear(). (It shouldn't, because it ignores the input token.)
However I think that calls to next() would end up creating Tokens for
nothing (by TokenStream.next()).
May currently be an empty case (if all current u
is the site javadocs link broken or is it just me?
Doron
[
https://issues.apache.org/jira/browse/LUCENE-1101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12554520
]
Yonik Seeley commented on LUCENE-1101:
--
{quote}Currently Token.clear() is used only for un-tokenized fields in
[
https://issues.apache.org/jira/browse/LUCENE-1101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12554533
]
Doron Cohen commented on LUCENE-1101:
-
{quote}
I think it's used for both tokenized and un-tokenized see lin
16 matches
Mail list logo
