[
https://issues.apache.org/jira/browse/LUCENE-4656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13542995#comment-13542995
]
Adrien Grand commented on LUCENE-4656:
--------------------------------------
bq. So we should fix IndexWriter to handle that case?
How would IndexWriter handle token streams with no TermToBytesRefAttribute?
- fail if the tokens stream happens to have tokens? (incrementToken returns
true at least once)
- index empty terms?
> Fix EmptyTokenizer
> ------------------
>
> Key: LUCENE-4656
> URL: https://issues.apache.org/jira/browse/LUCENE-4656
> Project: Lucene - Core
> Issue Type: Bug
> Components: modules/analysis
> Reporter: Adrien Grand
> Assignee: Adrien Grand
> Priority: Trivial
> Attachments: LUCENE-4656.patch, LUCENE-4656.patch
>
>
> TestRandomChains can fail because EmptyTokenizer doesn't have a
> CharTermAttribute and doesn't compute the end offset (if the offset attribute
> was added by a filter).
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org
