[
https://issues.apache.org/jira/browse/LUCENE-9283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17061878#comment-17061878
]
David Smiley commented on LUCENE-9283:
--------------------------------------
Yes, remove in TestRandomChains for consistency with the choice by
DelimitedTermFrequencyTokenFilter which is super-similar and already excluded.
> DelimitedBoostTokenFilter can fail testRandomChains
> ---------------------------------------------------
>
> Key: LUCENE-9283
> URL: https://issues.apache.org/jira/browse/LUCENE-9283
> Project: Lucene - Core
> Issue Type: Bug
> Reporter: Alan Woodward
> Assignee: Alan Woodward
> Priority: Major
>
> DelimitedBoostTokenFilter expects tokens of the form `token` or
> `token|number` and throws a NumberFormatException if the `number` part can't
> be parsed. This can cause test failures when we build random chains and
> throw random data through them.
> We can either exclude DelimiteBoostTokenFilter when building a random
> analyzer, or add a flag to ignore badly-formed tokens. I lean towards doing
> the former, as I don't really want to make leniency the default here.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org
For additional commands, e-mail: issues-h...@lucene.apache.org
