[
https://issues.apache.org/jira/browse/OPENNLP-1989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18121295#comment-18121295
]
ASF GitHub Bot commented on OPENNLP-1989:
-----------------------------------------
rzo1 merged PR #1321:
URL: https://github.com/apache/opennlp/pull/1321
> Regex removal (5b/10): Make event parsing deterministic and preserve feature
> identities
> ---------------------------------------------------------------------------------------
>
> Key: OPENNLP-1989
> URL: https://issues.apache.org/jira/browse/OPENNLP-1989
> Project: OpenNLP
> Issue Type: Improvement
> Reporter: Kristian Rickert
> Priority: Major
> Time Spent: 10m
> Remaining Estimate: 0h
>
> Correct parsing in {{RealValueFileEventStream}}, {{RealBasicEventStream}},
> and {{SimpleEventStreamBuilder}} using explicit, documented delimiters
> independent of global tokenizer settings. Preserve Unicode characters within
> feature names, eliminate accidental empty features, and prevent outcome-only
> events from prematurely ending a stream. Report malformed records clearly and
> document the shared parsing API. Test exact outcomes, feature arrays, values,
> and continued reading after outcome-only events.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
