[
https://issues.apache.org/jira/browse/OPENNLP-602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13876456#comment-13876456
]
Mark Giaconia commented on OPENNLP-602:
---------------------------------------
The only other option is for the actual model/training tool to allow for a
"sample separator" char param. Encoding the newlines within a sample will work,
but this can be problematic due to the Span offsets generated when the encoded
chars are decoded back to a newline.
> SentenceDetector should support new line as and end of sentence char
> --------------------------------------------------------------------
>
> Key: OPENNLP-602
> URL: https://issues.apache.org/jira/browse/OPENNLP-602
> Project: OpenNLP
> Issue Type: Improvement
> Components: Sentence Detector
> Affects Versions: tools-1.5.3
> Reporter: Joern Kottmann
> Assignee: Joern Kottmann
> Priority: Minor
> Fix For: 1.6.0
>
>
> The Sentence Detector should have support to consider new line chars as the
> end of a sentence. This will probably require special handling in the
> training code to assume that there is an new line char if any other eos is
> missing.
--
This message was sent by Atlassian JIRA
(v6.1.5#6160)
