[
https://issues.apache.org/jira/browse/OPENNLP-1310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17222657#comment-17222657
]
Alan Wang commented on OPENNLP-1310:
------------------------------------
[https://github.com/apache/opennlp/pull/379]
> Add unit test for WhitespaceTokenStream
> ----------------------------------------
>
> Key: OPENNLP-1310
> URL: https://issues.apache.org/jira/browse/OPENNLP-1310
> Project: OpenNLP
> Issue Type: Test
> Components: Tokenizer
> Reporter: Alan Wang
> Priority: Minor
> Labels: test
>
> test if it can tokenize whitespace separated and the split chars tokens.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
