[jira] [Created] (OPENNLP-1310) Add unit test for WhitespaceTokenStream

[Alan Wang (Jira)]

Alan Wang created OPENNLP-1310:
----------------------------------

             Summary:  Add unit test for WhitespaceTokenStream
                 Key: OPENNLP-1310
                 URL: https://issues.apache.org/jira/browse/OPENNLP-1310
             Project: OpenNLP
          Issue Type: Test
          Components: Tokenizer
            Reporter: Alan Wang


test if it can tokenize whitespace separated and the split chars tokens. 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)