[jira] [Created] (OPENNLP-941) Add eval support to detokenizer

[Joern Kottmann (JIRA)]

Joern Kottmann created OPENNLP-941:
--------------------------------------

             Summary: Add eval support to detokenizer
                 Key: OPENNLP-941
                 URL: https://issues.apache.org/jira/browse/OPENNLP-941
             Project: OpenNLP
          Issue Type: Improvement
          Components: Tokenizer
            Reporter: Joern Kottmann


It would be nice to be able to evaluate a detokenizer on tokenizer training 
data.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)