Add Tokenizer Training API section
----------------------------------
Key: OPENNLP-215
URL: https://issues.apache.org/jira/browse/OPENNLP-215
Project: OpenNLP
Issue Type: Improvement
Components: Documentation
Reporter: Jörn Kottmann
The documentation is lacking a section for the tokenizer which explains how the
training api can be used. This section should be written in a similar fashion
as in other components, e.g. sentence detector or name finder.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira