[
https://issues.apache.org/jira/browse/OPENNLP-1387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jeff Zemerick updated OPENNLP-1387:
-----------------------------------
Description:
The example command for the tokenizer in the documentation is:
{{opennlp TokenizerTrainer -model en-token.bin -alphaNumOpt -lang en -data
en-token.train -encoding UTF-8}}
This is an invalid command because the alphaNumOpt parameter must have a value.
Running this command as-is will give the error "Number of parameters must be
always be even."
The documentation for alphaNumOpt specifies it must have a value:
{quote}
-alphaNumOpt isAlphaNumOpt
Optimization flag to skip alpha numeric tokens for further tokenization
{quote}
was:
The example command for the tokenizer in the documentation is:
opennlp TokenizerTrainer -model en-token.bin -alphaNumOpt -lang en -data
en-token.train -encoding UTF-8
This is an invalid command because the alphaNumOpt parameter must have a value.
Running this command as-is will give the error "Number of parameters must be
always be even."
The documentation for alphaNumOpt specifies it must have a value:
-alphaNumOpt isAlphaNumOpt
Optimization flag to skip alpha numeric tokens for further
tokenization
> Fix alphaNumOpt in tokenizer example
> ------------------------------------
>
> Key: OPENNLP-1387
> URL: https://issues.apache.org/jira/browse/OPENNLP-1387
> Project: OpenNLP
> Issue Type: Task
> Components: Documentation, Tokenizer
> Affects Versions: 1.9.4, 2.0.0
> Reporter: Jeff Zemerick
> Priority: Major
>
> The example command for the tokenizer in the documentation is:
> {{opennlp TokenizerTrainer -model en-token.bin -alphaNumOpt -lang en -data
> en-token.train -encoding UTF-8}}
> This is an invalid command because the alphaNumOpt parameter must have a
> value. Running this command as-is will give the error "Number of parameters
> must be always be even."
> The documentation for alphaNumOpt specifies it must have a value:
> {quote}
> -alphaNumOpt isAlphaNumOpt
> Optimization flag to skip alpha numeric tokens for further tokenization
> {quote}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
