This is an automated email from the ASF dual-hosted git repository.
koji pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/opennlp.git
The following commit(s) were added to refs/heads/master by this push:
new bf1c2c3 [OPENNLP-1210] Change `-lang en` in documentation about
CoNLL2003 to `-lang eng` (#325)
bf1c2c3 is described below
commit bf1c2c3b0a60041be263d1febeddf53a146d9fa1
Author: Xiang Ji <[email protected]>
AuthorDate: Wed Aug 1 03:03:00 2018 +0200
[OPENNLP-1210] Change `-lang en` in documentation about CoNLL2003 to `-lang
eng` (#325)
Thanks x-ji! :)
---
opennlp-docs/src/docbkx/corpora.xml | 14 ++++++++------
1 file changed, 8 insertions(+), 6 deletions(-)
diff --git a/opennlp-docs/src/docbkx/corpora.xml
b/opennlp-docs/src/docbkx/corpora.xml
index aeef36c..187c9c3 100644
--- a/opennlp-docs/src/docbkx/corpora.xml
+++ b/opennlp-docs/src/docbkx/corpora.xml
@@ -270,6 +270,8 @@ path: .\es_ner_person.bin]]>
<para>After one of the corpora is available the data must be
transformed as explained in the README file to the CONLL format.
The transformed data can be read by the OpenNLP CONLL03
converter.
+
+ Note that for CoNLL-2003 corpora, the -lang argument should either be
"eng" or "deu", instead of "en" or "de".
</para>
</section>
<section id="tools.corpora.conll.2003.converting">
@@ -278,13 +280,13 @@ path: .\es_ner_person.bin]]>
To convert the information to the OpenNLP format:
<screen>
<![CDATA[
-$ opennlp TokenNameFinderConverter conll03 -lang en -types per -data eng.train
> corpus_train.txt]]>
+$ opennlp TokenNameFinderConverter conll03 -lang eng -types per -data
eng.train > corpus_train.txt]]>
</screen>
Optionally, you can convert the training test samples as well.
<screen>
<![CDATA[
-$ opennlp TokenNameFinderConverter conll03 -lang en -types per -data eng.testa
> corpus_testa.txt
-$ opennlp TokenNameFinderConverter conll03 -lang en -types per -data eng.testb
> corpus_testb.txt]]>
+$ opennlp TokenNameFinderConverter conll03 -lang eng -types per -data
eng.testa > corpus_testa.txt
+$ opennlp TokenNameFinderConverter conll03 -lang eng -types per -data
eng.testb > corpus_testb.txt]]>
</screen>
</para>
</section>
@@ -295,7 +297,7 @@ $ opennlp TokenNameFinderConverter conll03 -lang en -types
per -data eng.testb >
<screen>
<![CDATA[
$ opennlp TokenNameFinderTrainer.conll03 -model en_ner_person.bin -iterations
500 \
- -lang en -types per -data eng.train -encoding
utf8]]>
+ -lang eng -types per -data eng.train
-encoding utf8]]>
</screen>
</para>
<para>
@@ -346,7 +348,7 @@ path: .\en_ner_person.bin]]>
<screen>
<![CDATA[
$ opennlp TokenNameFinderEvaluator.conll03 -model en_ner_person.bin \
- -lang en -types per -data eng.testa
-encoding utf8]]>
+ -lang eng -types per -data eng.testa
-encoding utf8]]>
</screen>
</para>
<para>
@@ -745,4 +747,4 @@ Organization: precision: 85.11%; recall: 79.38%; F1:
82.14%. [target: 130
</para>
</section>
</section>
-</chapter>
\ No newline at end of file
+</chapter>
