Hello, I need help.
I'm working on my thesis for form translation system using MOSES MT. I came to
the Language model Training. I am having some problems. I have followed some of
the steps like following the Moses Baseline. including the following: 1. The
language model (LM) is used to ensure fluent output, so it is built
with the target language (i.e Indonesia language in this case). The IRSTLM
documentation gives a full explanation of the command-line options, but the
following will build an appropriate 3-gram language model, removing
singletons, smoothing with improved Kneser-Ney, and adding sentence
boundary symbols: mkdir ~/lm cd ~/lm ~/irstlm/bin/add-start-end.sh
\ < ~/corpus/news-commentary-v8.fr-en.true.en \ >
news-commentary-v8.fr-en.sb.en export IRSTLM=$HOME/irstlm;
~/irstlm/bin/build-lm.sh \ -i news-commentary-v8.fr-en.sb.en \
-t ./tmp -p -s improved-kneser-ney -o news-commentary-v8.fr-en.lm.en
~/irstlm/bin/compile-lm --text news-commentary-v8.fr-en.lm.en.gz \
news-commentary-v8.fr-en.arpa.en First until four commands were executed
successfuly. The last one failed.
Here is the result after entering the following command line:
maria@maria-Aspire-E1-471:~/lm$ ~/moses/irstlm/bin/compile-lm --text
news-commentary-v8.fr-en.lm.en.gz news-commentary-v8.fr-en.arpa.en inpfile:
news-commentary-v8.fr-en.lm.en.gz
outfile: news-commentary-v8.fr-en.arpa.en
loading up to the LM level 1000 (if any)
dub: 10000000
Failed to open news-commentary-v8.fr-en.lm.en.gz!
2. I add command "yes" like this:
maria@maria-Aspire-E1-471:~/lm$ ~/moses/irstlm/bin/compile-lm –text yes
news-commentary-v8.fr-en.lm.en.gz news-commentary-v8.fr-en.arpa.en
Warning: Too many arguments
please help me, what should I do?
Best regards!
Maria Marpaung
_______________________________________________
Moses-support mailing list
[email protected]
http://mailman.mit.edu/mailman/listinfo/moses-support
