Hi Maria first I would like to ask (for next time) to write to the IRSTLM mailing list (user-irs...@list.fbk.eu) to any problem related to IRSTLM only
Now I am going to reply you privately. Nicola On Jun 20, 2014, at 6:47 AM, Maria Marpaung wrote: > Hello, I need help. > I'm working on my thesis for form translation system using MOSES MT. I came > to the Language model Training. I am having some problems. I have followed > some of the steps like following the Moses Baseline. including the following: > > 1. The language model (LM) is used to ensure fluent output, so it is built > with the target language (i.e Indonesia language in this case). The IRSTLM > documentation gives a full explanation of the command-line options, but the > following will build an appropriate 3-gram language model, removing > singletons, smoothing with improved Kneser-Ney, and adding sentence > boundary symbols: > > mkdir ~/lm > cd ~/lm > ~/irstlm/bin/add-start-end.sh \ > < ~/corpus/news-commentary-v8.fr-en.true.en \ > > news-commentary-v8.fr-en.sb.en > export IRSTLM=$HOME/irstlm; ~/irstlm/bin/build-lm.sh \ > -i news-commentary-v8.fr-en.sb.en \ > -t ./tmp -p -s improved-kneser-ney -o news-commentary-v8.fr-en.lm.en > ~/irstlm/bin/compile-lm --text news-commentary-v8.fr-en.lm.en.gz \ > news-commentary-v8.fr-en.arpa.en > > First until four commands were executed successfuly. The last one failed. > Here is the result after entering the following command line: > > maria@maria-Aspire-E1-471:~/lm$ ~/moses/irstlm/bin/compile-lm --text > news-commentary-v8.fr-en.lm.en.gz news-commentary-v8.fr-en.arpa.en > > inpfile: news-commentary-v8.fr-en.lm.en.gz > outfile: news-commentary-v8.fr-en.arpa.en > loading up to the LM level 1000 (if any) > dub: 10000000 > Failed to open news-commentary-v8.fr-en.lm.en.gz! > > > 2. I add command "yes" like this: > maria@maria-Aspire-E1-471:~/lm$ ~/moses/irstlm/bin/compile-lm –text yes > news-commentary-v8.fr-en.lm.en.gz news-commentary-v8.fr-en.arpa.en > > Warning: Too many arguments > > > > please help me, what should I do? > > > Best regards! > > Maria Marpaung > _______________________________________________ > Moses-support mailing list > Moses-support@mit.edu > http://mailman.mit.edu/mailman/listinfo/moses-support
_______________________________________________ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support
