I think there's differences in different versions of irstlm. Maybe try --text yes --text -text yes -text Also, Moses comes with the script scripts/generic/trainlm-irst2.perl which runs IRSTLM for you. You just need to give it the text file.
Also, you might want to look at KenLM's lmplz command, which also creates a LM On 30 October 2014 15:19, Sovath-MITE-319 <[email protected]> wrote: > Dear Sir, > > I am a student from Royal University of Phnom Penh, Cambodia. > > I am under taking Master Degree of Computer Science and my thesis is > working on Paralell Corpus from Khmer to English. > > However, I have no problem with moses installation as well as the other > tools. > > Come to step number 5, i seem to get stuck and can't find any resource > to fix this problem. > I have found one article that has the same problem too, > (http://comments.gmane.org/gmane.comp.nlp.moses.user/9924). > But there seems to have no solution. I am not sure if there is > something that require to configure before processing step number 5. > > PS: Step that i have issue > > mkdir ~/lm > cd ~/lm > ~/irstlm/bin/add-start-end.sh \ > < ~/corpus/news-commentary-v8.fr-en.true.en \ > > news-commentary-v8.fr-en.sb.en > export IRSTLM=$HOME/irstlm; ~/irstlm/bin/build-lm.sh \ > -i news-commentary-v8.fr-en.sb.en \ > -t ./tmp -p -s improved-kneser-ney -o news-commentary-v8.fr-en.lm.en > ~/irstlm/bin/compile-lm \ > --text yes \ > news-commentary-v8.fr-en.lm.en.gz \ > news-commentary-v8.fr-en.arpa.en > > Looking forward to hearing from your support. > > Best Regards, > Sovath > _______________________________________________ > Moses-support mailing list > [email protected] > http://mailman.mit.edu/mailman/listinfo/moses-support > -- Hieu Hoang Research Associate University of Edinburgh http://www.hoang.co.uk/hieu
_______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
