Hi Chitra Can you check that you are using the version of IRSTLM specified in the "baseline system" (http://www.statmt.org/moses/?n=Moses.Baseline) page? The "--text yes" argument should work.
Also, the "baseline system" page also explains how to create a kenlm binary file from an ARPA file. It looks like you are passing an irstlm binary file to kenlm, and that is why Moses is failing. cheers - Barry On 13/05/14 11:40, Chitra C wrote: > Hello Moses-Support team, > > My name is Chitra, I am working on SMT[ Statistical Machine > Translation ] from English to Kannada Language. I am using Giza,IRSTLM > and Moses tools. > > I am following Oses manual for installation and training.Installation > of all the tools are successful,but during the training of language > model i have a problem. > > when i execute the following command > > ~/irstlm/bin/compile-lm \ > --text yes \ > kannada.lm.kn.gz \ > kannada.arpa.kn <http://kannada.arpa.kn> > > I am getting a warning called-Too many arguments > In order to avoid this, i gave following command > > ~/irstlm/bin/compile-lm \ > --text \ > kannada.lm.kn.gz \ > kannada.arpa.kn <http://kannada.arpa.kn> > > arpa file got created,but i am getting error when i try to do > tuning,testing ..etc. > > The error was like > > Loading the LM will be faster if you build a binary file. > Reading kannada.blm.kn <http://kannada.blm.kn> > ----5---10---15---20---25---30---35---40---45---50---55---60---65---70---75---80---85---90---95--100 > **************************************************************************************************** > lm/read_arpa.cc:63 in void lm::ReadARPACounts(util::FilePiece&, > std::vector<long long unsigned int, std::allocator<long long unsigned > int> >&) threw FormatLoadException because `line.size() >= 4 && > StringPiece(line.data(), 4) == "blmt"'. > This looks like an IRSTLM binary file. Did you forget to pass --text > yes to compile-lm? Byte: 40 File: kannada.blm.kn <http://kannada.blm.kn> > > Please help me out to solve this problem, > Thank you in advance. > > Regards, > Chitra C > > > _______________________________________________ > Moses-support mailing list > [email protected] > http://mailman.mit.edu/mailman/listinfo/moses-support -- The University of Edinburgh is a charitable body, registered in Scotland, with registration number SC005336. _______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
