Hello Barry,

Thank you for your immediate response.

I am using the same version as specified in the webpage,it is irstlm-5.80.03


On Tue, May 13, 2014 at 6:35 PM, Barry Haddow <[email protected]>wrote:

> Hi Chitra
>
> Can you check that you are using the version of IRSTLM specified in the
> "baseline system" (http://www.statmt.org/moses/?n=Moses.Baseline)  page?
> The "--text yes" argument should work.
>
> Also, the "baseline system" page also explains how to create a kenlm
> binary file from an ARPA file. It looks like you are passing an irstlm
> binary file to kenlm, and that is why Moses is failing.
>
> cheers - Barry
>
>
> On 13/05/14 11:40, Chitra C wrote:
>
>> Hello Moses-Support team,
>>
>> My name is Chitra, I am working on SMT[ Statistical Machine Translation ]
>> from English to Kannada Language. I am using Giza,IRSTLM and Moses tools.
>>
>> I am following Oses manual for installation and training.Installation of
>> all the tools are successful,but during the training of language model i
>> have a problem.
>>
>> when i execute the following command
>>
>> ~/irstlm/bin/compile-lm \
>> --text yes \
>> kannada.lm.kn.gz \
>> kannada.arpa.kn <http://kannada.arpa.kn>
>>
>>
>> I am getting a warning called-Too many arguments
>> In order to avoid this, i gave following command
>>
>> ~/irstlm/bin/compile-lm \
>> --text \
>> kannada.lm.kn.gz \
>> kannada.arpa.kn <http://kannada.arpa.kn>
>>
>>
>> arpa file got created,but i am getting error when i try to do
>> tuning,testing ..etc.
>>
>> The error was like
>>
>> Loading the LM will be faster if you build a binary file.
>> Reading kannada.blm.kn <http://kannada.blm.kn>
>>
>> ----5---10---15---20---25---30---35---40---45---50---55---
>> 60---65---70---75---80---85---90---95--100
>> ************************************************************
>> ****************************************
>> lm/read_arpa.cc:63 in void lm::ReadARPACounts(util::FilePiece&,
>> std::vector<long long unsigned int, std::allocator<long long unsigned int>
>> >&) threw FormatLoadException because `line.size() >= 4 &&
>> StringPiece(line.data(), 4) == "blmt"'.
>>  This looks like an IRSTLM binary file.  Did you forget to pass --text
>> yes to compile-lm? Byte: 40 File: kannada.blm.kn <http://kannada.blm.kn>
>>
>>
>> Please help me out to solve this problem,
>> Thank you in advance.
>>
>> Regards,
>> Chitra C
>>
>>
>> _______________________________________________
>> Moses-support mailing list
>> [email protected]
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>
>
>
> --
> The University of Edinburgh is a charitable body, registered in
> Scotland, with registration number SC005336.
>
>
_______________________________________________
Moses-support mailing list
[email protected]
http://mailman.mit.edu/mailman/listinfo/moses-support

Reply via email to