Recently, these two threads have discussed moses.ini language model
parameters:
Re: [Moses-support] What is the use of the lm parameter in the model
training stage?
Re: [Moses-support] Moses seems to hang
Recently, it seems there have been some changes to the way
train-factored-phrase-model.perl. On the current
http://www.statmt.org/moses_steps.html, the -lm command option for
train-factored-phrase-model.perl shows:
-lm 0:3:/path-to-lm/file.lm
I recently trained a model with this syntax, and
train-factored-phrase-model.perl generated this lm section in moses.ini
file:
[lmodel-file]
0 0 3 /path-to-lm/file.lm
The current
http://www.statmt.org/moses/?n=FactoredTraining.BuildingLanguageModel
explains the leading digit represents the language model type: SRILM=0,
IRSTLM=1, RandLM=5. So, I edit the line from 0 0 3 to 1 0 3
Previous versions of moses_steps.html included a trailing option after the
file name:
-lm 0:3:/path-to-lm/file.lm:0
Can someone explain the trailing :0 and what does/did? Why was it dropped
from the current web instructions?
Thanks,
Tom
On Thu, 20 May 2010 01:50:35 -0700,
<[email protected]>
wrote:
> Thanks, that worked.
>
> Tom
>
> On Wed, 19 May 2010 09:57:17 +0100, Barry Haddow <[email protected]>
> wrote:
>> Hi
>>
>> To use the binary phrase table, change this line
>>
>> 0 0 0 5 /media/models/europarl.v5.mini-3-nl-en/model/phrase-table
>>
>> to
>>
>> 1 0 0 5 /media/models/europarl.v5.mini-3-nl-en/model/phrase-table
>>
>> regards
>> Barry
>>
>>
>> On Wednesday 19 May 2010 04:37:36 [email protected]
>> wrote:
>>> Thanks Franz and Raphael,
>>>
>>> Re: echo. I was using echo, but didn't copy to email. Sorry.
>>>
>>> I rebuilt the model with closer attention to steps in the new link.
> Seems
>>> that I didn't wait long enough before. It finally translated after
over
>>> an
>>> hour. It took 3776 seconds to load the phrase table. That's after I
>>> edited
>>> the moses.ini file to use the binarized table (I thought). The moses
>>> output and the moses.ini config are attached.
>>>
>>> What am I missing?
>>>
>>> Tom
>>>
>>>
>>> On Sat, 15 May 2010 16:13:30 +0100, Raphael Payen
>>> <[email protected]>
>>>
>>> wrote:
>>> >> Here's the input:
>>> >>
>>> >> dit is niet gebeurd . | moses -f ./model/moses.ini
>>> >
>>> > You need to write "echo" before your input, otherwise "dit" is not a
>>> > valid command.
>>> >
>>> > Also, when moses does nothing, try to type "dit is niet gebeurd"
then
>>> > Ctrl-d instead of Ctrl-c
>>>
> _______________________________________________
> Moses-support mailing list
> [email protected]
> http://mailman.mit.edu/mailman/listinfo/moses-support
_______________________________________________
Moses-support mailing list
[email protected]
http://mailman.mit.edu/mailman/listinfo/moses-support
