Re: [Moses-support] What is the use of the lm parameter in the model training stage?
Crhistof is right the LM is used only to create a formally correct configuration file. You can simply set any NON EMPTY file, to complete the training successfully. Of course you have to modify the configfile with your good LM before translating Nicola From: moses-support-boun...@mit.edu [moses-support-boun...@mit.edu] on behalf of Christof Pintaske [christof.pinta...@oracle.com] Sent: Friday, May 21, 2010 5:26 AM To: moses-support@mit.edu Subject: Re: [Moses-support] What is the use of the lm parameter in the model training stage? On 5/20/10 8:12 PM, yifeng...@sina.com wrote: In Factored Tutorial, the first example is: % train-model.perl \ --corpus factored-corpus/proj-syndicate \ --root-dir unfactored \ --f de --e en \ --lm 0:3:factored-corpus/surface.lm:0 I think the language model is usually used in the decoding stage in SMT. What is the use of the lm parameter which lists a language model in the model training stage? I'm not sure if it's really required, but it's written to the moses.ini, which you later need in decoding. Otherwise you'd have to patch the moses.ini manually. just my 2 cents of wisdom Christof ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support
Re: [Moses-support] What is the use of the lm parameter in the model training stage?
the LM is used only to create a formally correct configuration file. You can simply set any NON EMPTY file, to complete the training successfully. Of course you have to modify the configfile with your good LM before translating Or you could simply do something like this: % echo FAKE factored-corpus/surface.lm % train-model.perl \ --corpus factored-corpus/proj-syndicate \ --root-dir unfactored \ --f de --e en \ --lm 0:3:factored-corpus/surface.lm:0 Then you don't have to change the config file later, and you can build the lm in parallel with the model. - John D. Burger MITRE ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support
[Moses-support] What is the use of the lm parameter in the model training stage?
nbsp;In Factored Tutorial, the first example is: nbsp; nbsp;% train-model.perl \ nbsp;nbsp;nbsp; --corpus factored-corpus/proj-syndicate \ nbsp;nbsp;nbsp; --root-dir unfactored \ nbsp;nbsp;nbsp; --f de --e en \ nbsp;nbsp;nbsp; --lm 0:3:factored-corpus/surface.lm:0 I think the language model is usually used in the decoding stage in SMT. What is the use of the lm parameter which lists a language modelnbsp;in the model training stage?___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support
Re: [Moses-support] What is the use of the lm parameter in the model training stage?
On 5/20/10 8:12 PM, yifeng...@sina.com wrote: In Factored Tutorial, the first example is: % train-model.perl \ --corpus factored-corpus/proj-syndicate \ --root-dir unfactored \ --f de --e en \ --lm 0:3:factored-corpus/surface.lm:0 I think the language model is usually used in the decoding stage in SMT. What is the use of the lm parameter which lists a language model in the model training stage? I'm not sure if it's really required, but it's written to the moses.ini, which you later need in decoding. Otherwise you'd have to patch the moses.ini manually. just my 2 cents of wisdom Christof ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support
