Hi, very useful flag indeed. Please add the suggestion to the Baseline page: http://www.statmt.org/moses/?n=Moses.Baseline
Now you can read the following about the tuning script: nohup nice ~/mosesdecoder/scripts/training/mert-moses.pl ~/corpus/news-test2008.true.fr ~/corpus/news-test2008.true.en \ ~/mosesdecoder/bin/moses train/model/moses.ini --mertdir ~/mosesdecoder/bin/ &> mert.out & "If you have several cores at your disposal, then it'll be a lot faster to run Moses multi-threaded. Add --decoder-flags="-threads 4" to the last line above in order to run the decoder with 4 threads. With this setting, tuning took about 4 hours for me. " --decoder-flags "-threads all" is an easier way to get the most out of your computer, without having to figure out how many threads you've got. I thought I had only four, but actually I have 8. Knowledge about "-threads all", would have saved me some days. BTW Where should I put it in moses.ini? And what's the implications? Any drawbacks? Yours, Per Tunedal On Mon, Apr 29, 2013, at 17:44, Kenneth Heafield wrote: > Hi, > > It's not obvious, but here it is: > > --decoder-flags "-threads all" > > or 16 instead of all > > or add it to your moses.ini before tuning. > > Kenneth > > On 04/29/13 17:33, Arezki Sadoune wrote: > > Dear All, > > > > I'm currently working on a Phrase-based model from french to english. > > Assuming that the bitext corpora is very large, is there any way to use > > the multi-thread for the tuning purpose? > > > > I've already tried by the past to tune a similar system but it has taken > > 30 days on a single core. > > > > I've actually tried multithreaded tuning by adding the option -threads > > 16 to the mert script parameter ( > > /mosesdecoder/scripts/training/mert-moses.pl > > home/Moses/mosesdecoder/tunning1/tunning.true.fr > > /home/Moses/mosesdecoder/tunning1/tunning.true.en > > /home/Moses/mosesdecoder/bin/moses -threads 16 ...) > > > > but it didn't work. > > > > Thanks a lot > > > > Az > > > > > > > > _______________________________________________ > > Moses-support mailing list > > [email protected] > > http://mailman.mit.edu/mailman/listinfo/moses-support > > > _______________________________________________ > Moses-support mailing list > [email protected] > http://mailman.mit.edu/mailman/listinfo/moses-support _______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
