Hi Barry, Adam thank you for an explanation. Indeed I used the whole corpora file for tuning :)
Best regards Mariusz -----Original Message----- From: Barry Haddow [mailto:[email protected]] Sent: Monday, May 30, 2011 11:04 AM To: [email protected] Cc: Mariusz Hawryłkiewicz Subject: Re: [Moses-support] is mert taking too much time here? Hi Mariusz The speed of a mert iteration depends on how fast translation is. For a small data set like the one you're using, it shouldn't take 5 days. Unless you have a really big tuning set? How large is /moses/korpusy/ERP_test/lowercased/erp.lowercased.en ? Usually about 1000-2000 sentences is sufficient for tuning, and it should be distinct from the data set used to estimate phrase tables. best regards - Barry On Monday 30 May 2011 09:50, [Intra] Mariusz Hawryłkiewicz wrote: > Hello Moses team! > > I just wanted to ask you if it's normal for mert to run over 10 days on a > multicore machine (2 processors with 8 cores - AMD Opteron) and 24GB of > RAM? The bilingual corpora is about 400k sentences large, and I am running > mert with the following command: > > > > /moses/install/skrypty/scripts-20110516-1443/training/mert-moses.pl > /moses/korpusy/ERP_test/lowercased/erp.lowercased.en > /moses/korpusy/ERP_test/lowercased/erp.lowercased.pl > /moses/install/moses/moses-cmd/src/moses /moses/install/model/moses.ini > --working-dir /moses/korpusy/ERP_test/tuning/ --rootdir > /moses/install/skrypty/scripts-20110516-1443/ > --mertdir=/moses/install/moses/mert/ --decoder-flags "-v 0 -threads 16" >& > /moses/korpusy/ERP_test/tuning/mert.out & > > > > Over these 10 days mert was able to run just 2 iterations and generated > some moses.ini file with weights, but mert.out file shows that the process > wasn't finished at all. It ended up suddenly and the last message is: > > > > Translating line 246297 in thread id > > > > Isuppose this is not normal mert behavior.. what am I doing wrong then? > > > > Thanks for any hint on the issue! > > Best regards > > Mariusz -- The University of Edinburgh is a charitable body, registered in Scotland, with registration number SC005336. _______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
