Hi, I get a new result with 3456 seconds by setting mgiza-cpu as 4. Still it is slower than GIZA++.
在 2015年1月18日，16:25，Tom Hoar <[email protected]> 写道： Your command line sets "--mgiza-cpus 3" which assigns 3 CPUs to each instance of mgiza on your quad-core machine. You also set the "--parallel" flag. The notes say the --parallel flag run "forward and inverse GIZA++ in parallel". This means the forward and reverse instances of mgiza are trying to use 3 CPUs each, or a total of 6 threads on on 8-threaded CPU. Sounds reasonable. We've been using dual-threaded quad-cores for a while. We set "--mgiza-cpus 8" and never use the "--parallel" flag. In this configuration, we never see a slow-down. So, I'm wondering if the "--parallel" flag causes some other kind of resource bottleneck. Try dropping the "--parallel" flag, and set "--mgiza-cpus 8" to see what happens. On 01/16/2015 11:34 PM, Hieu Hoang wrote: can you provide the training corpus so I can verify your results? On 16 January 2015 at 15:53, Li Xiang <[email protected]> wrote: > Hi all, > > I trained the alignment model on the same data with the same parameters > using GIZA and MGIZA respectively. The training corpus includes 200K > sentences. My server has an Intel Quad CPU i4790K which has 4 cores and > each core has 2 threads. It costs 2905 seconds for GIZA. But it costs 5259 > seconds for MGIZA with 3 threads. I think MGIZA is much faster than GIZA. > But I got bad result. I do not know the reason is the compile way or others. > > Does anyone has relative experience? Thanks. > > The following is the training command for MGIZA. And the training data is > the FBIS zh-en data. But I can not public the data because of copyright. > > > ${mosesScript}/training/train-model.perl \ > --external-bin-dir "${binDir}" \ > --root-dir "${trainDir}" \ > --corpus train \ > --f src \ > --e ref \ > --alignment grow-diag-final-and \ > --parallel \ > --first-step 1 \ > --last-step 3 \ > --mgiza --mgiza-cpus 3 > _______________________________________________ > Moses-support mailing list > [email protected] > http://mailman.mit.edu/mailman/listinfo/moses-support > -- Hieu Hoang Research Associate University of Edinburgh http://www.hoang.co.uk/hieu _______________________________________________ Moses-support mailing [email protected]http://mailman.mit.edu/mailman/listinfo/moses-support _______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
_______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
