Hi Per There's a lot of questions in this email. I'd strongly recommend that you have a look at this page http://www.statmt.org/moses/?n=FactoredTraining.Tuning and the references in it. But if you really want to understand tuning you need to read this book (http://www.statmt.org/book/) and particularly chapter 9.
As to the memory/thread usage, Moses will use a single thread whilst loading models, then multiple threads in decoding. The mert binary (mert) shouldn't be resource heavy in the default setting. It has its own threads parameter, but you probably don't need it. Tuning stops when it no longer gets any improvement, typically 10-20 iterations, although there is an upper limit of 25 (configurable). cheers - Barry On 15/03/13 08:08, Per Tunedal wrote: > Hi again, > What does the tuning actually do? Tries to translate and checks against > the actual translation in the target language file? Trying different > weights, over and over again? No wonder it's time consuming. > > Tuning needs a lot of memory too, compared to training. At least in one > of the steps, according to the system monitor. The step that only uses > one thread, in spite of the parameter -threads. What step? And why? > > I see some interesting files are created, with names like > run8.best100.out . I suppose those are the most successful translations. > How are they used in the tuning? > > The default tuner (?) is mert, how does mert acually work to do the > tuning efficient? How are the weights to be tested chosen? Are there > any short cuts to take? > What's the difference to other tuners (?)? > > Anyone working on some different approach for tuning, to get improved > tuning speed or improved translation quality? > > What's the recommended size of the tuning corpus? Is that size > independent of the size of the training corpus? Is it dependent of the > tuner (?) used? > > Yours, > Per Tunedal > > PS My tuning has just started round 8, after 20 hours of processing. > Will it stop at 10 rounds, or what? > > > _______________________________________________ > Moses-support mailing list > [email protected] > http://mailman.mit.edu/mailman/listinfo/moses-support > _______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
