Hi, > > Training data: > > wmt07/training/europarl-v3.fr-en.fr > > wmt07/training/europarl-v3.fr-en.en > > Format: parallel files, one sentence per line, utf8. > > (I think I read somewhere they should be at least 1000 sentences)
Ideally you have much more training data than this. The Europarl corpus is around a million sentence pairs. > > Tuning data: > > wmt07/dev/dev2006.fr > > wmt07/dev/dev2006.en > > Format: same as above?? > > Size: ?? (compared to training data) Same format, size should be 500-2000 sentences or so. > > Test data: > > wmt07/devtest/devtest2006.fr > > wmt07/devtest/devtest2006.en > > Format: same as above?? > > Size: ?? Could be whatever size you like I suppose? Same format, size should be 500-2000 sentences or so. > > I think http://www.statmt.org/wmt07/baseline.html these instructions > are > > for translating French -> English only, is that correct? > > > > With the "Train Data" command: > > > bin/moses-scripts/scripts-YYYYMMDD-HHMM/training/train-factored-phrase-model.perl > -scripts-root-dir bin/moses-scripts/scripts-YYYYMMDD-HHMM -root-dir > working-dir -corpus working-dir/corpus/europarl.lowercased -f fr -e en > -alignment grow-diag-final-and -reordering msd-bidirectional-fe -lm > 0:5:working-dir/lm/europarl.lm:0 > > > > What is the significance of the flags -f and -e ? to specify the extensions of the foreign (input) and english (output) files. > > Are they related to msd-bidirectional-fe ? no. that one is the lexicalized reordering model. > > Can I just put tg instead of fr and everything else stays the same? > (my > > training files are raw.tg and raw.en) yes. > > Is it possible to only download the en/fr files rather than the whole > > Europarl corpus? I only want to use it confirm that I get the expected > > results and therefore have everything set up correctly. older version of europarl: http://www.statmt.org/wmt06/shared-task/ -phi _______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
