Hi Matthias, Thank you, I really apreciate your help.
It seems that was the problem. I'm checking the tuning results and it did 8 runs and returned all factors. Hope the BLEU would be better this time. Best regards, Carlos El 28/4/2016 9:14 p. m., "Matthias Huck" <[email protected]> escribió: > Hi Carlos, > > Have you tried switching off MBR decoding during tuning? (Run Moses > without the -mbr parameter.) The exception it throws seems to suggest > that MBR doesn't work with more than a single output factor. > > Cheers, > Matthias > > On Thu, 2016-04-28 at 21:09 +0200, Carlos Escolano wrote: > > Hi, > > > > Thank you for your answer > > > > I've tried setting the output factors in the moses.ini before and > > mert-moses.pl throws the following error: > > > > Loading table into memory...done. > > terminate called after throwing an instance of 'util::Exception' > > what(): moses/mbr.cpp:112 in const Moses::TrellisPath doMBR(const > > Moses::TrellisPathList&, const Moses::AllOptions&) threw > > util::Exception > > because `oFactors.size() != 1'. > > Need exactly one output factor! > > > > Using the moses.ini without tuning all factors are generated, It's > > during > > the tuning process that only the forms appear. > > > > Best regards, > > > > Carlos > > > > 2016-04-28 20:14 GMT+02:00 Matthias Huck <[email protected]>: > > > > > Hi, > > > > > > Moses can be configured to output the target-side factors of your > > > choice. > > > Add something like this to your moses.ini: > > > > > > [output-factors] > > > 0 > > > 1 > > > 2 > > > > > > Cheers, > > > Matthias > > > > > > > > > On Thu, 2016-04-28 at 18:16 +0200, Carlos Escolano wrote: > > > > Hi, > > > > > > > > Thank you for your answer. > > > > > > > > You are right. While the phrase table has all three factors in > > > > the > > > > run.X.best.out only the form appears. > > > > > > > > I'll check why this is happening. > > > > > > > > Best Regards, > > > > > > > > Carlos > > > > > > > > > > > > > > > > 2016-04-28 8:46 GMT+02:00 Ondrej Bojar <[email protected]>: > > > > > > > > > Dear Carlos, > > > > > > > > > > My frequent mistake in this respect is the match of factor > > > representation > > > > > in run.X.best.out and the reference sentences. > > > > > > > > > > Technically, both is possible: evaluating only the first factor > > > > > (form) > > > or > > > > > all factors of each token. BLEU does not care. Mismatch will > > > > > cause > > > terribly > > > > > low scores. > > > > > > > > > > O. > > > > > > > > > > > > > > > On April 27, 2016 9:48:50 PM CEST, Carlos Escolano < > > > [email protected]> > > > > > wrote: > > > > > > Hi, > > > > > > > > > > > > I trained a chinese to spanish unfacored model and all worked > > > > > > perfectly. > > > > > > But when I try to train a factored model for the same task I > > > > > > have > > > some > > > > > > trouble while tuning. The factors I'm using are only words > > > > > > for > > > chinese > > > > > > and > > > > > > words, lemmas and POS tags for spanish. > > > > > > > > > > > > Training seems to finish correctly and the phrase tables > > > > > > shows all > > > the > > > > > > factors but when tuning t it only does 2 runs and prints a > > > > > > message > > > > > > saying > > > > > > that weights have not change in the last run. Leaving the > > > > > > original > > > > > > weights. > > > > > > Also when translating, the BLEU obtained is worse than the > > > > > > obtained > > > > > > with > > > > > > the not factored model. > > > > > > > > > > > > > > > > > > These are my calls for training and tuning the model: > > > > > > > > > > > > $SCRIPTS_ROOTDIR/training/train-model.perl \ > > > > > > -external-bin-dir $GIZA_DIR/mgiza-bin -mgiza \ > > > > > > --corpus $WORKING_DIR/train/train \ > > > > > > --alignment grow-diag-final-and \ > > > > > > --score-options '--GoodTuring' \ > > > > > > --root-dir $WORKING_DIR/baseline/ \ > > > > > > --f zh --e es \ > > > > > > --lm 0:5:$WORKING_DIR/baseline/lm/words.lm.es:0 \ > > > > > > --translation-factors 0-0,1,2 \ > > > > > > --reordering msd-bidirectional-fe \ > > > > > > --reordering-factors 0-0 \ > > > > > > > > > > > > $MOSES_SCRIPTS/training/mert-moses.pl \ > > > > > > $WORKING_DIR/dev/dev.zh \ > > > > > > $WORKING_DIR/dev/dev.es \ > > > > > > > > > > > > > > $MOSES_DIR/moses-cmd/bin/gcc-4.8.5/release/link-static/threading > > > -multi/moses > > > > > > \ > > > > > > $WORKING_DIR/baseline/model/moses.ini \ > > > > > > --nbest 100 \ > > > > > > --working-dir $WORKING_DIR/baseline/tuning/ \ > > > > > > --decoder-flags "-drop-unknown -mbr -threads 24 -mp -v 0" \ > > > > > > --rootdir $MOSES_SCRIPTS \ > > > > > > --mertdir $MOSES_DIR/bin/ \ > > > > > > -threads 24 \ > > > > > > --filtercmd > > > > > > '/veu4/usuaris24/xtrans/mosesdecoder/scripts/training/ > > > > > > filter-model-given-input.pl' > > > > > > > > > > > > > > > > > > > > /veu4/usuaris24/smt/softlic/mosesdecoder/scripts//ems/support/reuse > > > -weights.perl > > > > > > \ > > > > > > $WORKING_DIR/baseline/tuning/moses.ini < > > > > > > $WORKING_DIR/baseline/model/moses.ini > > > > > > > $WORKING_DIR/baseline/tuning/moses.weight-reused.ini > > > > > > > > > > > > > > > > > > Best regards, > > > > > > > > > > > > Carlos > > > > > > > > > > > > > > > > > > > > > ------------------------------------------------------------------- > > > ----- > > > > > > > > > > > > _______________________________________________ > > > > > > Moses-support mailing list > > > > > > [email protected] > > > > > > http://mailman.mit.edu/mailman/listinfo/moses-support > > > > > > > > > > -- > > > > > Ondrej Bojar (mailto:[email protected] / [email protected]) > > > > > http://www.cuni.cz/~obo > > > > > > > > > _______________________________________________ > > > > Moses-support mailing list > > > > [email protected] > > > > http://mailman.mit.edu/mailman/listinfo/moses-support > > > >
_______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
