oh man, now I feel stupid. of course, I used a relative path for the workdir and mert didn't like. I thought I wouldn't make this mistake anymore … Thanks for helping!
Jörg On May 21, 2014, at 12:12 PM, Hieu Hoang wrote: > hi jorg > > are you using relative paths? use absolute paths if you are. > > this is my tree-to-string mert command i ran last week, if it helps. I use > the EMS to run it so i don't usually look at the details > > /home/s0565741/workspace/github/mosesdecoder.hieu/scripts/training/mert-moses.pl > > > /home/s0565741/workspace/experiment/europarl/en-fr-mixed/tuning/input.lc.7 > > /home/s0565741/workspace/experiment/europarl/en-fr-mixed/tuning/reference.lc.7 > > /home/s0565741/workspace/github/mosesdecoder.hieu/bin/moses_chart > > /home/s0565741/workspace/experiment/europarl/en-fr-mixed/tuning/moses.filtered.ini.7 > --nbest 100 > --working-dir > /home/s0565741/workspace/experiment/europarl/en-fr-mixed/tuning/tmp.7 > --decoder-flags "-threads 8 -v 0 " > --rootdir /home/s0565741/workspace/github/mosesdecoder.hieu/scripts > -mertdir /home/s0565741/workspace/github/mosesdecoder.hieu/bin > -threads 10 > --no-filter-phrase-table > --inputtype 3 > > > > > On 20 May 2014 15:40, Jorg Tiedemann <[email protected]> wrote: > > I'm struggling a bit with tuning my tree-based models. I try to run MERT on a > syntax-to-string model but I have problems setting the flags for > mert-moses.pl correctly. Now I tried something like > > mert-moses.pl newstest2011.trees.es newstest2011.tok.true.fr moses_chart > es-fr/model/moses.ini \ > --mertdir /path/to/mosesdecoder/bin \ > --nbest 100 \ > --working-dir es-fr/tuning \ > --no-filter-phrase-table \ > --inputtype 3 \ > --rootdir /path/to/mosesdecoder/scripts > > but after translating the devset in the first iteration my process stops with > Couldn't open es-fr/tuning/extractor.sh for writing: file or directory does > not exist > > The directory exists and the n-best list looks fine. Is there yet another > flag that I have to add to the mert-moses call? > > By the way, it took me some time to figure out that I have to set inputtype > to 3 to make the system accept parsed input. Maybe someone could add this to > the documentation (if it is correct like this anyway). > ok. done > http://www.statmt.org/moses/?n=FactoredTraining.Tuning > > Another question: What would be the correct call to make mert-moses to filter > the model before running? It doesn't work to add > '-Hierarchical' to the filtercmd as mert-moses then complains that the > command is not found on the system (it doesn't remove flags before checking > for existence). Or is it better to binarize the rule-tables anyway? > i use the EMS, which filters and binarize the phrase table before tuning > > Thanks for your help! > > Jörg > > > > > > > > _______________________________________________ > Moses-support mailing list > [email protected] > http://mailman.mit.edu/mailman/listinfo/moses-support > > > > -- > Hieu Hoang > Research Associate > University of Edinburgh > http://www.hoang.co.uk/hieu >
_______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
