I don't know why but the binarize crashes see below .... > >> in my working directory I have 2 subdir, >> "tuning" with inside moses.filtered.ini.5 moses.ini.5 moses.tuned.ini.5 >> and >> "model" with inside moses.ini.5 (apparently this one does not have the >> tuned weights) >> >> those in the tuning subdir : the "tuned" one moses.tuned.ini.5 generated >> after the moses.ini.5 seems to point on phrase-table.5.gz not binarized >> and the moses.5.ini seem to point on the binarized within >> tuning/filtered.5/... >> unclear to me on which one I should use. > If you run EMS, there will be a filtered ini file inside the > evaluation directory which can be used to translate the test set using > the tuned weights. However this model is filtered for the test set, so > you cannot use it on other sentences. > > If you want the full model binarised, then you should add: > > binarize-all = $moses-script-dir/training/binarize-model.perl > > to the [GENERAL] section of the EMS config and rerun EMS. In this case > the moses.tuned.ini in tuning can be used to translate any sentences. >
Executing: /home/moses/mosesdecoder/scripts/training/filter-model-given-input.pl /home/moses/working/model/moses.bin.ini.6.tables /home/moses/working/model/moses.ini.5 /dev/null -nofilter -Binarizer /home/moses/mosesdecoder/bin/CreateOnDiskPt Executing: mkdir -p /home/moses/working/model/moses.bin.ini.6.tables Stripping XML... Executing: /home/moses/mosesdecoder/scripts/training/../generic/strip-xml.perl < /dev/null > /home/moses/working/model/moses.bin.ini.6.tables/input.34384 pt:PhraseDictionaryMemory name=TranslationModel0 num-features=4 path=/home/moses/working/model/phrase-table.5 input-factor=0 output-factor=0 Considering factor 0 ro:LexicalReordering name=LexicalReordering0 num-features=6 type=wbe-msd-bidirectional-fe-allff input-factor=0 output-factor=0 path=/home/moses/working/model/reordering-table.5.wbe-msd-bidirectional-fe.gz Considering factor 0 Filtering files... filtering /home/moses/working/model/phrase-table.5 -> /home/moses/working/model/moses.bin.ini.6.tables/phrase-table.0-0.1.1... Executing: ln -s /home/moses/working/model/phrase-table.5.gz /home/moses/working/model/moses.bin.ini.6.tables/phrase-table.0-0.1.1.gz binarizing... Executing: /home/moses/mosesdecoder/bin/CreateOnDiskPt /home/moses/working/model/moses.bin.ini.6.tables/phrase-table.0-0.1.1.gz /home/moses/working/model/moses.bin.ini.6.tables/phrase-table.0-0.1.1.bin Usage: /home/moses/mosesdecoder/bin/CreateOnDiskPt numSourceFactors numTargetFactors numScores tableLimit sortScoreIndex inputPath outputPath Exit code: 1 Can't binarize at /home/moses/mosesdecoder/scripts/training/filter-model-given-input.pl line 417. Exit code: 1 binarising failed at /home/moses/mosesdecoder/scripts/training/binarize-model.perl line 43. _______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
