Hi Vincent If you look at the error log, you will see:
> Usage: /home/moses/mosesdecoder/bin/CreateOnDiskPt numSourceFactors > numTargetFactors numScores tableLimit sortScoreIndex inputPath outputPath You are missing the first 5 arguments to CreateOnDiskPt, as given in config.basic. cheers - Barry On 28/07/15 12:37, Vincent Nguyen wrote: > I don't know why but the binarize crashes see below .... > >> >>> in my working directory I have 2 subdir, >>> "tuning" with inside moses.filtered.ini.5 moses.ini.5 >>> moses.tuned.ini.5 >>> and >>> "model" with inside moses.ini.5 (apparently this one does not have the >>> tuned weights) >>> >>> those in the tuning subdir : the "tuned" one moses.tuned.ini.5 >>> generated >>> after the moses.ini.5 seems to point on phrase-table.5.gz not binarized >>> and the moses.5.ini seem to point on the binarized within >>> tuning/filtered.5/... >>> unclear to me on which one I should use. >> If you run EMS, there will be a filtered ini file inside the >> evaluation directory which can be used to translate the test set >> using the tuned weights. However this model is filtered for the test >> set, so you cannot use it on other sentences. >> >> If you want the full model binarised, then you should add: >> >> binarize-all = $moses-script-dir/training/binarize-model.perl >> >> to the [GENERAL] section of the EMS config and rerun EMS. In this >> case the moses.tuned.ini in tuning can be used to translate any >> sentences. >> > > > Executing: > /home/moses/mosesdecoder/scripts/training/filter-model-given-input.pl > /home/moses/working/model/moses.bin.ini.6.tables > /home/moses/working/model/moses.ini.5 /dev/null -nofilter -Binarizer > /home/moses/mosesdecoder/bin/CreateOnDiskPt > Executing: mkdir -p /home/moses/working/model/moses.bin.ini.6.tables > Stripping XML... > Executing: > /home/moses/mosesdecoder/scripts/training/../generic/strip-xml.perl < > /dev/null > /home/moses/working/model/moses.bin.ini.6.tables/input.34384 > pt:PhraseDictionaryMemory name=TranslationModel0 num-features=4 > path=/home/moses/working/model/phrase-table.5 input-factor=0 > output-factor=0 > Considering factor 0 > ro:LexicalReordering name=LexicalReordering0 num-features=6 > type=wbe-msd-bidirectional-fe-allff input-factor=0 output-factor=0 > path=/home/moses/working/model/reordering-table.5.wbe-msd-bidirectional-fe.gz > > Considering factor 0 > Filtering files... > filtering /home/moses/working/model/phrase-table.5 -> > /home/moses/working/model/moses.bin.ini.6.tables/phrase-table.0-0.1.1... > Executing: ln -s /home/moses/working/model/phrase-table.5.gz > /home/moses/working/model/moses.bin.ini.6.tables/phrase-table.0-0.1.1.gz > binarizing... > Executing: /home/moses/mosesdecoder/bin/CreateOnDiskPt > /home/moses/working/model/moses.bin.ini.6.tables/phrase-table.0-0.1.1.gz > /home/moses/working/model/moses.bin.ini.6.tables/phrase-table.0-0.1.1.bin > Usage: /home/moses/mosesdecoder/bin/CreateOnDiskPt numSourceFactors > numTargetFactors numScores tableLimit sortScoreIndex inputPath outputPath > Exit code: 1 > Can't binarize at > /home/moses/mosesdecoder/scripts/training/filter-model-given-input.pl > line 417. > Exit code: 1 > binarising failed at > /home/moses/mosesdecoder/scripts/training/binarize-model.perl line 43. > -- The University of Edinburgh is a charitable body, registered in Scotland, with registration number SC005336. _______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
