you need to binarize with CreateProbingPT if you use moses2

if you use CreateOnDiskPt then you must use the moses decoder


Hieu Hoang
http://statmt.org/hieu


On Thu, 23 Aug 2018 at 09:02, Arezoo Arjomand <[email protected]>
wrote:

> Hi,
>
> I installed successfully moses decoder on server. I run syntax grammer
> extraction as follow :
>
>
>
> /home/vps/mosesdecoder/scripts/training/train-model.perl  \
>
> -root-dir train  \
>
> -corpus /home/vps/emlla//ttt/news-commentary-v8.fr-en.clean  \
>
> -f fr -e en -alignment grow-diag-final-and  -hierarchical    -glue-grammar
>       \  -lm 0:3:/home/vps/emlla//ttt/news-commentary-v8.fr-en.blm.en  \
>
> -mgiza -mgiza-cpus 4  \
>
> *-external-bin-dir * /*home*vps/mosesdecoder/tools >&training2.out
>
>
>
> the file which created is :
>
>
>
> train → corpus , giza.en-fr, giza.fr-en, model
>
> model → aligned.grow-diag-final-and, extract.sorted.gz, lex.e2f,  moses.ini,
> extract.inv.sorted.gz,        glue-grammar, lex.f2e  rule-table.gz
>
>
>
> to tune the model the following command is run:
>
>
>
> /home/vps/mosesdecoder/scripts/training/mert-moses.pl  /home/vps/emlla/
> nc-dev2007.en.true.fr  /home/vps/emlla/nc-dev2007.en.true.en  
> /home/vps/mosesdecoder/bin/moses2
> /home/vps/emlla/train/model/moses.ini --rootdir  
> /home/vps/mosesdecoder/scripts
> --decoder-flags "-v 0" --no-filter-phrase-table --inputtype 3     --batch-mira
> --return-best-dev  --filtercmd '/home/vps/mosesdecoder/scripts/training/
> filter-model-given-input.pl -Binarizer "CreateOnDiskPt 1 1 5 100 2" '
> --batch-mira-args '-J 300' --decoder-flags '-threads 8 -v 0' 1>&mert.out
>
>
> but it dies in following step:
>
>
> Finished loading LM0
>
> Loading UnknownWordPenalty0
>
> Finished loading UnknownWordPenalty0
>
> Loading TranslationModel0
>
> Finished loading TranslationModel0
>
> Loading TranslationModel1
>
> Finished loading TranslationModel1
>
> START LoadMappings()
>
> END LoadMappings()
>
> END LoadDecodeGraphBackoff()
>
> Loaded : [0.0490292] seconds
>
> RUN BATCH
>
> terminate called after throwing an instance of 'util::Exception'
>
>   what():  moses2/SCFG/nbest/KBestExtractor.cpp:42 in void
> Moses2::SCFG::KBestE$
>
> Only suppose to be 1 hypo coll in last stack
>
> Aborted (core dumped)
>
> Exit code: 134
> The decoder died. CONFIG WAS -weight-overwrite 'TranslationModel1=
> 0.285714 Phr$
>
> how can I fix it?
> Thank  you for your attention
>
>
_______________________________________________
Moses-support mailing list
[email protected]
http://mailman.mit.edu/mailman/listinfo/moses-support

Reply via email to