Dear all I am using moses RELEASE-2.1 binaries. my training data is very small corpus of 170k sentences. I following instructions from "http://www.statmt.org/moses/?n=Moses.Baseline"; for training and testing. the problem is that when I test the system, loading time is very long and after 30min the phrase-table is still loading .. the models are small and it should not take that long, also translation itself is very slow. same model loads relatively fast and works fine with my older version of moses(before 2012). both were using only one cpu and almost same amount of memory. my question is : how can I get the same decoding speed as before; with the moses 2.1 , and what is wrong with my current settings?
binarising the models helped with initial loading, but the translation is still much faster with my old moses. please see my moses.ini and translation log files in the attachment. the command that I am using: training: nohup nice /home/lingua/smt/moses-binaries/www.statmt.org_64bit/moses/RELEASE-2.1/binaries/linux-64bit/scripts/training/train-model.perl -root-dir new/ -corpus ./all -f de -e en -max-phrase-length 5 -alignment grow-diag-final-and -reordering msd-bidirectional-fe -lm 0:3:/home/lingua/smt/Multisensor/news-models/news.en.truecase.irstlm.blm -external-bin-dir /home/lingua/smt/moses-binaries/www.statmt.org_64bit/moses/RELEASE-2.1/binaries/linux-64bit/training-tools -mgiza mgiza -snt2cooc snt2cooc >& ./new/training.out binarising: /home/lingua/smt/moses-binaries/www.statmt.org_64bit/moses/RELEASE-2.1/binaries/linux-64bit/bin/processLexicalTable -in ./new/model/reordering-table.wbe-msd-bidirectional-fe.gz -out ./new/binariesed/reordering-table /home/lingua/smt/moses-binaries/www.statmt.org_64bit/moses/RELEASE-2.1/binaries/linux-64bit/bin/processLexicalTable -in ./new/model/reordering-table.wbe-msd-bidirectional-fe.gz -out ./new/binariesed/reordering-table testing: nohup nice /home/lingua/smt/moses-binaries/www.statmt.org_64bit/moses/RELEASE-2.1/binaries/linux-64bit/bin/moses -f ./new/model/moses-bin.ini <./newstest2013.tok.norm.de > out 2> log Best, Marieh
moses.ini
Description: Binary data
moses-bin.ini
Description: Binary data
log
Description: Binary data
_______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
