Hi Hieu, I changed from relative path to absolute. Still same error. Thanks, Steve
On Thu, Sep 15, 2016 at 8:54 PM, Hieu Hoang <[email protected]> wrote: > don't use relative paths, ie. change > filtered-newstest2011 -> /whatever/filtered-newstest2011 > mert-work/moses.ini -> /whatever/mert-work/moses.ini > > > Hieu Hoang > http://www.hoang.co.uk/hieu > > On 16 September 2016 at 05:42, Steve Braich <[email protected]> wrote: > >> Hello, >> >> I am going thru the steps described in the baseline system instructions. >> I have no problems until the very end when I try to filter out the test >> data from the binarised model. >> >> >> >> Here is the step in the instructions where the error appears: >> >> *The model that we've trained can then be filtered for this test set, >> meaning that we only retain the entries needed translate the test set. This >> will make the translation a lot faster.* >> >> >> >> *cd ~/working* >> >> *~/mosesdecoder/scripts/training/filter-model-given-input.pl >> <http://filter-model-given-input.pl> filtered-newstest2011 >> mert-work/moses.ini ~/corpus/newstest2011.true.fr >> <http://newstest2011.true.fr> -Binarizer >> ~/mosesdecoder/bin/processPhraseTableMin* >> >> >> >> Here is the error message: >> >> *Can't open '< /home/steve/working/binarised-model/reordering-table' at >> /home/steve/mosesdecoder/scripts/training/filter-model-given-input.pl >> <http://filter-model-given-input.pl> line 439.* >> >> >> >> Keep in mind the following: >> >> - I compiled moses with the following parameters. It is the same >> compilation. I did not recompile moses at any point during the process. >> ./bjam -a --with-boost=/home/steve/mosesdecoder/boost_1_55_0 >> --with-cmph=$HOME/mosesdecoder/cmph/cmph-2.0 >> NOTE: I did try recompiling with the absolute path for cmph. Same >> error. >> - I checked all paths first to make sure they exist. >> - I am able to translate segments using the binarised model with no >> problem >> - I provided my moses.ini file below. >> >> Questions: >> >> - Can I recompile moses after training and/or tuning, and expect that >> it should work for testing? I ask because I want to know if the solution >> is to modify the compile options, do I have to start from scratch again? >> (Can you filter a binarised model using moses with different compile >> options that were used to train the model?) >> >> Thanks, >> Steve >> >> >> Moses.ini file >> >> # MERT optimized configuration >> >> # decoder /home/steve/mosesdecoder/bin/moses >> >> # BLEU 0.18611 on dev /home/steve/corpus/news-test2008.true.fr >> >> # We were before running iteration 5 >> >> # finished Thu Sep 15 01:53:22 PDT 2016 >> >> ### MOSES CONFIG FILE ### >> >> ######################### >> >> >> # input factors >> >> [input-factors] >> >> 0 >> >> >> # mapping steps >> >> [mapping] >> >> 0 T 0 >> >> >> [distortion-limit] >> >> 6 >> >> >> # feature functions >> >> [feature] >> >> UnknownWordPenalty >> >> WordPenalty >> >> PhrasePenalty >> >> PhraseDictionaryCompact name=TranslationModel0 num-features=4 >> path=/home/steve/working/binarised-model/phrase-table.minphr >> input-factor=0 output-factor=0 >> >> LexicalReordering name=LexicalReordering0 num-features=6 >> type=wbe-msd-bidirectional-fe-allff input-factor=0 output-factor=0 >> path=/home/steve/working/binarised-model/reordering-table >> >> Distortion >> >> KENLM name=LM0 factor=0 path=/home/steve/lm/news-commentary-v8.fr-en.blm.en >> order=3 >> >> >> # dense weights for feature functions >> >> >> [threads] >> >> 4 >> >> [weight] >> >> >> LexicalReordering0= 0.0760973 0.0426988 0.0872591 0.0872621 0.0141898 >> 0.0348721 >> >> Distortion0= 0.0721205 >> >> LM0= 0.0908638 >> >> WordPenalty0= -0.153776 >> >> PhrasePenalty0= 0.0874059 >> >> TranslationModel0= 0.0162038 0.0871216 0.0687163 0.0814132 >> >> UnknownWordPenalty0= 1 >> >> >> _______________________________________________ >> Moses-support mailing list >> [email protected] >> http://mailman.mit.edu/mailman/listinfo/moses-support >> >> >
_______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
