Indeed.
On this box I will not be making use of the decoder and most of the Moses software. All I need is for the training script to complete and to be able to use evaluation scripts to output bleu scores at the end. Will be using own custom translation software. Just need a phrase table to extract information from to make own custom translation tables. Which binaries need to be compiled to make the training script complete? Any suggestions for modifications to install scripts so I can install only the essential components would be most welcomed. James ________________________________ From: [email protected] <[email protected]> on behalf of Philipp Koehn <[email protected]> Sent: Wednesday, December 2, 2015 9:22 PM To: Read, James C Cc: Moses Support Subject: Re: [Moses-support] Exit code: 127 ERROR: Can't generate symmetrized alignment file Hi, it looks like that symal was not compiled - it should be in $MOSES/bin Can you check what went wrong during compilation? -phi On Wed, Dec 2, 2015 at 10:21 AM, Read, James C <[email protected]<mailto:[email protected]>> wrote: nohup nice /media/bigdata/jcread/3rd_party_software/mosesdecoder/scripts/training/train-model.perl -root-dir phrase_table -corpus /media/bigdata/jcread/llv/data/europarlv7/prealigned/tokenized_truecased_cleaned/1-0010/00001000/europarl-v7.it-en.1-0010.00001000 -f it -e en -alignment grow-diag-final-and -reordering msd-bidirectional-fe -lm 0:3:/media/bigdata/jcread/llv/lm:8 -external-bin-dir /media/bigdata/jcread/3rd_party_software/bin >& training.out & Runs well for a while and then bombs out with following output and Error 127 (3) generate word alignment @ Wed Dec 2 01:56:06 GMT 2015 Combining forward and inverted alignment from files: /media/bigdata/jcread/llv/data/europarlv7/prealigned/tokenized_truecased_cleaned/1-0010/00001000/phrase_table/giza.it-en/it-en.A3.final.{bz2,gz} /media/bigdata/jcread/llv/data/europarlv7/prealigned/tokenized_truecased_cleaned/1-0010/00001000/phrase_table/giza.en-it/en-it.A3.final.{bz2,gz} Executing: mkdir -p /media/bigdata/jcread/llv/data/europarlv7/prealigned/tokenized_truecased_cleaned/1-0010/00001000/phrase_table/model Executing: /media/bigdata/jcread/3rd_party_software/mosesdecoder/scripts/training/giza2bal.pl<http://giza2bal.pl> -d "gzip -cd /media/bigdata/jcread/llv/data/europarlv7/prealigned/tokenized_truecased_cleaned/1-0010/00001000/phrase_table/giza.en-it/en-it.A3.final.gz" -i "gzip -cd /media/bigdata/jcread/llv/data/europarlv7/prealigned/tokenized_truecased_cleaned/1-0010/00001000/phrase_table/giza.it-en/it-en.A3.final.gz" |/media/bigdata/jcread/3rd_party_software/mosesdecoder/scripts/../bin/symal -alignment="grow" -diagonal="yes" -final="yes" -both="yes" > /media/bigdata/jcread/llv/data/europarlv7/prealigned/tokenized_truecased_cleaned/1-0010/00001000/phrase_table/model/aligned.grow-diag-final-and sh: 1: /media/bigdata/jcread/3rd_party_software/mosesdecoder/scripts/../bin/symal: not found Exit code: 127 ERROR: Can't generate symmetrized alignment file It seems this problem with the script has been encountered before: http://comments.gmane.org/gmane.comp.nlp.moses.user/10489 I'm not sure I understand the accepted solution. "Use absolute paths to all the scripts, and make sure your parallel files have the same names but the extension" The command I issued uses only absolute paths. Is this referring to modifications in the training script itself? James _______________________________________________ Moses-support mailing list [email protected]<mailto:[email protected]> http://mailman.mit.edu/mailman/listinfo/moses-support
_______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
