Hi, I'm a beginnner in Linux... so I like to see things happening in the foreground :) If there is no need to change the command... don't do that... ;)
Obviously I overlooked and did not go through the section of copying the giza++ utilities to the tools directory. Thank you for your help. Janez On Wed, Mar 5, 2014 at 11:01 AM, Barry Haddow <bhad...@staffmail.ed.ac.uk>wrote: > Hi Janez > > In my opinion there are two things that need to be somehow described or >> corrected in the Moses baseline: >> 1. Notify the user about the location of the Giza++ utilities >> (mosesdecoder/tools or mosesdecoder/giza++) and need to rename the folders >> to the one used in command. >> > > The instructions already ask you to copy the GIZA++ utilities to the tools > directory, you must have missed out that step. > > 2. Remove the last "&" char in the command, listed in the baseline. >> > > The "&" is correct, it runs the command in the background, which is why it > returns instantly. This is quite a normal thing to do in a UNIX environment. > > cheers - Barry > > > On 05/03/14 09:43, Janez Kadivec wrote: > >> Hi, >> >> thank you for your help. The added "yes" parameter resolved the >> situation. We are following the Moses baseline, published in the official >> Moses web site: >> http://www.statmt.org/moses/?n=moses.baseline >> >> Please correct the last command in the Language Model Traning section. >> The command is marked with red color. >> mkdir ~/lm >> cd ~/lm >> ~/irstlm/bin/add-start-end.sh \ >> < ~/corpus/news-commentary-v8.fr-en.true.en \ >> > news-commentary-v8.fr-en.sb.en >> export IRSTLM=$HOME/irstlm; ~/irstlm/bin/build-lm.sh \ >> -i news-commentary-v8.fr-en.sb.en \ >> -t ./tmp -p -s improved-kneser-ney -o news-commentary-v8.fr-en.lm.en >> * ~/irstlm/bin/compile-lm --text news-commentary-v8.fr-en.lm.en.gz \ >> news-commentary-v8.fr-en.arpa.en* >> >> .................... >> We followed the same baseline. In the Training the Translation System we >> found the next inconsistency: >> We installed the Moses and part of it was also Giza++ installed under the >> ...mosesdecoder\giza++1.0.7. >> We executed the following commands from the Training the Translation >> System section: >> mkdir ~/working >> cd ~/working >> nohup nice ~/mosesdecoder/scripts/training/train-model.perl -root-dir >> train \ >> -corpus ~/corpus/news-commentary-v8.fr-en.clean >> \ >> -f fr -e en -alignment grow-diag-final-and -reordering >> msd-bidirectional-fe \ >> -lm 0:3:$HOME/lm/news-commentary-v8.fr-en.blm.en:8 >> \ >> -external-bin-dir ~/mosesdecoder/tools >& training.out & >> During the execution of the last command (marked with green color) here >> was an error saying that the mkcls utility is not found. >> It's not found because in the "initial" installation there is no tools >> subdirectory. We renamed the Giza++107 directory to "tools". >> The command was executed instantly with no results. So we removed the >> last character "&" from the command. It's working now for about half an >> hour. ;) >> >> In my opinion there are two things that need to be somehow described or >> corrected in the Moses baseline: >> 1. Notify the user about the location of the Giza++ utilities >> (mosesdecoder/tools or mosesdecoder/giza++) and need to rename the folders >> to the one used in command. >> 2. Remove the last "&" char in the command, listed in the baseline. >> >> Have a nice rest of the day. >> Janez >> >> >> Seth syggested you the right fix >> >> I just checked the IRSTLM documentation >> http://sourceforge.net/apps/mediawiki/irstlm/index.php? >> title=Estimating_gigantic_models >> and the correct notation is reported there. >> >> Could you please tell me from where do you get the "wrong" information >> So that I correct it. >> >> >> Nicola >> (on behalf of IRSTLM development team) >> >> >> >> On Mar 5, 2014, at 1:36 AM, Seth Jarrett wrote: >> >> First four commands were executed successfuly. The last one >> failed. Here >> is the result after entering the following command line:zzz <at> >> zzz-laptop:~/lm$ ~/moses/irstlm/bin/compile-lm --text >> news-commentary-v8.fr-en.lm.en.gz news-commentary-v8.fr-en.arpa.en >> >> inpfile: news-commentary-v8.fr-en.arpa.enloading up to the LM >> level 1000 >> (if any) >> dub: 10000000Failed to open news-commentary-v8.fr-en.arpa.en!zzz <at> >> zzz-laptop:~/lm$ ----------------Where we made a mistake? I see the >> xxx.arpa.en listed as input file. Shouldn't be the xxx.arpa.en file an >> output file?Best regards! >> >> >> I was having the same problem when following the steps in the baseline >> instructions but I was able to get it to work by adding "yes" >> after --text. >> >> Try this: >> >> ~/moses/irstlm/bin/compile-lm --text yes >> news-commentary-v8.fr-en.lm.en.gz >> news-commentary-v8.fr-en.arpa.en >> >> >> _______________________________________________ >> Moses-support mailing list >> Moses-support@mit.edu >> <mailto:Moses-support@mit.edu><mailto:Moses-support@mit.edu >> <mailto:Moses-support@mit.edu>> >> http://mailman.mit.edu/mailman/listinfo/moses-support >> >> >> Call >> Send SMS >> Add to Skype >> You'll need Skype CreditFree via Skype >> >> >> _______________________________________________ >> Moses-support mailing list >> Moses-support@mit.edu >> http://mailman.mit.edu/mailman/listinfo/moses-support >> > > > -- > The University of Edinburgh is a charitable body, registered in > Scotland, with registration number SC005336. > > Call Send SMS Add to Skype You'll need Skype CreditFree via Skype
_______________________________________________ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support
