Hi Janez > In my opinion there are two things that need to be somehow described > or corrected in the Moses baseline: > 1. Notify the user about the location of the Giza++ utilities > (mosesdecoder/tools or mosesdecoder/giza++) and need to rename the > folders to the one used in command.
The instructions already ask you to copy the GIZA++ utilities to the tools directory, you must have missed out that step. > 2. Remove the last "&" char in the command, listed in the baseline. The "&" is correct, it runs the command in the background, which is why it returns instantly. This is quite a normal thing to do in a UNIX environment. cheers - Barry On 05/03/14 09:43, Janez Kadivec wrote: > Hi, > > thank you for your help. The added "yes" parameter resolved the > situation. We are following the Moses baseline, published in the > official Moses web site: > http://www.statmt.org/moses/?n=moses.baseline > > Please correct the last command in the Language Model Traning section. > The command is marked with red color. > mkdir ~/lm > cd ~/lm > ~/irstlm/bin/add-start-end.sh \ > < ~/corpus/news-commentary-v8.fr-en.true.en \ > > news-commentary-v8.fr-en.sb.en > export IRSTLM=$HOME/irstlm; ~/irstlm/bin/build-lm.sh \ > -i news-commentary-v8.fr-en.sb.en \ > -t ./tmp -p -s improved-kneser-ney -o news-commentary-v8.fr-en.lm.en > * ~/irstlm/bin/compile-lm --text news-commentary-v8.fr-en.lm.en.gz \ > news-commentary-v8.fr-en.arpa.en* > > .................... > We followed the same baseline. In the Training the Translation System > we found the next inconsistency: > We installed the Moses and part of it was also Giza++ installed under > the ...mosesdecoder\giza++1.0.7. > We executed the following commands from the Training the Translation > System section: > mkdir ~/working > cd ~/working > nohup nice ~/mosesdecoder/scripts/training/train-model.perl -root-dir train > \ > -corpus ~/corpus/news-commentary-v8.fr-en.clean > \ > -f fr -e en -alignment grow-diag-final-and -reordering msd-bidirectional-fe > \ > -lm 0:3:$HOME/lm/news-commentary-v8.fr-en.blm.en:8 > \ > -external-bin-dir ~/mosesdecoder/tools >& training.out & > During the execution of the last command (marked with green color) > here was an error saying that the mkcls utility is not found. > It's not found because in the "initial" installation there is no tools > subdirectory. We renamed the Giza++107 directory to "tools". > The command was executed instantly with no results. So we removed the > last character "&" from the command. It's working now for about half > an hour. ;) > > In my opinion there are two things that need to be somehow described > or corrected in the Moses baseline: > 1. Notify the user about the location of the Giza++ utilities > (mosesdecoder/tools or mosesdecoder/giza++) and need to rename the > folders to the one used in command. > 2. Remove the last "&" char in the command, listed in the baseline. > > Have a nice rest of the day. > Janez > > > Seth syggested you the right fix > > I just checked the IRSTLM documentation > > http://sourceforge.net/apps/mediawiki/irstlm/index.php?title=Estimating_gigantic_models > and the correct notation is reported there. > > Could you please tell me from where do you get the "wrong" information > So that I correct it. > > > Nicola > (on behalf of IRSTLM development team) > > > > On Mar 5, 2014, at 1:36 AM, Seth Jarrett wrote: > > First four commands were executed successfuly. The last one > failed. Here > is the result after entering the following command line:zzz <at> > zzz-laptop:~/lm$ ~/moses/irstlm/bin/compile-lm --text > news-commentary-v8.fr-en.lm.en.gz news-commentary-v8.fr-en.arpa.en > > inpfile: news-commentary-v8.fr-en.arpa.enloading up to the LM > level 1000 > (if any) > dub: 10000000Failed to open news-commentary-v8.fr-en.arpa.en!zzz <at> > zzz-laptop:~/lm$ ----------------Where we made a mistake? I see the > xxx.arpa.en listed as input file. Shouldn't be the xxx.arpa.en file an > output file?Best regards! > > > I was having the same problem when following the steps in the baseline > instructions but I was able to get it to work by adding "yes" > after --text. > > Try this: > > ~/moses/irstlm/bin/compile-lm --text yes > news-commentary-v8.fr-en.lm.en.gz > news-commentary-v8.fr-en.arpa.en > > > _______________________________________________ > Moses-support mailing list > [email protected] > <mailto:[email protected]><mailto:[email protected] > <mailto:[email protected]>> > http://mailman.mit.edu/mailman/listinfo/moses-support > > > Call > Send SMS > Add to Skype > You'll need Skype CreditFree via Skype > > > _______________________________________________ > Moses-support mailing list > [email protected] > http://mailman.mit.edu/mailman/listinfo/moses-support -- The University of Edinburgh is a charitable body, registered in Scotland, with registration number SC005336. _______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
