Hi Hieu, Thank you very much for your support. I think i got some errors while compiling moses. I recompiled it and now see the binary exe in mosesdecoder/bin now. I am running the training again and I think it's going to work.
Thank again, Thuong. On Thu, Jun 14, 2012 at 2:07 PM, Hieu Hoang <[email protected]>wrote: > hi minh > > from your log, there seems to be a mismatch between the moses scripts and > exe programs. Eg. > Can't exec "/scratch/mbui/tools/mosesdecoder/scripts/../bin/extract": > No such file or directory at > > Please do a git pull again. Make sure everything compiles ok. The exe > programs should be in the folder > /bin > Then run again > > > On 14/06/2012 09:31, Minh Thuong Bui wrote: > > Hi Barry, > Please find the log file in the attachment. > > Thanks, > Thuong. > > On Thu, Jun 14, 2012 at 10:21 AM, Barry Haddow <[email protected] > > wrote: > >> Hi Minh >> >> Could you post your training log so we can check for errors? >> >> Cheers - Barry >> >> Sent from my ZX81 >> >> >> ----- Reply message ----- >> From: "Minh Thuong Bui" <[email protected]> >> Date: Thu, Jun 14, 2012 00:38 >> Subject: [Moses-support] Empty phrase-table >> To: "Tom Hoar" <[email protected]> >> Cc: <[email protected]> >> >> >> Hi again, >> The problem seems to persist with my runs. I tried the following script: >> >> *nohup nice >> >> /scratch/mbui/tools/mosesdecoder/scripts/training/train-model.perl >> -root-dir /scratch/mbui/test/train -external-bin-dir >> /scratch/mbui/tools/bin -corpus >> /scratch/mbui/test/corpus/news-commentary-v7.fr-en.clean -f fr -e en >> -alignment grow-diag-final-and -reordering msd-bidirectional-fe -lm >> 0:3:/scratch/mbui/test/lm/news-commentary-v7.fr-en.blm.en:8 >& >> training.out >> &* >> >> >> It finished without any error, moses.ini was created but the phrase-talbe >> and reordering-table are still empty and I still see the temporary folder >> in train/model as described earlier which i have never seen with previous >> installation of moses. >> The only difference i make with this run compared to baseline i built >> before with previous installation is that I made a 5-gram language model. >> I >> not sure if I did something wrong. >> >> Hope to find out the source of the problem soon. >> >> Best, >> Thuong. >> >> >> On Wed, Jun 13, 2012 at 11:00 PM, Minh Thuong Bui >> <[email protected]>wrote: >> >> > Hi Tom, >> > >> > Thank you for your answer. I am running with the absolute path now and >> > waiting for the output. >> > >> > Best, >> > Thuong. >> > >> > >> > On Wed, Jun 13, 2012 at 9:13 PM, Tom Hoar < >> > [email protected]> wrote: >> > >> >> Hi Thuong, >> >> >> >> Your "-root-dir train" option is still a relative path. Try changing it >> >> to the absolute path from root /. >> >> >> >> >> >> >> >> Tom >> >> >> >> >> >> >> >> On Wed, 13 Jun 2012 20:58:05 +0200, Minh Thuong Bui < >> >> [email protected]> wrote: >> >> >> >> Hi Hieu, >> >> I have tried with ablosute paths as below but still got empty phrase >> >> table. >> >> * nophup nice >> >> >> /scratch/mbui/tools/mosesdecoder/scripts/training/train-model.perl >> >> -root-dir train -external-bin-dir /scratch/mbui/tools/bin -corpus >> >> /scratch/mbui/test/corpus/news-commentary-v7.fr-en.clean -f fr -e en >> >> -alignment grow-diag-final-and -reordering msd-bidirectional-fe -lm >> >> 0:3:/scratch/mbui/test/lm/news-commentary-v7.fr-en.blm.en:8 >& >> training.out >> >> &* >> >> >> >> >> Do you have any clue about what could go wrong? >> >> Thanks, >> >> Thuong. >> >> On Wed, Jun 13, 2012 at 12:54 AM, Minh Thuong Bui < >> >> [email protected]> wrote: >> >> >> >>> Hi Hieu, >> >>> >> >>> Thank you very much for your answer. I will try the absolute path to >> see >> >>> how it goes. >> >>> Best, >> >>> Thuong. >> >>> >> >>> >> >>> On Wed, Jun 13, 2012 at 12:42 AM, Hieu Hoang < >> [email protected]>wrote: >> >>> >> >>>> Hi thuong >> >>>> Please use absolute paths, ie >> >>>> /home/thuong/*corpus/news-commentary-v7.de-en.clean* >> >>>> *Not >> >>>> * >> >>>> * **corpus/news-commentary-v7.de-en.clean* >> >>>> * >> >>>> * >> >>>> *The training was changed a few days ago to be parallel and use less >> >>>> disk space. This may have affected the use of relative paths* >> >> >>>> Hieu >> >>>> Sent from my flying horse >> >>>> >> >>>> On 12 Jun 2012, at 05:54 PM, Minh Thuong Bui < >> [email protected]> >> >>>> wrote: >> >>>> >> >>>> Dear All, >> >>>> I installed the newly updated moses 2 days ago and was trying to run >> >>>> training. Strangely, I got empty phrase-table and reordering table >> with >> >>>> both GIZA++ and MGIZA(0.6.3). I just realized that the phrase-tale >> is empty >> >>>> when i was running mert. Have somebody encountered the same problem? >> Or I >> >>>> did something wrong. >> >>>> The command i used looks like this: >> >>>> *nohup nice >> >> >>>> /scratch/mbui/tools/mosesdecoder/scripts/training/train-model.perl >> >>>> -root-dir train -external-bin-dir /scratch/mbui/tools/giza -corpus >> >>>> corpus/news-commentary-v7.de-en.clean -f de -e en -alignment >> >>>> grow-diag-final-and -reordering msd-bidirectional-fe -lm >> >>>> >> 0:3:/scratch/mbui/pp/news-commentary/lm/news-commentary-v7.de-en.blm.en:8 >> >>>> >& training.out &* >> >> >>>> The training finished normally, the moses.ini was created and the >> >>>> training log file look normal to what i got when running with >> previous >> >>>> version. I also attach the training log and the moses.ini in this >> email. >> >>>> Also, in the model folder, the temporary folder is always there >> >>>> after training has finished, in the temporary folder there are 2 >> files: >> >>>> extract.0.gz and run.0.sh. This seems strange compared to what i got >> >>>> running the older version. >> >>>> Best, >> >>>> Thuong. >> >>>> >> >>>> _______________________________________________ >> >>>> >> >>>> Moses-support mailing list >> >>>> [email protected] >> >>>> http://mailman.mit.edu/mailman/listinfo/moses-support >> >>>> >> >>>> >> > >> >> >> >> The University of Edinburgh is a charitable body, registered in >> Scotland, with registration number SC005336. >> >> > > > _______________________________________________ > Moses-support mailing > [email protected]http://mailman.mit.edu/mailman/listinfo/moses-support > > > _______________________________________________ > Moses-support mailing list > [email protected] > http://mailman.mit.edu/mailman/listinfo/moses-support > >
_______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
