hi minh
from your log, there seems to be a mismatch between the moses scripts
and exe programs. Eg.
Can't exec
"/scratch/mbui/tools/mosesdecoder/scripts/../bin/extract": No such file
or directory at
Please do a git pull again. Make sure everything compiles ok. The exe
programs should be in the folder
/bin
Then run again
On 14/06/2012 09:31, Minh Thuong Bui wrote:
Hi Barry,
Please find the log file in the attachment.
Thanks,
Thuong.
On Thu, Jun 14, 2012 at 10:21 AM, Barry Haddow
<[email protected] <mailto:[email protected]>> wrote:
Hi Minh
Could you post your training log so we can check for errors?
Cheers - Barry
Sent from my ZX81
----- Reply message -----
From: "Minh Thuong Bui" <[email protected]
<mailto:[email protected]>>
Date: Thu, Jun 14, 2012 00:38
Subject: [Moses-support] Empty phrase-table
To: "Tom Hoar" <[email protected]
<mailto:[email protected]>>
Cc: <[email protected] <mailto:[email protected]>>
Hi again,
The problem seems to persist with my runs. I tried the following
script:
*nohup nice
/scratch/mbui/tools/mosesdecoder/scripts/training/train-model.perl
-root-dir /scratch/mbui/test/train -external-bin-dir
/scratch/mbui/tools/bin -corpus
/scratch/mbui/test/corpus/news-commentary-v7.fr-en.clean -f fr -e en
-alignment grow-diag-final-and -reordering msd-bidirectional-fe -lm
0:3:/scratch/mbui/test/lm/news-commentary-v7.fr-en.blm.en:8 >&
training.out
&*
It finished without any error, moses.ini was created but the
phrase-talbe
and reordering-table are still empty and I still see the temporary
folder
in train/model as described earlier which i have never seen with
previous
installation of moses.
The only difference i make with this run compared to baseline i built
before with previous installation is that I made a 5-gram language
model. I
not sure if I did something wrong.
Hope to find out the source of the problem soon.
Best,
Thuong.
On Wed, Jun 13, 2012 at 11:00 PM, Minh Thuong Bui
<[email protected] <mailto:[email protected]>>wrote:
> Hi Tom,
>
> Thank you for your answer. I am running with the absolute path
now and
> waiting for the output.
>
> Best,
> Thuong.
>
>
> On Wed, Jun 13, 2012 at 9:13 PM, Tom Hoar <
> [email protected]
<mailto:[email protected]>> wrote:
>
>> Hi Thuong,
>>
>> Your "-root-dir train" option is still a relative path. Try
changing it
>> to the absolute path from root /.
>>
>>
>>
>> Tom
>>
>>
>>
>> On Wed, 13 Jun 2012 20:58:05 +0200, Minh Thuong Bui <
>> [email protected] <mailto:[email protected]>> wrote:
>>
>> Hi Hieu,
>> I have tried with ablosute paths as below but still got empty
phrase
>> table.
>> * nophup nice
>> /scratch/mbui/tools/mosesdecoder/scripts/training/train-model.perl
>> -root-dir train -external-bin-dir /scratch/mbui/tools/bin -corpus
>> /scratch/mbui/test/corpus/news-commentary-v7.fr-en.clean -f fr
-e en
>> -alignment grow-diag-final-and -reordering msd-bidirectional-fe -lm
>> 0:3:/scratch/mbui/test/lm/news-commentary-v7.fr-en.blm.en:8 >&
training.out
>> &*
>>
>> Do you have any clue about what could go wrong?
>> Thanks,
>> Thuong.
>> On Wed, Jun 13, 2012 at 12:54 AM, Minh Thuong Bui <
>> [email protected] <mailto:[email protected]>> wrote:
>>
>>> Hi Hieu,
>>>
>>> Thank you very much for your answer. I will try the absolute
path to see
>>> how it goes.
>>> Best,
>>> Thuong.
>>>
>>>
>>> On Wed, Jun 13, 2012 at 12:42 AM, Hieu Hoang
<[email protected] <mailto:[email protected]>>wrote:
>>>
>>>> Hi thuong
>>>> Please use absolute paths, ie
>>>> /home/thuong/*corpus/news-commentary-v7.de-en.clean*
>>>> *Not
>>>> *
>>>> * **corpus/news-commentary-v7.de-en.clean*
>>>> *
>>>> *
>>>> *The training was changed a few days ago to be parallel and
use less
>>>> disk space. This may have affected the use of relative paths*
>>>> Hieu
>>>> Sent from my flying horse
>>>>
>>>> On 12 Jun 2012, at 05:54 PM, Minh Thuong Bui
<[email protected] <mailto:[email protected]>>
>>>> wrote:
>>>>
>>>> Dear All,
>>>> I installed the newly updated moses 2 days ago and was trying
to run
>>>> training. Strangely, I got empty phrase-table and reordering
table with
>>>> both GIZA++ and MGIZA(0.6.3). I just realized that the
phrase-tale is empty
>>>> when i was running mert. Have somebody encountered the same
problem? Or I
>>>> did something wrong.
>>>> The command i used looks like this:
>>>> *nohup nice
>>>>
/scratch/mbui/tools/mosesdecoder/scripts/training/train-model.perl
>>>> -root-dir train -external-bin-dir /scratch/mbui/tools/giza
-corpus
>>>> corpus/news-commentary-v7.de-en.clean -f de -e en -alignment
>>>> grow-diag-final-and -reordering msd-bidirectional-fe -lm
>>>>
0:3:/scratch/mbui/pp/news-commentary/lm/news-commentary-v7.de-en.blm.en:8
>>>> >& training.out &*
>>>> The training finished normally, the moses.ini was created
and the
>>>> training log file look normal to what i got when running with
previous
>>>> version. I also attach the training log and the moses.ini in
this email.
>>>> Also, in the model folder, the temporary folder is always there
>>>> after training has finished, in the temporary folder there
are 2 files:
>>>> extract.0.gz and run.0.sh <http://run.0.sh>. This seems
strange compared to what i got
>>>> running the older version.
>>>> Best,
>>>> Thuong.
>>>>
>>>> _______________________________________________
>>>>
>>>> Moses-support mailing list
>>>> [email protected] <mailto:[email protected]>
>>>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>>>
>>>>
>
The University of Edinburgh is a charitable body, registered in
Scotland, with registration number SC005336.
_______________________________________________
Moses-support mailing list
[email protected]
http://mailman.mit.edu/mailman/listinfo/moses-support
_______________________________________________
Moses-support mailing list
[email protected]
http://mailman.mit.edu/mailman/listinfo/moses-support
