Thanks, Barry.
The following is the output file of one of the qsub jobs:
Linux ubuntu11 3.2.0-24-generic #39-Ubuntu SMP Mon May 21 16:52:17 UTC 2012
x86_64 x86_64 x86_64 GNU/Linux
Defined parameters (per moses.ini or switch):
config:
/home/guchun/Data/mt-files/tests/exp-new-training/model/EN_US-FR_FR//evaluation/model.filtered.ini.1
cube-pruning-pop-limit: 5000
distortion-file: 0-0 wbe-msd-bidirectional-fe-allff 6
/home/guchun/Data/mt-files/tests/exp-new-training/model/EN_US-FR_FR//evaluation/model.filtered.1/reordering-table.1.0-0.wbe-msd-bidirectional-fe
distortion-limit: 6
input-factors: 0
input-file: model.input.tc.1.split16701-aa
inputtype: 0
lmodel-file: 0 0 7
/home/guchun/Data/mt-files/tests/exp-new-training/model/EN_US-FR_FR//lm/model.lm.1
0 1 7
/home/guchun/Data/mt-files/tests/exp-new-training/model/EN_US-FR_FR//lm/model=pos.lm.1
mapping: 0 T 0
search-algorithm: 1
stack: 5000
ttable-file: 1 0 0,1 5
/home/guchun/Data/mt-files/tests/exp-new-training/model/EN_US-FR_FR//evaluation/model.filtered.1/phrase-table.0-0,1.1.1
ttable-limit: 20
weight-d: 0.063647 0.0630623 0.0827805 0.0571843 0.0856819
0.0255637 0.0459574
weight-l: 0.139309 0.0196229
weight-t: 0.136273 0.0197609 0.021245 0.0725207 -0.0529247
weight-w: -0.114467
*ERROR:illegal switch: -t-text-type*
exit status 1
exit status 0
I checked -t wasn't present in the config file but appeared in the command.
A typo in mert-moses.pl?
I will pull the change you made and try it out in a moment.
Cheers,
Guchun
On 9 November 2012 12:15, Barry Haddow <[email protected]> wrote:
> Hi Guchun
>
> I've pushed a change that may fix the second error. Can you let me know,
> and if it doesn't fix it, can you send me your ini file to help with
> testing.
>
> For the first error, could you post one of the decoder log files to see
> why the decoder is crashing,
>
> cheers - Barry
>
>
> On 09/11/12 11:15, Guchun Zhang wrote:
>
>> Hi there,
>>
>> I hope you can help me out with two new problems after installing a new
>> Moses commit. I have spent some time on them, but to no avail.
>>
>> The first occurred during decode. The command is
>>
>> #####
>> /home/guchun/Work/moses/moses-**scripts/generic/moses-**parallel.pl<http://moses-parallel.pl><
>> http://moses-parallel.pl> -decoder
>> /home/guchun/Work/moses/**mosesdecoder/bin/moses
>> -config /home/guchun/Data/mt-files/**tests/exp-new-training/model/**
>> EN_US-FR_FR//evaluation/model.**filtered.ini.1 -input-file
>> /home/guchun/Data/mt-files/**tests/exp-new-training/model/**
>> EN_US-FR_FR//evaluation/model.**input.tc.1 *--jobs 32*
>> -decoder-parameters "-search-algorithm 1 -cube-pruning-pop-limit 5000 -s
>> 5000 -t" > /home/guchun/Data/mt-files/**tests/exp-new-training/model/**
>> EN_US-FR_FR//evaluation/model.**output.2 -text-type "test"
>>
>> #####
>>
>> The models are built using the EMS factored example. The error message is
>>
>> -----
>> Split (-aa) were not entirely translated
>> outputN=0 inputN=36
>> outputfile=model.input.tc.1.**split17159-aa.trans
>> inputfile=model.input.tc.1.**split17159-aa
>> ....
>> everything crashed, not trying to resubmit jobs
>> Got interrupt or something failed.
>> kill_all_and_quit
>> qdel 17791
>> Executing: qdel 17791
>> Exit code: 1
>> ....
>> Translation was not performed correctly
>> or some of the submitted jobs died.
>> qdel function was called for all submitted jobs
>> -----
>>
>> Using bin/moses -thread 32 .... works fine.
>>
>> The second error is during the first iteration of tuning with a corpus
>> having 4 factors. The command is
>>
>> #####
>> /home/guchun/Work/moses/moses-**scripts/training/mert-moses.pl <
>> http://mert-moses.pl> /home/guchun/Data/mt-files/**
>> tests/exp-new-training/model/**EN_US-FR_FR/rb//tuning/input.**tc.1
>> /home/guchun/Data/mt-files/**tests/exp-new-training/model/**
>> EN_US-FR_FR/rb//tuning/**reference.tc.1
>> /home/guchun/Work/moses/**mosesdecoder/bin/moses
>> /home/guchun/Data/mt-files/**tests/exp-new-training/model/**
>> EN_US-FR_FR/rb//tuning/moses.**filtered.ini.2 --nbest 100 --working-dir
>> /home/guchun/Data/mt-files/**tests/exp-new-training/model/**EN_US-FR_FR/rb//tuning/tmp.2
>> --decoder-flags "" --rootdir /home/guchun/Work/moses/moses-**scripts
>> -mertdir /home/guchun/Work/moses/**mosesdecoder/bin
>> --no-filter-phrase-table *--jobs 32*
>>
>> #####
>>
>> The error message is
>>
>> -----
>> The decoder returns the scores in this order: d d d d d d d lm lm w tm tm
>> tm tm tm tm tm tm tm tm tm tm tm tm tm g g g g
>> Mismatched lambdas. Decoder returned d d d d d d d lm lm w tm tm tm tm tm
>> tm tm tm tm tm tm tm tm tm tm g g g g, we expected d d d d d d d lm lm w tm
>> tm tm tm tm g g tm tm tm tm tm g g tm tm tm tm tm at
>> /home/guchun/Work/moses/moses-**scripts/training/mert-moses.pl <
>> http://mert-moses.pl> line 1155.
>>
>> -----
>>
>> I never had these problems with a previous commit back in March. Any
>> hints will be warmly welcomed.
>>
>> Many thanks,
>>
>> Guchun
>>
>>
>> ______________________________**_________________
>> Moses-support mailing list
>> [email protected]
>> http://mailman.mit.edu/**mailman/listinfo/moses-support<http://mailman.mit.edu/mailman/listinfo/moses-support>
>>
>
>
> --
> The University of Edinburgh is a charitable body, registered in
> Scotland, with registration number SC005336.
>
>
>
_______________________________________________
Moses-support mailing list
[email protected]
http://mailman.mit.edu/mailman/listinfo/moses-support
