Hi Barry,

I am doing it now. :-)

Cheers,

Guchun

On 9 November 2012 13:35, Barry Haddow <[email protected]> wrote:

> Hi Guchun
>
> The -text-type problem should be fixed by a commit I made yesterday. I
> haven't tested SGE operation though, so can you try again with the latest
> EMS?
>
> cheers - Barry
>
>
> On 09/11/12 13:26, Guchun Zhang wrote:
>
>> Thanks, Barry.
>>
>> The following is the output file of one of the qsub jobs:
>>
>> Linux ubuntu11 3.2.0-24-generic #39-Ubuntu SMP Mon May 21 16:52:17 UTC
>> 2012 x86_64 x86_64 x86_64 GNU/Linux
>> Defined parameters (per moses.ini or switch):
>>         config: /home/guchun/Data/mt-files/**
>> tests/exp-new-training/model/**EN_US-FR_FR//evaluation/model.**filtered.ini.1
>>
>>         cube-pruning-pop-limit: 5000
>>         distortion-file: 0-0 wbe-msd-bidirectional-fe-allff 6
>> /home/guchun/Data/mt-files/**tests/exp-new-training/model/**
>> EN_US-FR_FR//evaluation/model.**filtered.1/reordering-table.1.**0-0.wbe-msd-bidirectional-fe
>>
>>         distortion-limit: 6
>>         input-factors: 0
>>         input-file: model.input.tc.1.split16701-aa
>>         inputtype: 0
>>         lmodel-file: 0 0 7 /home/guchun/Data/mt-files/**
>> tests/exp-new-training/model/**EN_US-FR_FR//lm/model.lm.1 0 1 7
>> /home/guchun/Data/mt-files/**tests/exp-new-training/model/**EN_US-FR_FR//lm/model=pos.lm.1
>>
>>         mapping: 0 T 0
>>         search-algorithm: 1
>>         stack: 5000
>>         ttable-file: 1 0 0,1 5 /home/guchun/Data/mt-files/**
>> tests/exp-new-training/model/**EN_US-FR_FR//evaluation/model.**
>> filtered.1/phrase-table.0-0,1.**1.1
>>         ttable-limit: 20
>>         weight-d: 0.063647 0.0630623 0.0827805 0.0571843 0.0856819
>> 0.0255637 0.0459574
>>         weight-l: 0.139309 0.0196229
>>         weight-t: 0.136273 0.0197609 0.021245 0.0725207 -0.0529247
>>         weight-w: -0.114467
>> *ERROR:illegal switch: -t-text-type*
>>
>> exit status 1
>> exit status 0
>>
>> I checked -t wasn't present in the config file but appeared in the
>> command. A typo in mert-moses.pl <http://mert-moses.pl>?
>>
>>
>> I will pull the change you made and try it out in a moment.
>>
>> Cheers,
>>
>> Guchun
>> On 9 November 2012 12:15, Barry Haddow <[email protected]<mailto:
>> [email protected].**ac.uk <[email protected]>>> wrote:
>>
>>     Hi Guchun
>>
>>     I've pushed a change that may fix the second error. Can you let me
>>     know, and if it doesn't fix it, can you send me your ini file to
>>     help with testing.
>>
>>     For the first error, could you post one of the decoder log files
>>     to see why the decoder is crashing,
>>
>>     cheers - Barry
>>
>>
>>     On 09/11/12 11:15, Guchun Zhang wrote:
>>
>>         Hi there,
>>
>>         I hope you can help me out with two new problems after
>>         installing a new Moses commit. I have spent some time on them,
>>         but to no avail.
>>
>>         The first occurred during decode. The command is
>>
>>         #####
>>         /home/guchun/Work/moses/moses- scripts/generic/moses-
>>         parallel.pl <http://moses-parallel.pl>
>>         <http://moses-parallel.pl> -decoder /home/guchun/Work/moses/
>>         mosesdecoder/bin/moses -config /home/guchun/Data/mt-files/
>>         tests/exp-new-training/model/ EN_US-FR_FR//evaluation/model.
>>         filtered.ini.1 -input-file /home/guchun/Data/mt-files/
>>         tests/exp-new-training/model/ EN_US-FR_FR//evaluation/model.
>>
>>         input.tc.1 *--jobs 32* -decoder-parameters "-search-algorithm
>>         1 -cube-pruning-pop-limit 5000 -s 5000 -t" >
>>         /home/guchun/Data/mt-files/ tests/exp-new-training/model/
>>         EN_US-FR_FR//evaluation/model. output.2 -text-type "test"
>>
>>
>>         #####
>>
>>         The models are built using the EMS factored example. The error
>>         message is
>>
>>         -----
>>         Split (-aa) were not entirely translated
>>         outputN=0 inputN=36
>>         outputfile=model.input.tc.1. split17159-aa.trans
>>         inputfile=model.input.tc.1. split17159-aa
>>         ....
>>         everything crashed, not trying to resubmit jobs
>>         Got interrupt or something failed.
>>         kill_all_and_quit
>>         qdel 17791
>>         Executing: qdel 17791
>>         Exit code: 1
>>         ....
>>         Translation was not performed correctly
>>         or some of the submitted jobs died.
>>         qdel function was called for all submitted jobs
>>         -----
>>
>>         Using bin/moses -thread 32 .... works fine.
>>
>>         The second error is during the first iteration of tuning with
>>         a corpus having 4 factors. The command is
>>
>>         #####
>>         /home/guchun/Work/moses/moses- scripts/training/mert-moses.pl
>>         <http://mert-moses.pl> <http://mert-moses.pl>
>>         /home/guchun/Data/mt-files/ tests/exp-new-training/model/
>>         EN_US-FR_FR/rb//tuning/input. tc.1 /home/guchun/Data/mt-files/
>>         tests/exp-new-training/model/ EN_US-FR_FR/rb//tuning/
>>         reference.tc.1 /home/guchun/Work/moses/ mosesdecoder/bin/moses
>>         /home/guchun/Data/mt-files/ tests/exp-new-training/model/
>>         EN_US-FR_FR/rb//tuning/moses. filtered.ini.2 --nbest 100
>>         --working-dir /home/guchun/Data/mt-files/
>>         tests/exp-new-training/model/ EN_US-FR_FR/rb//tuning/tmp.2
>>          --decoder-flags "" --rootdir /home/guchun/Work/moses/moses-
>>         scripts -mertdir /home/guchun/Work/moses/ mosesdecoder/bin
>>
>>         --no-filter-phrase-table *--jobs 32*
>>
>>         #####
>>
>>         The error message is
>>
>>         -----
>>         The decoder returns the scores in this order: d d d d d d d lm
>>         lm w tm tm tm tm tm tm tm tm tm tm tm tm tm tm tm g g g g
>>         Mismatched lambdas. Decoder returned d d d d d d d lm lm w tm
>>         tm tm tm tm tm tm tm tm tm tm tm tm tm tm g g g g, we expected
>>         d d d d d d d lm lm w tm tm tm tm tm g g tm tm tm tm tm g g tm
>>         tm tm tm tm at /home/guchun/Work/moses/moses-
>>         scripts/training/mert-moses.pl <http://mert-moses.pl>
>>         <http://mert-moses.pl> line 1155.
>>
>>         -----
>>
>>         I never had these problems with a previous commit back in
>>         March. Any hints will be warmly welcomed.
>>
>>         Many thanks,
>>
>>         Guchun
>>
>>
>>         ______________________________ _________________
>>         Moses-support mailing list
>>         [email protected] <mailto:[email protected]>
>>         http://mailman.mit.edu/ mailman/listinfo/moses-support
>>
>>         
>> <http://mailman.mit.edu/**mailman/listinfo/moses-support<http://mailman.mit.edu/mailman/listinfo/moses-support>
>> **>
>>
>>
>>
>>     --     The University of Edinburgh is a charitable body, registered in
>>     Scotland, with registration number SC005336.
>>
>>
>>
>>
>
> --
> The University of Edinburgh is a charitable body, registered in
> Scotland, with registration number SC005336.
>
>
>
_______________________________________________
Moses-support mailing list
[email protected]
http://mailman.mit.edu/mailman/listinfo/moses-support

Reply via email to