It seems that your parallel corpus contains a line long 999 words (at least in 
target)
So I suspect that something in the cleaning with "clean-corpus-n.perl " failed

As you know, if you use 40 as maximum sentence length you should get
only sentence shorter than (or equal to) 40.
Please check this carefully.

if you can not find the solution please send me an excerpt of the parallel 
corpus
(and alignment file) including the portion arising the problem.


Nicola

On Jul 20, 2011, at 9:27 AM, 蒋乾 wrote:

Hello,

When I trained the translation from English to Vietnamese, a mistake I met was 
showed as follows:


"|tools/moses-scripts/scripts-20110322-0943//training/symal/symal 
-alignment="grow" -diagonal="yes" -final="yes" -both="yes" > 
jameswork/En_Vi//model/aligned.grow-diag-final-and
symal: computing grow alignment: diagonal (1) final (1)both-uncovered (1)
20636: target len=999 is not less than MAX_WORD-1=999
symal: symal.cpp:83: int getals(std::fstream&, int&, int*, int&, int*): 
Assertion `strlen(w)<1000-1' failed.
sh: line 1: 16708 Broken pipe             
tools/moses-scripts/scripts-20110322-0943//training/symal/giza2bal.pl<http://giza2bal.pl/>
 -d "gzip -cd jameswork/En_Vi//giza.vi-en/vi-en.A3.final.gz" -i "gzip -cd 
jameswork/En_Vi//giza.en-vi/en-vi.A3.final.gz"
     16709 Aborted                 (core dumped) | 
tools/moses-scripts/scripts-20110322-0943//training/symal/symal 
-alignment="grow" -diagonal="yes" -final="yes" -both="yes" > 
jameswork/En_Vi//model/aligned.grow-diag-final-and
Exit code: 134
ERROR: Can't generate symmetrized alignment file"

I tried to "clean-corpus-n.perl " both of the "paralled corpus" & 
"commentary.lm" into "1 40". But the mistake still happened!

Has anyone meet this problem & solve it successfully? Please share your 
experience.

Thank you.
_______________________________________________
Moses-support mailing list
[email protected]<mailto:[email protected]>
http://mailman.mit.edu/mailman/listinfo/moses-support


_______________________________________________
Moses-support mailing list
[email protected]
http://mailman.mit.edu/mailman/listinfo/moses-support

Reply via email to