Hi, thanks for your reply, but I have tried wit a cutoff of 40, 20, 10 even 5 words per line and I am still getting the same error, I have followed the training steps exactly as described and I cant seem to find the problem. Please any help would be really appreciated! Thank you
2009/6/23 John Burger <[email protected]> > maria sol ferrer wrote: > > > Hi, I am going to be working on my thesis with moses and I a having > > some problems getting started.. So far I was able to download and > > install Moses and all its necessary tools successfully, tried the > > one sentence example and worked fine.. Now I am trying to do the > > training that is available on the "Moses installation and training > > run-through" (http://www.statmt.org/moses_steps.html) but when I run > > moses, during step 2.1a I was getting this error: > > > > *** buffer overflow detected ***: /home/puchi/tools/bin/GIZA++ > > terminated > > > > now, a few days later without changing anything it seems to go to > > step 2.1b but I get: > > > In my experience, the buffer overflow error is due to not sufficiently > filtering your corpus - GIZA is unhappy with very long segments. That > same page describes the "Filter out long sentences" step, with an > example invocation like this: > > clean-corpus-n.perl ... 1 40 > > What value are you using for the max length? I would decrease this > until GIZA stops throwing the error. > > Also, I suspect it only appears to go on to step 2.1b because some > partial file is laying around - don't be fooled. > > - John D. Burger > MITRE > > _______________________________________________ > Moses-support mailing list > [email protected] > http://mailman.mit.edu/mailman/listinfo/moses-support >
_______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
