maria sol ferrer wrote: > Hi, I am going to be working on my thesis with moses and I a having > some problems getting started.. So far I was able to download and > install Moses and all its necessary tools successfully, tried the > one sentence example and worked fine.. Now I am trying to do the > training that is available on the "Moses installation and training > run-through" (http://www.statmt.org/moses_steps.html) but when I run > moses, during step 2.1a I was getting this error: > > *** buffer overflow detected ***: /home/puchi/tools/bin/GIZA++ > terminated > > now, a few days later without changing anything it seems to go to > step 2.1b but I get:
In my experience, the buffer overflow error is due to not sufficiently filtering your corpus - GIZA is unhappy with very long segments. That same page describes the "Filter out long sentences" step, with an example invocation like this: clean-corpus-n.perl ... 1 40 What value are you using for the max length? I would decrease this until GIZA stops throwing the error. Also, I suspect it only appears to go on to step 2.1b because some partial file is laying around - don't be fooled. - John D. Burger MITRE _______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
