I recently rebuilt my Moses machine with the latest SVN updates of Moses, SRILM, GIZA++ and compiled with g++4.3. Everything seemed to go fine. In my first training, I ran clean-corpus-n.perl, then train-factored-phrase-model.perl. It terminated with the message below. Can you tell if this problem is corrupted data problem or a result of the compile?
Thanks, Tom line 1776000 line 1777000 line 1778000 END. (2.1b) running giza f-e @ Mon Jul 27 08:49:08 ICT 2009 GIZA++ -CoocurrenceFile /usr/local/share/model/20090717-0815.5/giza.f-e/f-e.cooc -c /usr/local/share/model/20090717-0815.5/corpus/f-e-int-train.snt -m1 5 -m2 0 -m3 3 -m4 3 -model1dumpfrequency 1 -model4smoothfactor 0.4 -nodumps 1 -nsmooth 4 -o /usr/local/share/model/20090717-0815.5/giza.f-e/f-e -onlyaldumps 1 -p0 0.999 -s /usr/local/share/model/20090717-0815.5/corpus/e.vcb -t /usr/local/share/model/20090717-0815.5/corpus/f.vcb Executing: GIZA++ -CoocurrenceFile /usr/local/share/model/20090717-0815.5/giza.f-e/f-e.cooc -c /usr/local/share/model/20090717-0815.5/corpus/f-e-int-train.snt -m1 5 -m2 0 -m3 3 -m4 3 -model1dumpfrequency 1 -model4smoothfactor 0.4 -nodumps 1 -nsmooth 4 -o /usr/local/share/model/20090717-0815.5/giza.f-e/f-e -onlyaldumps 1 -p0 0.999 -s /usr/local/share/model/20090717-0815.5/corpus/e.vcb -t /usr/local/share/model/20090717-0815.5/corpus/f.vcb GIZA++ -CoocurrenceFile /usr/local/share/model/20090717-0815.5/giza.f-e/f-e.cooc -c /usr/local/share/model/20090717-0815.5/corpus/f-e-int-train.snt -m1 5 -m2 0 -m3 3 -m4 3 -model1dumpfrequency 1 -model4smoothfactor 0.4 -nodumps 1 -nsmooth 4 -o /usr/local/share/model/20090717-0815.5/giza.f-e/f-e -onlyaldumps 1 -p0 0.999 -s /usr/local/share/model/20090717-0815.5/corpus/e.vcb -t /usr/local/share/model/20090717-0815.5/corpus/f.vcb *** buffer overflow detected ***: GIZA++ terminated ======= Backtrace: ========= [0x817971e] [0x81796b2] [0x81794b8] [0x8162488] [0x818576c] [0x8179554] [0x81794ad] [0x8069d7d] [0x806a387] [0x8070d88] [0x8149f4a] [0x8048171] ======= Memory map: ======== 08048000-081f1000 r-xp 00000000 08:11 477229 GIZA++ 081f1000-081f3000 rw-p 001a9000 08:11 477229 GIZA++ 081f3000-081fb000 rw-p 081f3000 00:00 0 08e8d000-08f01000 rw-p 08e8d000 00:00 0 [heap] b7f13000-b7f14000 r-xp b7f13000 00:00 0 [vdso] bfefe000-bff13000 rw-p bffeb000 00:00 0 [stack] ERROR: Execution of: GIZA++ -CoocurrenceFile /usr/local/share/model/20090717-0815.5/giza.f-e/f-e.cooc -c /usr/local/share/model/20090717-0815.5/corpus/f-e-int-train.snt -m1 5 -m2 0 -m3 3 -m4 3 -model1dumpfrequency 1 -model4smoothfactor 0.4 -nodumps 1 -nsmooth 4 -o /usr/local/share/model/20090717-0815.5/giza.f-e/f-e -onlyaldumps 1 -p0 0.999 -s /usr/local/share/model/20090717-0815.5/corpus/e.vcb -t /usr/local/share/model/20090717-0815.5/corpus/f.vcb died with signal 6, without coredump
_______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
