Re: [Moses-support] Fwd: Help me

Tue, 31 Jul 2012 23:23:38 -0700

Hi Mohaddeseh,

It seems that you are using an old version of GIZA++. The previous versions of GIZA++ have to be modified to work well. The problem is that in file_spec.h the year doesn't fit in two digits. so you have to change this file as follows:
Line 37:
   char time_stmp[17];
   char time_stmp[19];

Line 49   
  sprintf(time_stmp, "%02d-%02d-%02d.%02d%02d%02d.", 1900 + local->tm_year,
  sprintf(time_stmp, "%04d-%02d-%02d.%02d%02d%02d.", local->tm_year,


you also need to do following changes in the Makefile:
CFLAGS_OPT = $(CFLAGS) -O3 -DNDEBUG -DWORDINDEX_WITH_4_BYTE -DBINARY_SEARCH_FOR_TTABLE CFLAGS_OPT = $(CFLAGS) -O3 -DNDEBUG -DWORDINDEX_WITH_4_BYTE

By the way, I highly recommend you to get the latest version of GIZA++ from this link:
http://code.google.com/p/giza-pp/downloads/detail?name=giza-pp-v1.0.7.tar.gz&can=2&q=

and compile it.

Bests,
M. Amin

On 08/01/2012 10:25 AM, Mohadeseh Sheikhoveisi wrote:

Hi, I need to use moses in my thesis and when I run "./train-model.perl -scripts-root-dir /opt/tools/scripts-20120707-0326 -root-dir /home/msho/Parallel-Corpus/New-Train -corpus /home/msho/Parallel-Corpus/clean/Clean-Corpus -f en -e fa -alignment grow-diag-final-and -reordering msd-bidirectional-fe -lm 0:3:/home/msho/Parallel-Corpus/LM/lm/Data.fa.lm -parallel -giza-option m1=5,m2=0,m3=0,m4=0,mh=0,t1=5,nodumps=0" command I was getting this error: 

(2.1b) running giza en-fa @ Tue Jul 31 01:57:15 PDT 2012
/opt/tools/bin//GIZA++  -CoocurrenceFile /home/msho/Parallel-Corpus/New-Train/giza.en-fa/en-fa.cooc -c /home/msho/Parallel-Corpus/New-Train/corpus/en-fa-int-train.snt -m1 5 -m2 0 -m3 0 -m4 0 -mh 0 -model1dumpfrequency 1 -model4smoothfactor 0.4 -nodumps 0 -nsmooth 4 -o /home/msho/Parallel-Corpus/New-Train/giza.en-fa/en-fa -onlyaldumps 1 -p0 0.999 -s /home/msho/Parallel-Corpus/New-Train/corpus/fa.vcb -t /home/msho/Parallel-Corpus/New-Train/corpus/en.vcb -t1 5
/opt/tools/bin//GIZA++  -CoocurrenceFile /home/msho/Parallel-Corpus/New-Train/giza.en-fa/en-fa.cooc -c /home/msho/Parallel-Corpus/New-Train/corpus/en-fa-int-train.snt -m1 5 -m2 0 -m3 0 -m4 0 -mh 0 -model1dumpfrequency 1 -model4smoothfactor 0.4 -nodumps 0 -nsmooth 4 -o /home/msho/Parallel-Corpus/New-Train/giza.en-fa/en-fa -onlyaldumps 1 -p0 0.999 -s /home/msho/Parallel-Corpus/New-Train/corpus/fa.vcb -t /home/msho/Parallel-Corpus/New-Train/corpus/en.vcb -t1 5
Executing: /opt/tools/bin//GIZA++  -CoocurrenceFile /home/msho/Parallel-Corpus/New-Train/giza.en-fa/en-fa.cooc -c /home/msho/Parallel-Corpus/New-Train/corpus/en-fa-int-train.snt -m1 5 -m2 0 -m3 0 -m4 0 -mh 0 -model1dumpfrequency 1 -model4smoothfactor 0.4 -nodumps 0 -nsmooth 4 -o /home/msho/Parallel-Corpus/New-Train/giza.en-fa/en-fa -onlyaldumps 1 -p0 0.999 -s /home/msho/Parallel-Corpus/New-Train/corpus/fa.vcb -t /home/msho/Parallel-Corpus/New-Train/corpus/en.vcb -t1 5
*** buffer overflow detected ***: /opt/tools/bin//GIZA++ terminated
======= Backtrace: =========
[0x8176a39]
[0x81769ed]
[0x8176808]
[0x8158616]
[0x8184885]
[0x81768a4]
[0x81767fd]
[0x806d92d]
[0x8074754]
[0x8142b7b]
[0x8048201]
======= Memory map: ========
00768000-00769000 r-xp 00000000 00:00 0          [vdso]
08048000-081fb000 r-xp 00000000 08:01 410849     /opt/tools/bin/GIZA++
081fb000-081fd000 rw-p 001b2000 08:01 410849     /opt/tools/bin/GIZA++
081fd000-08205000 rw-p 00000000 00:00 0 
09164000-091d8000 rw-p 00000000 00:00 0          [heap]
bfba0000-bfbc1000 rw-p 00000000 00:00 0          [stack]
ERROR: Execution of: /opt/tools/bin//GIZA++  -CoocurrenceFile /home/msho/Parallel-Corpus/New-Train/giza.en-fa/en-fa.cooc -c /home/msho/Parallel-Corpus/New-Train/corpus/en-fa-int-train.snt -m1 5 -m2 0 -m3 0 -m4 0 -mh 0 -model1dumpfrequency 1 -model4smoothfactor 0.4 -nodumps 0 -nsmooth 4 -o /home/msho/Parallel-Corpus/New-Train/giza.en-fa/en-fa -onlyaldumps 1 -p0 0.999 -s /home/msho/Parallel-Corpus/New-Train/corpus/fa.vcb -t /home/msho/Parallel-Corpus/New-Train/corpus/en.vcb -t1 5
  died with signal 6, without coredump
(2.1b) running giza fa-en @ Tue Jul 31 01:57:34 PDT 2012
/opt/tools/bin//GIZA++  -CoocurrenceFile /home/msho/Parallel-Corpus/New-Train/giza.fa-en/fa-en.cooc -c /home/msho/Parallel-Corpus/New-Train/corpus/fa-en-int-train.snt -m1 5 -m2 0 -m3 0 -m4 0 -mh 0 -model1dumpfrequency 1 -model4smoothfactor 0.4 -nodumps 0 -nsmooth 4 -o /home/msho/Parallel-Corpus/New-Train/giza.fa-en/fa-en -onlyaldumps 1 -p0 0.999 -s /home/msho/Parallel-Corpus/New-Train/corpus/en.vcb -t /home/msho/Parallel-Corpus/New-Train/corpus/fa.vcb -t1 5
/opt/tools/bin//GIZA++  -CoocurrenceFile /home/msho/Parallel-Corpus/New-Train/giza.fa-en/fa-en.cooc -c /home/msho/Parallel-Corpus/New-Train/corpus/fa-en-int-train.snt -m1 5 -m2 0 -m3 0 -m4 0 -mh 0 -model1dumpfrequency 1 -model4smoothfactor 0.4 -nodumps 0 -nsmooth 4 -o /home/msho/Parallel-Corpus/New-Train/giza.fa-en/fa-en -onlyaldumps 1 -p0 0.999 -s /home/msho/Parallel-Corpus/New-Train/corpus/en.vcb -t /home/msho/Parallel-Corpus/New-Train/corpus/fa.vcb -t1 5
Executing: /opt/tools/bin//GIZA++  -CoocurrenceFile /home/msho/Parallel-Corpus/New-Train/giza.fa-en/fa-en.cooc -c /home/msho/Parallel-Corpus/New-Train/corpus/fa-en-int-train.snt -m1 5 -m2 0 -m3 0 -m4 0 -mh 0 -model1dumpfrequency 1 -model4smoothfactor 0.4 -nodumps 0 -nsmooth 4 -o /home/msho/Parallel-Corpus/New-Train/giza.fa-en/fa-en -onlyaldumps 1 -p0 0.999 -s /home/msho/Parallel-Corpus/New-Train/corpus/en.vcb -t /home/msho/Parallel-Corpus/New-Train/corpus/fa.vcb -t1 5
*** buffer overflow detected ***: /opt/tools/bin//GIZA++ terminated
======= Backtrace: =========
[0x8176a39]
[0x81769ed]
[0x8176808]
[0x8158616]
[0x8184885]
[0x81768a4]
[0x81767fd]
[0x806d92d]
[0x8074754]
[0x8142b7b]
[0x8048201]
======= Memory map: ========
00a96000-00a97000 r-xp 00000000 00:00 0          [vdso]
08048000-081fb000 r-xp 00000000 08:01 410849     /opt/tools/bin/GIZA++
081fb000-081fd000 rw-p 001b2000 08:01 410849     /opt/tools/bin/GIZA++
081fd000-08205000 rw-p 00000000 00:00 0 
09f2a000-09f9e000 rw-p 00000000 00:00 0          [heap]
bfe06000-bfe27000 rw-p 00000000 00:00 0          [stack]
ERROR: Execution of: /opt/tools/bin//GIZA++  -CoocurrenceFile /home/msho/Parallel-Corpus/New-Train/giza.fa-en/fa-en.cooc -c /home/msho/Parallel-Corpus/New-Train/corpus/fa-en-int-train.snt -m1 5 -m2 0 -m3 0 -m4 0 -mh 0 -model1dumpfrequency 1 -model4smoothfactor 0.4 -nodumps 0 -nsmooth 4 -o /home/msho/Parallel-Corpus/New-Train/giza.fa-en/fa-en -onlyaldumps 1 -p0 0.999 -s /home/msho/Parallel-Corpus/New-Train/corpus/en.vcb -t /home/msho/Parallel-Corpus/New-Train/corpus/fa.vcb -t1 5
  died with signal 6, without coredump

and I could't find any online help. Do you have any idea about this?
Please help me.

Best regards, 



_______________________________________________
Moses-support mailing list
[email protected]
http://mailman.mit.edu/mailman/listinfo/moses-support




_______________________________________________
Moses-support mailing list
[email protected]
http://mailman.mit.edu/mailman/listinfo/moses-support

Reply via email to