Hi there,

It looks like Phrase extractor have a bug:



If I run command:

training/phrase-extract/extract lotus.tok.rem.clean.lw.cs 
lotus.tok.rem.clean.lw.en ./model/aligned.grow-diag-final-and ./model/extract 7 
orientation --model wbe-msd



Within Moses from Git, version: 9b5a4278b7693ec361c1138478fc22310ccdc2bd



I'm getting this error:

PhraseExtract v1.4, written by Philipp Koehn

phrase extraction from an aligned parallel corpus

............*** Segmentation fault

Register dump:



RAX: 0000000000d3d1a0   RBX: 0000000000620fb0   RCX: 0000000000000004

RDX: 00000036be9b3050   RSI: 0000000000000000   RDI: 0000000000d42b10

RBP: 00000036be9b1668   R8 : 00007fecd5bd0740   R9 : 0000000000000001

R10: 00007fff8f18b330   R11: 00000035e3c67d10   R12: 00000036be9b2f20

R13: 0000000000000001   R14: 0000000000000000   R15: 0000000000000000

RSP: 00007fff8f18b568



RIP: 0000000000000000   EFLAGS: 00010202



CS: 0033   FS: 0000   GS: 0000



Trap: 0000000e   Error: 00000014   OldMask: 00000000   CR2: 00000000



FPUCW: 0000037f   FPUSW: 00000000   TAG: 00000000

RIP: 00000000   RDP: 00000000



ST(0) 0000 0000000000000000   ST(1) 0000 0000000000000000

ST(2) 0000 0000000000000000   ST(3) 0000 0000000000000000

ST(4) 0000 0000000000000000   ST(5) 0000 0000000000000000

ST(6) 0000 0000000000000000   ST(7) 0000 0000000000000000

mxcsr: 1f80

XMM0:  0000000000000000000000000000ff00 XMM1:  0000000000000000000000000000ff00

XMM2:  0000000000000000000000000000ff00 XMM3:  0000000000000000000000000000ff00

XMM4:  0000000000000000000000000000ff00 XMM5:  0000000000000000000000000000ff00

XMM6:  0000000000000000000000000000ff00 XMM7:  0000000000000000000000000000ff00

XMM8:  0000000000000000000000000000ff00 XMM9:  0000000000000000000000000000ff00

XMM10: 0000000000000000000000000000ff00 XMM11: 0000000000000000000000000000ff00

XMM12: 0000000000000000000000000000ff00 XMM13: 0000000000000000000000000000ff00

XMM14: 0000000000000000000000000000ff00 XMM15: 0000000000000000000000000000ff00



Backtrace:

/lib64/libSegFault.so(+0x2fcb)[0x7fecd5df2fcb]

/lib64/libpthread.so.0[0x36bea0f500]



Memory map:



00400000-00420000 r-xp 00000000 08:11 3932403                            
/home/moses/moses/new/moses/scripts/training/phrase-extract/extract

00620000-00621000 rw-p 00020000 08:11 3932403                            
/home/moses/moses/new/moses/scripts/training/phrase-extract/extract

00621000-00622000 rw-p 00000000 00:00 0

00d33000-00d54000 rw-p 00000000 00:00 0                                  [heap]

35e3c00000-35e3ce8000 r-xp 00000000 fd:01 8948                           
/usr/lib64/libstdc++.so.6.0.16

35e3ce8000-35e3ee8000 ---p 000e8000 fd:01 8948                           
/usr/lib64/libstdc++.so.6.0.16

35e3ee8000-35e3ef0000 r--p 000e8000 fd:01 8948                           
/usr/lib64/libstdc++.so.6.0.16

35e3ef0000-35e3ef2000 rw-p 000f0000 fd:01 8948                           
/usr/lib64/libstdc++.so.6.0.16

35e3ef2000-35e3f07000 rw-p 00000000 00:00 0

36bde00000-36bde22000 r-xp 00000000 fd:01 4942                           
/lib64/ld-2.14.90.so

36be021000-36be022000 r--p 00021000 fd:01 4942                           
/lib64/ld-2.14.90.so

36be022000-36be023000 rw-p 00022000 fd:01 4942                           
/lib64/ld-2.14.90.so

36be023000-36be024000 rw-p 00000000 00:00 0

36be600000-36be7ad000 r-xp 00000000 fd:01 4953                           
/lib64/libc-2.14.90.so

36be7ad000-36be9ad000 ---p 001ad000 fd:01 4953                           
/lib64/libc-2.14.90.so

36be9ad000-36be9b1000 r--p 001ad000 fd:01 4953                           
/lib64/libc-2.14.90.so

36be9b1000-36be9b3000 rw-p 001b1000 fd:01 4953                           
/lib64/libc-2.14.90.so

36be9b3000-36be9b8000 rw-p 00000000 00:00 0

36bea00000-36bea17000 r-xp 00000000 fd:01 4957                           
/lib64/libpthread-2.14.90.so

36bea17000-36bec16000 ---p 00017000 fd:01 4957                           
/lib64/libpthread-2.14.90.so

36bec16000-36bec17000 r--p 00016000 fd:01 4957                           
/lib64/libpthread-2.14.90.so

36bec17000-36bec18000 rw-p 00017000 fd:01 4957                           
/lib64/libpthread-2.14.90.so

36bec18000-36bec1c000 rw-p 00000000 00:00 0

36bf200000-36bf207000 r-xp 00000000 fd:01 5132                           
/lib64/librt-2.14.90.so

36bf207000-36bf406000 ---p 00007000 fd:01 5132                           
/lib64/librt-2.14.90.so

36bf406000-36bf407000 r--p 00006000 fd:01 5132                           
/lib64/librt-2.14.90.so

36bf407000-36bf408000 rw-p 00007000 fd:01 5132                           
/lib64/librt-2.14.90.so

36bf600000-36bf615000 r-xp 00000000 fd:01 5149                           
/lib64/libgcc_s-4.6.3-20120306.so.1

36bf615000-36bf814000 ---p 00015000 fd:01 5149                           
/lib64/libgcc_s-4.6.3-20120306.so.1

36bf814000-36bf815000 rw-p 00014000 fd:01 5149                           
/lib64/libgcc_s-4.6.3-20120306.so.1

36bfa00000-36bfa83000 r-xp 00000000 fd:01 5139                           
/lib64/libm-2.14.90.so

36bfa83000-36bfc82000 ---p 00083000 fd:01 5139                           
/lib64/libm-2.14.90.so

36bfc82000-36bfc83000 r--p 00082000 fd:01 5139                           
/lib64/libm-2.14.90.so

36bfc83000-36bfc84000 rw-p 00083000 fd:01 5139                           
/lib64/libm-2.14.90.so

36c0200000-36c0217000 r-xp 00000000 fd:01 4974                           
/lib64/libz.so.1.2.5

36c0217000-36c0416000 ---p 00017000 fd:01 4974                           
/lib64/libz.so.1.2.5

36c0416000-36c0417000 rw-p 00016000 fd:01 4974                           
/lib64/libz.so.1.2.5

36c6600000-36c660f000 r-xp 00000000 fd:01 10628                          
/lib64/libbz2.so.1.0.6

36c660f000-36c680e000 ---p 0000f000 fd:01 10628                          
/lib64/libbz2.so.1.0.6

36c680e000-36c6810000 rw-p 0000e000 fd:01 10628                          
/lib64/libbz2.so.1.0.6

7fecd5bcf000-7fecd5bd6000 rw-p 00000000 00:00 0

7fecd5bd6000-7fecd5bed000 r-xp 00000000 fd:01 54169                      
/usr/lib64/libboost_iostreams-mt.so.1.47.0

7fecd5bed000-7fecd5ded000 ---p 00017000 fd:01 54169                      
/usr/lib64/libboost_iostreams-mt.so.1.47.0

7fecd5ded000-7fecd5dee000 r--p 00017000 fd:01 54169                      
/usr/lib64/libboost_iostreams-mt.so.1.47.0

7fecd5dee000-7fecd5def000 rw-p 00018000 fd:01 54169                      
/usr/lib64/libboost_iostreams-mt.so.1.47.0

7fecd5def000-7fecd5df0000 rw-p 00000000 00:00 0

7fecd5df0000-7fecd5df4000 r-xp 00000000 fd:01 4749                       
/lib64/libSegFault.so

7fecd5df4000-7fecd5ff3000 ---p 00004000 fd:01 4749                       
/lib64/libSegFault.so

7fecd5ff3000-7fecd5ff4000 r--p 00003000 fd:01 4749                       
/lib64/libSegFault.so

7fecd5ff4000-7fecd5ff5000 rw-p 00004000 fd:01 4749                       
/lib64/libSegFault.so

7fecd5ff5000-7fecd600e000 r-xp 00000000 fd:01 54137                      
/usr/lib64/libboost_thread-mt.so.1.47.0

7fecd600e000-7fecd620d000 ---p 00019000 fd:01 54137                      
/usr/lib64/libboost_thread-mt.so.1.47.0

7fecd620d000-7fecd620f000 r--p 00018000 fd:01 54137                      
/usr/lib64/libboost_thread-mt.so.1.47.0

7fecd620f000-7fecd6210000 rw-p 0001a000 fd:01 54137                      
/usr/lib64/libboost_thread-mt.so.1.47.0

7fecd6229000-7fecd622a000 rw-p 00000000 00:00 0

7fff8f01c000-7fff8f18d000 rw-p 00000000 00:00 0                          [stack]

7fff8f1ff000-7fff8f200000 r-xp 00000000 00:00 0                          [vdso]

ffffffffff600000-ffffffffff601000 r-xp 00000000 00:00 0                  
[vsyscall]

Segmentation fault (core dumped)









However, when I run the command on older Moses, downloaded from SVN version 
4018. Everything is ok.



Any idea where the problem lies?

Thx, Tomas


_______________________________________________
Moses-support mailing list
[email protected]
http://mailman.mit.edu/mailman/listinfo/moses-support

Reply via email to