strange, I've added some new functionality to the extractor recently.
However, nothing seems to be broken.
There's even new regression tests for the extractor.
can you please do
./bjam clean
then recompile and tell me if it still crashes
On 25/05/2012 16:50, Tomas Hudik wrote:
Hi there,
It looks like Phrase extractor have a bug:
If I run command:
training/phrase-extract/extract lotus.tok.rem.clean.lw.cs
lotus.tok.rem.clean.lw.en ./model/aligned.grow-diag-final-and
./model/extract 7 orientation --model wbe-msd
Within Moses from Git, version: 9b5a4278b7693ec361c1138478fc22310ccdc2bd
I'm getting this error:
PhraseExtract v1.4, written by Philipp Koehn
phrase extraction from an aligned parallel corpus
............*** Segmentation fault
Register dump:
RAX: 0000000000d3d1a0 RBX: 0000000000620fb0 RCX: 0000000000000004
RDX: 00000036be9b3050 RSI: 0000000000000000 RDI: 0000000000d42b10
RBP: 00000036be9b1668 R8 : 00007fecd5bd0740 R9 : 0000000000000001
R10: 00007fff8f18b330 R11: 00000035e3c67d10 R12: 00000036be9b2f20
R13: 0000000000000001 R14: 0000000000000000 R15: 0000000000000000
RSP: 00007fff8f18b568
RIP: 0000000000000000 EFLAGS: 00010202
CS: 0033 FS: 0000 GS: 0000
Trap: 0000000e Error: 00000014 OldMask: 00000000 CR2: 00000000
FPUCW: 0000037f FPUSW: 00000000 TAG: 00000000
RIP: 00000000 RDP: 00000000
ST(0) 0000 0000000000000000 ST(1) 0000 0000000000000000
ST(2) 0000 0000000000000000 ST(3) 0000 0000000000000000
ST(4) 0000 0000000000000000 ST(5) 0000 0000000000000000
ST(6) 0000 0000000000000000 ST(7) 0000 0000000000000000
mxcsr: 1f80
XMM0: 0000000000000000000000000000ff00 XMM1:
0000000000000000000000000000ff00
XMM2: 0000000000000000000000000000ff00 XMM3:
0000000000000000000000000000ff00
XMM4: 0000000000000000000000000000ff00 XMM5:
0000000000000000000000000000ff00
XMM6: 0000000000000000000000000000ff00 XMM7:
0000000000000000000000000000ff00
XMM8: 0000000000000000000000000000ff00 XMM9:
0000000000000000000000000000ff00
XMM10: 0000000000000000000000000000ff00 XMM11:
0000000000000000000000000000ff00
XMM12: 0000000000000000000000000000ff00 XMM13:
0000000000000000000000000000ff00
XMM14: 0000000000000000000000000000ff00 XMM15:
0000000000000000000000000000ff00
Backtrace:
/lib64/libSegFault.so(+0x2fcb)[0x7fecd5df2fcb]
/lib64/libpthread.so.0[0x36bea0f500]
Memory map:
00400000-00420000 r-xp 00000000 08:11
3932403
/home/moses/moses/new/moses/scripts/training/phrase-extract/extract
00620000-00621000 rw-p 00020000 08:11
3932403
/home/moses/moses/new/moses/scripts/training/phrase-extract/extract
00621000-00622000 rw-p 00000000 00:00 0
00d33000-00d54000 rw-p 00000000 00:00
0 [heap]
35e3c00000-35e3ce8000 r-xp 00000000 fd:01
8948 /usr/lib64/libstdc++.so.6.0.16
35e3ce8000-35e3ee8000 ---p 000e8000 fd:01
8948 /usr/lib64/libstdc++.so.6.0.16
35e3ee8000-35e3ef0000 r--p 000e8000 fd:01
8948 /usr/lib64/libstdc++.so.6.0.16
35e3ef0000-35e3ef2000 rw-p 000f0000 fd:01 8948
/usr/lib64/libstdc++.so.6.0.16
35e3ef2000-35e3f07000 rw-p 00000000 00:00 0
36bde00000-36bde22000 r-xp 00000000 fd:01
4942 /lib64/ld-2.14.90.so
36be021000-36be022000 r--p 00021000 fd:01 4942
/lib64/ld-2.14.90.so
36be022000-36be023000 rw-p 00022000 fd:01
4942 /lib64/ld-2.14.90.so
36be023000-36be024000 rw-p 00000000 00:00 0
36be600000-36be7ad000 r-xp 00000000 fd:01
4953 /lib64/libc-2.14.90.so
36be7ad000-36be9ad000 ---p 001ad000 fd:01
4953 /lib64/libc-2.14.90.so
36be9ad000-36be9b1000 r--p 001ad000 fd:01
4953 /lib64/libc-2.14.90.so
36be9b1000-36be9b3000 rw-p 001b1000 fd:01
4953 /lib64/libc-2.14.90.so
36be9b3000-36be9b8000 rw-p 00000000 00:00 0
36bea00000-36bea17000 r-xp 00000000 fd:01
4957 /lib64/libpthread-2.14.90.so
36bea17000-36bec16000 ---p 00017000 fd:01
4957 /lib64/libpthread-2.14.90.so
36bec16000-36bec17000 r--p 00016000 fd:01
4957 /lib64/libpthread-2.14.90.so
36bec17000-36bec18000 rw-p 00017000 fd:01 4957
/lib64/libpthread-2.14.90.so
36bec18000-36bec1c000 rw-p 00000000 00:00 0
36bf200000-36bf207000 r-xp 00000000 fd:01
5132 /lib64/librt-2.14.90.so
36bf207000-36bf406000 ---p 00007000 fd:01
5132 /lib64/librt-2.14.90.so
36bf406000-36bf407000 r--p 00006000 fd:01
5132 /lib64/librt-2.14.90.so
36bf407000-36bf408000 rw-p 00007000 fd:01
5132 /lib64/librt-2.14.90.so
36bf600000-36bf615000 r-xp 00000000 fd:01
5149 /lib64/libgcc_s-4.6.3-20120306.so.1
36bf615000-36bf814000 ---p 00015000 fd:01
5149 /lib64/libgcc_s-4.6.3-20120306.so.1
36bf814000-36bf815000 rw-p 00014000 fd:01
5149 /lib64/libgcc_s-4.6.3-20120306.so.1
36bfa00000-36bfa83000 r-xp 00000000 fd:01
5139 /lib64/libm-2.14.90.so
36bfa83000-36bfc82000 ---p 00083000 fd:01
5139 /lib64/libm-2.14.90.so
36bfc82000-36bfc83000 r--p 00082000 fd:01
5139 /lib64/libm-2.14.90.so
36bfc83000-36bfc84000 rw-p 00083000 fd:01
5139 /lib64/libm-2.14.90.so
36c0200000-36c0217000 r-xp 00000000 fd:01
4974 /lib64/libz.so.1.2.5
36c0217000-36c0416000 ---p 00017000 fd:01
4974 /lib64/libz.so.1.2.5
36c0416000-36c0417000 rw-p 00016000 fd:01
4974 /lib64/libz.so.1.2.5
36c6600000-36c660f000 r-xp 00000000 fd:01
10628 /lib64/libbz2.so.1.0.6
36c660f000-36c680e000 ---p 0000f000 fd:01
10628 /lib64/libbz2.so.1.0.6
36c680e000-36c6810000 rw-p 0000e000 fd:01
10628 /lib64/libbz2.so.1.0.6
7fecd5bcf000-7fecd5bd6000 rw-p 00000000 00:00 0
7fecd5bd6000-7fecd5bed000 r-xp 00000000 fd:01
54169 /usr/lib64/libboost_iostreams-mt.so.1.47.0
7fecd5bed000-7fecd5ded000 ---p 00017000 fd:01
54169 /usr/lib64/libboost_iostreams-mt.so.1.47.0
7fecd5ded000-7fecd5dee000 r--p 00017000 fd:01
54169 /usr/lib64/libboost_iostreams-mt.so.1.47.0
7fecd5dee000-7fecd5def000 rw-p 00018000 fd:01
54169 /usr/lib64/libboost_iostreams-mt.so.1.47.0
7fecd5def000-7fecd5df0000 rw-p 00000000 00:00 0
7fecd5df0000-7fecd5df4000 r-xp 00000000 fd:01
4749 /lib64/libSegFault.so
7fecd5df4000-7fecd5ff3000 ---p 00004000 fd:01
4749 /lib64/libSegFault.so
7fecd5ff3000-7fecd5ff4000 r--p 00003000 fd:01
4749 /lib64/libSegFault.so
7fecd5ff4000-7fecd5ff5000 rw-p 00004000 fd:01
4749 /lib64/libSegFault.so
7fecd5ff5000-7fecd600e000 r-xp 00000000 fd:01
54137 /usr/lib64/libboost_thread-mt.so.1.47.0
7fecd600e000-7fecd620d000 ---p 00019000 fd:01
54137 /usr/lib64/libboost_thread-mt.so.1.47.0
7fecd620d000-7fecd620f000 r--p 00018000 fd:01
54137 /usr/lib64/libboost_thread-mt.so.1.47.0
7fecd620f000-7fecd6210000 rw-p 0001a000 fd:01
54137 /usr/lib64/libboost_thread-mt.so.1.47.0
7fecd6229000-7fecd622a000 rw-p 00000000 00:00 0
7fff8f01c000-7fff8f18d000 rw-p 00000000 00:00
0 [stack]
7fff8f1ff000-7fff8f200000 r-xp 00000000 00:00
0 [vdso]
ffffffffff600000-ffffffffff601000 r-xp 00000000 00:00
0 [vsyscall]
Segmentation fault (core dumped)
However, when I run the command on older Moses, downloaded from SVN
version 4018. Everything is ok.
Any idea where the problem lies?
Thx, Tomas
_______________________________________________
Moses-support mailing list
[email protected]
http://mailman.mit.edu/mailman/listinfo/moses-support
_______________________________________________
Moses-support mailing list
[email protected]
http://mailman.mit.edu/mailman/listinfo/moses-support
