Hi Barry
I tried to use valgrind on a small sample (100 sent.), but there's no
any error.
Since it happens kind of randomly, I would re-test it.
I also run the decoder on another dataset, the error appear again.
The command to compile Boost_1_55_0 is the same as the one on Moses
webpage. After setting the BOOST_BUILD_PATH and BOOST_ROOT to this
local boost dir, I compile moses with command:
/home/lly/plateform/boost_1_55_0/bjam -j8
--with-srilm=/home/lly/plateform/srilm
--with-boost=/home/lly/plateform/boost_1_55_0 -q variant=debug
The error msg is as follows:
*** Segmentation fault
Register dump:
RAX: 00007f0dd4812210 RBX: 0000000000000000 RCX: 0000000000000006
RDX: 00007f0d9fceeab0 RSI: 0000000000000000 RDI: 00007f0dd4812210
RBP: 00007f0dd48121c0 R8 : 00007f0de01bd030 R9 : 00007f0de01a2c90
R10: 00007f0de01bd030 R11: 0000000000000000 R12: 0000000000000000
R13: 00007fff25dc8e90 R14: 0000000000000000 R15: 00007f0dd4813700
RSP: 00007f0dd48121a8
RIP: 00007f0ddff505e3 EFLAGS: 00010202
CS: 0033 FS: 0000 GS: 0000
Trap: 0000000e Error: 00000005 OldMask: 00000000 CR2: ffffffe8
FPUCW: 0000037f FPUSW: 00000000 TAG: 00000000
RIP: 00000000 RDP: 00000000
ST(0) 0000 0000000000000000 ST(1) 0000 0000000000000000
ST(2) 0000 0000000000000000 ST(3) 0000 0000000000000000
ST(4) 0000 0000000000000000 ST(5) 0000 0000000000000000
ST(6) 0000 0000000000000000 ST(7) 0000 0000000000000000
mxcsr: 1fa4
XMM0: 00000000000000000000000000000000 XMM1:
00000000000000000000000000000000
XMM2: 00000000000000000000000000000000 XMM3:
00000000000000000000000000000000
XMM4: 00000000000000000000000000000000 XMM5:
00000000000000000000000000000000
XMM6: 00000000000000000000000000000000 XMM7:
00000000000000000000000000000000
XMM8: 00000000000000000000000000000000 XMM9:
00000000000000000000000000000000
XMM10: 00000000000000000000000000000000 XMM11:
00000000000000000000000000000000
XMM12: 00000000000000000000000000000000 XMM13:
00000000000000000000000000000000
XMM14: 00000000000000000000000000000000 XMM15:
00000000000000000000000000000000
Backtrace:
/usr/lib64/libstdc++.so.6(_ZStlsIcSt11char_traitsIcESaIcEERSt13basic_ostreamIT_T0_ES7_RKSbIS4_S5_T1_E+0x3)[0x7f0ddff505e3]
/home/lly/plateform/moses-3.0/bin/moses_chart[0x58400d]
/home/lly/plateform/moses-3.0/bin/moses_chart[0x43ffd6]
/home/lly/plateform/moses-3.0/bin/moses_chart[0x44057e]
/home/lly/plateform/moses-3.0/bin/moses_chart[0x4402fe]
/home/lly/plateform/moses-3.0/bin/moses_chart[0x561d16]
/home/lly/plateform/moses-3.0/bin/moses_chart[0x561a08]
/home/lly/plateform/moses-3.0/bin/moses_chart[0x47baa2]
/home/lly/plateform/moses-3.0/bin/moses_chart[0x530bdd]
/home/lly/plateform/moses-3.0/bin/moses_chart[0x534f41]
/home/lly/plateform/moses-3.0/bin/moses_chart[0x534ea4]
/home/lly/plateform/moses-3.0/bin/moses_chart[0x534e49]
/home/lly/plateform/moses-3.0/bin/moses_chart[0x534e0e]
/home/lly/plateform/moses-3.0/bin/moses_chart[0x8b3892]
/lib64/libpthread.so.0(+0x7e0e)[0x7f0ddf796e0e]
/lib64/libc.so.6(clone+0x6d)[0x7f0ddf4ce2cd]
Memory map:
00400000-00bac000 r-xp 00000000 00:21 36148887
/home/lly/plateform/moses-3.0/bin/moses
00dab000-00dac000 r--p 007ab000 00:21 36148887
/home/lly/plateform/moses-3.0/bin/moses
00dac000-00dae000 rw-p 007ac000 00:21 36148887
/home/lly/plateform/moses-3.0/bin/moses
00dae000-00e14000 rw-p 00000000 00:00 0
01d11000-7725c000 rw-p 00000000 00:00 0 [heap]
7f0ca8000000-7f0ca96ef000 rw-p 00000000 00:00 0
7f0ca96ef000-7f0cac000000 ---p 00000000 00:00 0
7f0cb0000000-7f0cb208c000 rw-p 00000000 00:00 0
7f0cb208c000-7f0cb4000000 ---p 00000000 00:00 0
7f0cb8000000-7f0cbc000000 rw-p 00000000 00:00 0
7f0cbc000000-7f0cbdb78000 rw-p 00000000 00:00 0
7f0cbdb78000-7f0cc0000000 ---p 00000000 00:00 0
7f0cc0000000-7f0cc310b000 rw-p 00000000 00:00 0
7f0cc310b000-7f0cc4000000 ---p 00000000 00:00 0
7f0cc4000000-7f0cc7c46000 rw-p 00000000 00:00 0
7f0cc7c46000-7f0cc8000000 ---p 00000000 00:00 0
7f0cc8000000-7f0ccc000000 rw-p 00000000 00:00 0
7f0ccc000000-7f0cd0000000 rw-p 00000000 00:00 0
7f0cd0000000-7f0cd264f000 rw-p 00000000 00:00 0
7f0cd264f000-7f0cd4000000 ---p 00000000 00:00 0
7f0cd8000000-7f0cda190000 rw-p 00000000 00:00 0
7f0cda190000-7f0cdc000000 ---p 00000000 00:00 0
7f0cdc000000-7f0cddec3000 rw-p 00000000 00:00 0
7f0cddec3000-7f0ce0000000 ---p 00000000 00:00 0
7f0ce0000000-7f0ce4000000 rw-p 00000000 00:00 0
7f0ce4000000-7f0ce8000000 rw-p 00000000 00:00 0
7f0ce8000000-7f0cec000000 rw-p 00000000 00:00 0
7f0cec000000-7f0cf0000000 rw-p 00000000 00:00 0
7f0cf0000000-7f0cf23d9000 rw-p 00000000 00:00 0
7f0cf23d9000-7f0cf4000000 ---p 00000000 00:00 0
7f0cf4000000-7f0cf8000000 rw-p 00000000 00:00 0
7f0cfc000000-7f0d00000000 rw-p 00000000 00:00 0
7f0d00000000-7f0d04000000 rw-p 00000000 00:00 0
7f0d04000000-7f0d08000000 rw-p 00000000 00:00 0
7f0d0c000000-7f0d0f4f0000 rw-p 00000000 00:00 0
7f0d0f4f0000-7f0d10000000 ---p 00000000 00:00 0
7f0d14000000-7f0d17d65000 rw-p 00000000 00:00 0
7f0d17d65000-7f0d18000000 ---p 00000000 00:00 0
7f0d1c000000-7f0d20000000 rw-p 00000000 00:00 0
7f0d20000000-7f0d24000000 rw-p 00000000 00:00 0
7f0d24000000-7f0d27f50000 rw-p 00000000 00:00 0
7f0d27f50000-7f0d28000000 ---p 00000000 00:00 0
7f0d28000000-7f0d2c000000 rw-p 00000000 00:00 0
7f0d2c000000-7f0d2dda8000 rw-p 00000000 00:00 0
7f0d2dda8000-7f0d30000000 ---p 00000000 00:00 0
7f0d30000000-7f0d34000000 rw-p 00000000 00:00 0
7f0d34000000-7f0d38000000 rw-p 00000000 00:00 0
7f0d38000000-7f0d3a518000 rw-p 00000000 00:00 0
7f0d3a518000-7f0d3c000000 ---p 00000000 00:00 0
7f0d3c000000-7f0d40000000 rw-p 00000000 00:00 0
7f0d40000000-7f0d44000000 rw-p 00000000 00:00 0
7f0d44000000-7f0d48000000 rw-p 00000000 00:00 0
7f0d4c000000-7f0d50000000 rw-p 00000000 00:00 0
7f0d50000000-7f0d54000000 rw-p 00000000 00:00 0
7f0d54000000-7f0d58000000 rw-p 00000000 00:00 0
7f0d58000000-7f0d5b80d000 rw-p 00000000 00:00 0
7f0d5b80d000-7f0d5c000000 ---p 00000000 00:00 0
7f0d5c000000-7f0d60000000 rw-p 00000000 00:00 0
7f0d60000000-7f0d64000000 rw-p 00000000 00:00 0
7f0d64000000-7f0d6714a000 rw-p 00000000 00:00 0
7f0d6714a000-7f0d68000000 ---p 00000000 00:00 0
7f0d68000000-7f0d6c000000 rw-p 00000000 00:00 0
7f0d6c000000-7f0d70000000 rw-p 00000000 00:00 0
7f0d70000000-7f0d74000000 rw-p 00000000 00:00 0
7f0d74000000-7f0d78000000 rw-p 00000000 00:00 0
7f0d78000000-7f0d7c000000 rw-p 00000000 00:00 0
7f0d7c000000-7f0d80000000 rw-p 00000000 00:00 0
7f0d80000000-7f0d84000000 rw-p 00000000 00:00 0
7f0d84000000-7f0d88000000 rw-p 00000000 00:00 0
7f0d88000000-7f0d8c000000 rw-p 00000000 00:00 0
7f0d8c000000-7f0d90000000 rw-p 00000000 00:00 0
7f0d90000000-7f0d94000000 rw-p 00000000 00:00 0
7f0d94000000-7f0d98000000 rw-p 00000000 00:00 0
7f0d98000000-7f0d9c000000 rw-p 00000000 00:00 0
7f0d9c000000-7f0da0000000 rw-p 00000000 00:00 0
7f0da0000000-7f0da4000000 rw-p 00000000 00:00 0
7f0da4000000-7f0da8000000 rw-p 00000000 00:00 0
7f0da8000000-7f0dac000000 rw-p 00000000 00:00 0
7f0dac000000-7f0db0000000 rw-p 00000000 00:00 0
7f0db0000000-7f0db4000000 rw-p 00000000 00:00 0
7f0db4000000-7f0db8000000 rw-p 00000000 00:00 0
7f0db8000000-7f0dbc000000 rw-p 00000000 00:00 0
7f0dbc000000-7f0dc0000000 rw-p 00000000 00:00 0
7f0dc0000000-7f0dc4000000 rw-p 00000000 00:00 0
7f0dc4000000-7f0dc8000000 rw-p 00000000 00:00 0
7f0dc8000000-7f0dcc000000 rw-p 00000000 00:00 0
7f0dcc000000-7f0dd0000000 rw-p 00000000 00:00 0
7f0dd3011000-7f0dd3012000 ---p 00000000 00:00 0
7f0dd3012000-7f0dd3812000 rw-p 00000000 00:00 0 [stack:2289]
7f0dd3812000-7f0dd3813000 ---p 00000000 00:00 0
7f0dd3813000-7f0dd4013000 rw-p 00000000 00:00 0 [stack:2288]
7f0dd4013000-7f0dd4014000 ---p 00000000 00:00 0
7f0dd4014000-7f0dd4814000 rw-p 00000000 00:00 0 [stack:2287]
7f0dd4814000-7f0dd4815000 ---p 00000000 00:00 0
7f0dd4815000-7f0dd5015000 rw-p 00000000 00:00 0 [stack:2286]
7f0dd5015000-7f0dd5016000 ---p 00000000 00:00 0
7f0dd5016000-7f0dd5816000 rw-p 00000000 00:00 0 [stack:2285]
7f0dd5816000-7f0dd5817000 ---p 00000000 00:00 0
7f0dd5817000-7f0dd6017000 rw-p 00000000 00:00 0 [stack:2284]
7f0dd6017000-7f0dd6018000 ---p 00000000 00:00 0
7f0dd6018000-7f0dd6818000 rw-p 00000000 00:00 0 [stack:2283]
7f0dd6818000-7f0dd6819000 ---p 00000000 00:00 0
7f0dd6819000-7f0dd7019000 rw-p 00000000 00:00 0 [stack:2282]
7f0dd7019000-7f0dd701a000 ---p 00000000 00:00 0
7f0dd701a000-7f0dd781a000 rw-p 00000000 00:00 0 [stack:2281]
7f0dd781a000-7f0dd781b000 ---p 00000000 00:00 0
7f0dd781b000-7f0dd801b000 rw-p 00000000 00:00 0 [stack:2280]
7f0dd801b000-7f0dd801c000 ---p 00000000 00:00 0
7f0dd801c000-7f0dd881c000 rw-p 00000000 00:00 0 [stack:2279]
7f0dd881c000-7f0dd881d000 ---p 00000000 00:00 0
7f0dd881d000-7f0dd901d000 rw-p 00000000 00:00 0 [stack:2278]
7f0dd901d000-7f0dd901e000 ---p 00000000 00:00 0
7f0dd901e000-7f0dd981e000 rw-p 00000000 00:00 0 [stack:2277]
7f0dd981e000-7f0dd981f000 ---p 00000000 00:00 0
7f0dd981f000-7f0dda01f000 rw-p 00000000 00:00 0 [stack:2276]
7f0dda01f000-7f0dda020000 ---p 00000000 00:00 0
7f0dda020000-7f0dda820000 rw-p 00000000 00:00 0 [stack:2275]
7f0dda820000-7f0dda821000 ---p 00000000 00:00 0
7f0dda821000-7f0ddb021000 rw-p 00000000 00:00 0 [stack:2274]
7f0ddb021000-7f0ddb022000 ---p 00000000 00:00 0
7f0ddb022000-7f0ddb822000 rw-p 00000000 00:00 0 [stack:2273]
7f0ddb822000-7f0ddb823000 ---p 00000000 00:00 0
7f0ddb823000-7f0ddc023000 rw-p 00000000 00:00 0 [stack:2272]
7f0ddc023000-7f0ddc024000 ---p 00000000 00:00 0
7f0ddc024000-7f0ddc824000 rw-p 00000000 00:00 0 [stack:2270]
7f0ddc824000-7f0ddc825000 ---p 00000000 00:00 0
7f0ddc825000-7f0ddd025000 rw-p 00000000 00:00 0 [stack:2269]
7f0ddd025000-7f0ddd026000 ---p 00000000 00:00 0
7f0ddd026000-7f0ddd826000 rw-p 00000000 00:00 0 [stack:2268]
7f0ddd826000-7f0ddd827000 ---p 00000000 00:00 0
7f0ddd827000-7f0dde027000 rw-p 00000000 00:00 0 [stack:2267]
7f0dde027000-7f0dde028000 ---p 00000000 00:00 0
7f0dde028000-7f0dde828000 rw-p 00000000 00:00 0 [stack:2266]
7f0dde828000-7f0dde829000 ---p 00000000 00:00 0
7f0dde829000-7f0ddf08b000 rw-p 00000000 00:00 0 [stack:2265]
7f0ddf1ae000-7f0ddf3ea000 r--s 00000000 00:21 35413235
/home/lly/work/perceptron/lm/en.binlm3
7f0ddf3ea000-7f0ddf585000 r-xp 00000000 08:11 262155
/lib64/libc-2.15.so <http://libc-2.15.so>
7f0ddf585000-7f0ddf785000 ---p 0019b000 08:11 262155
/lib64/libc-2.15.so <http://libc-2.15.so>
7f0ddf785000-7f0ddf789000 r--p 0019b000 08:11 262155
/lib64/libc-2.15.so <http://libc-2.15.so>
7f0ddf789000-7f0ddf78b000 rw-p 0019f000 08:11 262155
/lib64/libc-2.15.so <http://libc-2.15.so>
7f0ddf78b000-7f0ddf78f000 rw-p 00000000 00:00 0
7f0ddf78f000-7f0ddf7a6000 r-xp 00000000 08:11 262181
/lib64/libpthread-2.15.so <http://libpthread-2.15.so>
7f0ddf7a6000-7f0ddf9a5000 ---p 00017000 08:11 262181
/lib64/libpthread-2.15.so <http://libpthread-2.15.so>
7f0ddf9a5000-7f0ddf9a6000 r--p 00016000 08:11 262181
/lib64/libpthread-2.15.so <http://libpthread-2.15.so>
7f0ddf9a6000-7f0ddf9a7000 rw-p 00017000 08:11 262181
/lib64/libpthread-2.15.so <http://libpthread-2.15.so>
7f0ddf9a7000-7f0ddf9ab000 rw-p 00000000 00:00 0
7f0ddf9ab000-7f0ddf9c0000 r-xp 00000000 08:11 262300 /lib64/libgcc_s.so.1
7f0ddf9c0000-7f0ddfbbf000 ---p 00015000 08:11 262300 /lib64/libgcc_s.so.1
7f0ddfbbf000-7f0ddfbc0000 r--p 00014000 08:11 262300 /lib64/libgcc_s.so.1
7f0ddfbc0000-7f0ddfbc1000 rw-p 00015000 08:11 262300 /lib64/libgcc_s.so.1
7f0ddfbc1000-7f0ddfcb6000 r-xp 00000000 08:11 262163
/lib64/libm-2.15.so <http://libm-2.15.so>
7f0ddfcb6000-7f0ddfeb6000 ---p 000f5000 08:11 262163
/lib64/libm-2.15.so <http://libm-2.15.so>
7f0ddfeb6000-7f0ddfeb7000 r--p 000f5000 08:11 262163
/lib64/libm-2.15.so <http://libm-2.15.so>
7f0ddfeb7000-7f0ddfeb8000 rw-p 000f6000 08:11 262163
/lib64/libm-2.15.so <http://libm-2.15.so>
7f0ddfeb8000-7f0ddffa0000 r-xp 00000000 08:11 1710646
/usr/lib64/libstdc++.so.6.0.17
7f0ddffa0000-7f0de01a0000 ---p 000e8000 08:11 1710646
/usr/lib64/libstdc++.so.6.0.17
7f0de01a0000-7f0de01a8000 r--p 000e8000 08:11 1710646 /usSegmentation
fault
r/lib64/libstdc++.so.6.0.17
7f0de01a8000-7f0de01aa000 rw-p 000f0000 08:11 1710646
/usr/lib64/libstdc++.so.6.0.17
7f0de01aa000-7f0de01bf000 rw-p 00000000 00:00 0
7f0de01bf000-7f0de01c6000 r-xp 00000000 08:11 262185
/lib64/librt-2.15.so <http://librt-2.15.so>
7f0de01c6000-7f0de03c5000 ---p 00007000 08:11 262185
/lib64/librt-2.15.so <http://librt-2.15.so>
7f0de03c5000-7f0de03c6000 r--p 00006000 08:11 262185
/lib64/librt-2.15.so <http://librt-2.15.so>
7f0de03c6000-7f0de03c7000 rw-p 00007000 08:11 2621: 0000000000000000
R12: 0000000000000000
R13: 00007fff25dc8e90 R14: 0000000000000000 R15: 00007f0dd6817700
RSP: 00007f0dd68161a8
RIP: 00007f0ddff505e3 EFLAGS: 00010206
CS: 0033 FS: 0000 GS: 0000
Trap: 0000000e Error: 00000005 OldMask: 00000000 CR2: ffffffe8
FPUCW: 0000037f FPUSW: 00000000 TAG: 00000000
RIP: 00000000 RDP: 00000000
ST(0) 0000 0000000000000000 ST(1) 0000 0000000000000000
ST(2) 0000 0000000000000000 ST(3) 0000 0000000000000000
ST(4) 0000 0000000000000000 ST(5) 0000 0000000000000000
ST(6) 0000 0000000000000000 ST(7) 0000 0000000000000000
mxcsr: 1fa4
XMM0: 00000000000000000000000000000000 XMM1:
00000000000000000000000000000000
XMM2: 00000000000000000000000000000000 XMM3:
00000000000000000000000000000000
XMM4: 00000000000000000000000000000000 XMM5:
00000000000000000000000000000000
XMM6: 00000000000000000000000000000000 XMM7:
00000000000000000000000000000000
XMM8: 00000000000000000000000000000000 XMM9:
00000000000000000000000000000000
XMM10: 00000000000000000000000000000000 XMM11:
00000000000000000000000000000000
XMM12: 00000000000000000000000000000000 XMM13:
00000000000000000000000000000000
XMM14: 00000000000000000000000000000000 XMM15:
00000000000000000000000000000000
Backtrace:
185 /lib64/librt-2.15.so <http://librt-2.15.so>
7f0de03c7000-7f0de03dc000 r-xp 00000000 08:11 262194 /lib64/libz.so.1.2.7
7f0de03dc000-7f0de05db000 ---p 00015000 08:11 262194 /lib64/libz.so.1.2.7
7f0de05db000-7f0de05dc000 r--p 00014000 08:11 262194 /lib64/libz.so.1.2.7
7f0de05dc000-7f0de05dd000 rw-p 00015000 08:11 262194 /lib64/libz.so.1.2.7
7f0de05dd000-7f0de05e1000 r-xp 00000000 08:11 262152 /lib64/libSegFault.so
7f0de05e1000-7f0de07e0000 ---p 00004000 08:11 262152 /lib64/libSegFault.so
7f0de07e0000-7f0de07e1000 r--p 00003000 08:11 262152 /lib64/libSegFault.so
7f0de07e1000-7f0de07e2000 rw-p 00004000 08:11 262152 /lib64/libSegFault.so
7f0de07e2000-7f0de07e5000 r-xp 00000000 08:11 262161
/lib64/libdl-2.15.so <http://libdl-2.15.so>
7f0de07e5000-7f0de09e4000 ---p 00003000 08:11 262161
/lib64/libdl-2.15.so <http://libdl-2.15.so>
7f0de09e4000-7f0de09e5000 r--p 00002000 08:11 262161
/lib64/libdl-2.15.so <http://libdl-2.15.so>
7f0de09e5000-7f0de09e6000 rw-p 00003000 08:11 262161
/lib64/libdl-2.15.so <http://libdl-2.15.so>
7f0de09e6000-7f0de0a0b000 r-xp 00000000 08:11 1708628
/usr/lib64/liblzma.so.5.0.3
7f0de0a0b000-7f0de0c0a000 ---p 00025000 08:11 1708628
/usr/lib64/liblzma.so.5.0.3
7f0de0c0a000-7f0de0c0b000 r--p 00024000 08:11 1708628
/usr/lib64/liblzma.so.5.0.3
7f0de0c0b000-7f0de0c0c000 rw-p 00025000 08:11 1708628
/usr/lib64/liblzma.so.5.0.3
7f0de0c0c000-7f0de0c2d000 r-xp 00000000 08:11 280462
/lib64/ld-2.15.so <http://ld-2.15.so>
7f0de0d06000-7f0de0e0e000 rw-p 00000000 00:00 0
7f0de0e2c000-7f0de0e2d000 rw-p 00000000 00:00 0
7f0de0e2d000-7f0de0e2e000 r--p 00021000 08:11 280462
/lib64/ld-2.15.so <http://ld-2.15.so>
7f0de0e2e000-7f0de0e2f000 rw-p 00022000 08:11 280462
/lib64/ld-2.15.so <http://ld-2.15.so>
7f0de0e2f000-7f0de0e30000 rw-p 00000000 00:00 0
7fff25daa000-7fff25dcc000 rw-p 00000000 00:00 0
[stack]
7fff25dff000-7fff25e00000 r-xp 00000000 00:00 0
[vdso]
ffffffffff600000-ffffffffff601000 r-xp 00000000 00:00 0
[vsyscall]
/usr/lib64/libstdc++.so.6(_ZStlsIcSt11char_traitsIcESaIcEERSt13basic_ostreamIT_T0_ES7_RKSbIS4_S5_T1_E+0x3)[0x7f0ddff505e3]
/home/lly/plateform/moses-3.0/bin/moses_chart[0x58400d]
/home/lly/plateform/moses-3.0/bin/moses_chart[0x43ffd6]
/home/lly/plateform/moses-3.0/bin/moses_chart[0x44057e]
/home/lly/plateform/moses-3.0/bin/moses_chart[0x4402fe]
/home/lly/plateform/moses-3.0/bin/moses_chart[0x561d16]
/home/lly/plateform/moses-3.0/bin/moses_chart[0x561a08]
/home/lly/plateform/moses-3.0/bin/moses_chart[0x47baa2]
/home/lly/plateform/moses-3.0/bin/moses_chart[0x530bdd]
/home/lly/plateform/moses-3.0/bin/moses_chart[0x534f41]
/home/lly/plateform/moses-3.0/bin/moses_chart[0x534ea4]
/home/lly/plateform/moses-3.0/bin/moses_chart[0x534e49]
/home/lly/plateform/moses-3.0/bin/moses_chart[0x534e0e]
/home/lly/plateform/moses-3.0/bin/moses_chart[0x8b3892]
/lib64/libpthread.so.0(+0x7e0e)[0x7f0ddf796e0e]
sh: line 1: 2260 Segmentation fault
/home/lly/plateform/moses-3.0/bin/moses_chart -threads all -config
/home/lly/work/perceptron/tune/moses-sparse.ini -weight-overwrite
'PhrasePenalty0= -0.086708 WordPenalty0= -0.133063 TranslationModel0=
0.129426 0.015298 0.147046 -0.033093 TranslationModel1= 0.340195 LM0=
0.115169' -weight-file run2.sparse-weights -n-best-list
run2.best100.out 100 distinct -input-file
/home/lly/work/perceptron/tune/devset.train.zh > run2.out
Regards
Liangyou
On Wed, Mar 11, 2015 at 8:58 PM, Barry Haddow
<[email protected] <mailto:[email protected]>> wrote:
Hi Liangyou
This is a bit strange. The stacktrace suggests corruption in the
feature vector, but it would be surprising that we haven't seen it
before. Can you reproduce the problem when running under valgrind?
The memory could be getting corrupted by a completely different
source, which we'll really only find with a memory checker.
cheers - Barry
On 11/03/15 17:50, Liangyou Li wrote:
Thanks Matthias.
This problem doesn't always happen.
Even on the same data, sometimes it can run without crash,
sometimes it doesn't.
But, by now, the error only happens when the decoder outputs
features. (-n-best-list or -output-search-graph-hypergraph)
Cheers
Liangyou
On Wed, Mar 11, 2015 at 5:38 PM, Matthias Huck
<[email protected] <mailto:[email protected]>> wrote:
Hi,
I've recently been using these sparse feature functions
without any
issues in multi-threaded chart-based decoding. There might be
a problem
with thread safety, but I currently can't tell why you got the
segmentation fault. You should investigate this in more detail.
Cheers,
Matthias
On Wed, 2015-03-11 at 12:12 +0000, Liangyou Li wrote:
> When I run moses with sparse features in multi-threads (
parameter -threads all), I got segmentation fault.
>
>
> The three sparse features are:
> SourceWordDeletionFeature factor=0
> TargetWordInsertionFeature factor=0
> WordTranslationFeature input-factor=0 output-factor=0
>
>
> The exact command I used is:
> moses_chart -threads all -f moses.ini -i input
-n-best-list nbest 100 distinct
>
>
> This error happens kind of randomly. But it only happens
when sparse features and multi-threads are used.
>
>
> I've tried several times to use gdb to trace the error.
Fortunately, I just get the back-trace info, as listed:
>
>
> Program received signal SIGSEGV, Segmentation fault.
> [Switching to Thread 0x7fffdae77700 (LWP 32390)]
> 0x00007ffff711f5e3 in std::basic_ostream<char,
std::char_traits<char> >& std::operator<< <char,
std::char_traits<char>, std::allocator<char>
>(std::basic_ostream<char, std::char_traits<char> >&,
std::basic_string<char, std::char_traits<char>,
std::allocator<char> > const&) () from /usr/lib64/libstdc++.so.6
> Missing separate debuginfos, use: zypper install
glibc-debuginfo-2.15-22.17.1.x86_64
libgcc47-debuginfo-4.7.1_20120723-1.1.1.x86_64
liblzma5-debuginfo-5.0.3-12.2.2.x86_64
libstdc++47-debuginfo-4.7.1_20120723-1.1.1.x86_64
zlib-debuginfo-1.2.7-2.1.2.x86_64
> (gdb) backtrace
> #0 0x00007ffff711f5e3 in std::basic_ostream<char,
std::char_traits<char> >& std::operator<< <char,
std::char_traits<char>, std::allocator<char>
>(std::basic_ostream<char, std::char_traits<char> >&,
std::basic_string<char, std::char_traits<char>,
std::allocator<char> > const&) () from /usr/lib64/libstdc++.so.6
> #1 0x0000000000584711 in Moses::operator<< (out=...,
name=...) at moses/FeatureVector.cpp:141
> #2 0x0000000000440232 in
Moses::ScoreComponentCollection::GetVectorForProducer
(this=0x7fffad0e9380, sp=0xe2aab0) at
moses/ScoreComponentCollection.cpp:293
> #3 0x00000000004407da in
Moses::ScoreComponentCollection::OutputFeatureScores
(this=0x7fffad0e9380, out=..., ff=0xe2aab0, lastName="LM0")
at moses/ScoreComponentCollection.cpp:351
> #4 0x000000000044055a in
Moses::ScoreComponentCollection::OutputAllFeatureScores
(this=0x7fffad0e9380, out=...) at
moses/ScoreComponentCollection.cpp:319
> #5 0x0000000000561ce4 in
Moses::ChartManager::OutputNBestList (this=0x7fffacbe0010,
collector=0x9320d210, nBestList=std::vector of length 100,
capacity 128 = {...}, translationId=569)
> at moses/ChartManager.cpp:381
> #6 0x00000000005619d6 in Moses::ChartManager::OutputNBest
(this=0x7fffacbe0010, collector=0x9320d210) at
moses/ChartManager.cpp:335
> #7 0x0000000000467cd6 in Moses::TranslationTask::Run
(this=0x214d90b0) at moses/TranslationTask.cpp:111
> #8 0x0000000000530b69 in Moses::ThreadPool::Execute
(this=0x7fffffffd710) at moses/ThreadPool.cpp:61
> #9 0x0000000000534ecd in boost::_mfi::mf0<void,
Moses::ThreadPool>::operator() (this=0xf263088,
p=0x7fffffffd710) at
/home/lly/plateform/boost_1_55_0/include/boost/bind/mem_fn_template.hpp:49
> #10 0x0000000000534e30 in
boost::_bi::list1<boost::_bi::value<Moses::ThreadPool*>
>::operator()<boost::_mfi::mf0<void, Moses::ThreadPool>,
boost::_bi::list0> (this=0xf263098, f=..., a=...)
> at
/home/lly/plateform/boost_1_55_0/include/boost/bind/bind.hpp:253
> #11 0x0000000000534dd5 in boost::_bi::bind_t<void,
boost::_mfi::mf0<void, Moses::ThreadPool>,
boost::_bi::list1<boost::_bi::value<Moses::ThreadPool*> >
>::operator() (this=0xf263088)
> at
/home/lly/plateform/boost_1_55_0/include/boost/bind/bind_template.hpp:20
> #12 0x0000000000534d9a in
boost::detail::thread_data<boost::_bi::bind_t<void,
boost::_mfi::mf0<void, Moses::ThreadPool>,
boost::_bi::list1<boost::_bi::value<Moses::ThreadPool*> > >
>::run (this=0xf262ed0)
> at
/home/lly/plateform/boost_1_55_0/include/boost/thread/detail/thread.hpp:117
> #13 0x00000000008b4752 in thread_proxy ()
> #14 0x00007ffff6965e0e in start_thread () from
/lib64/libpthread.so.0
> #15 0x00007ffff669d2cd in clone () from /lib64/libc.so.6
>
>
> Has anyone had the problem before ? Any ideas on solving
this ?
> Many Thanks ?
>
>
>
>
> PS: In my experiment, I found the function " void
CompletedRuleCollection::Add(const TargetPhraseCollection
&tpc, const StackVec &stackVec, const std::vector<float>
&stackScores, const ChartParserCallback &outColl) " does not
consider " m_ruleLimit " . So after adding parameter "
-rule-limit 0 ", the decoder can only collect one translation
option.
>
>
>
>
> Cheers
> Liangyou
>
>
>
>
>
>
> --
>
>
> Liangyou Li
> CNGL
> School of Computing
> Dublin City University
>
>
> _______________________________________________
> Moses-support mailing list
> [email protected] <mailto:[email protected]>
> http://mailman.mit.edu/mailman/listinfo/moses-support
--
The University of Edinburgh is a charitable body, registered in
Scotland, with registration number SC005336.
--
Liangyou Li
CNGL
School of Computing
Dublin City University
_______________________________________________
Moses-support mailing list
[email protected] <mailto:[email protected]>
http://mailman.mit.edu/mailman/listinfo/moses-support
--
Liangyou Li
CNGL
School of Computing
Dublin City University
