Thanks Barry No error shows up with valgrind on a small sample. I will try again on the real dataset.
Cheers Liangyou On Fri, Mar 13, 2015 at 8:33 AM, Barry Haddow <[email protected]> wrote: > Hi Liangyou > > Did any relevant errors show up with valgrind? The problem is that running > under valgrind reduces parallelism so may make the error disappear, but it > is worth trying all the same, > > cheers - Barry > > > On 12/03/15 23:36, Liangyou Li wrote: > > Hi Barry > > I tried to use valgrind on a small sample (100 sent.), but there's no > any error. > Since it happens kind of randomly, I would re-test it. > I also run the decoder on another dataset, the error appear again. > > The command to compile Boost_1_55_0 is the same as the one on Moses > webpage. After setting the BOOST_BUILD_PATH and BOOST_ROOT to this local > boost dir, I compile moses with command: > > /home/lly/plateform/boost_1_55_0/bjam -j8 > --with-srilm=/home/lly/plateform/srilm > --with-boost=/home/lly/plateform/boost_1_55_0 -q variant=debug > > The error msg is as follows: > > *** Segmentation fault > Register dump: > > RAX: 00007f0dd4812210 RBX: 0000000000000000 RCX: 0000000000000006 > RDX: 00007f0d9fceeab0 RSI: 0000000000000000 RDI: 00007f0dd4812210 > RBP: 00007f0dd48121c0 R8 : 00007f0de01bd030 R9 : 00007f0de01a2c90 > R10: 00007f0de01bd030 R11: 0000000000000000 R12: 0000000000000000 > R13: 00007fff25dc8e90 R14: 0000000000000000 R15: 00007f0dd4813700 > RSP: 00007f0dd48121a8 > > RIP: 00007f0ddff505e3 EFLAGS: 00010202 > > CS: 0033 FS: 0000 GS: 0000 > > Trap: 0000000e Error: 00000005 OldMask: 00000000 CR2: ffffffe8 > > FPUCW: 0000037f FPUSW: 00000000 TAG: 00000000 > RIP: 00000000 RDP: 00000000 > > ST(0) 0000 0000000000000000 ST(1) 0000 0000000000000000 > ST(2) 0000 0000000000000000 ST(3) 0000 0000000000000000 > ST(4) 0000 0000000000000000 ST(5) 0000 0000000000000000 > ST(6) 0000 0000000000000000 ST(7) 0000 0000000000000000 > mxcsr: 1fa4 > XMM0: 00000000000000000000000000000000 XMM1: > 00000000000000000000000000000000 > XMM2: 00000000000000000000000000000000 XMM3: > 00000000000000000000000000000000 > XMM4: 00000000000000000000000000000000 XMM5: > 00000000000000000000000000000000 > XMM6: 00000000000000000000000000000000 XMM7: > 00000000000000000000000000000000 > XMM8: 00000000000000000000000000000000 XMM9: > 00000000000000000000000000000000 > XMM10: 00000000000000000000000000000000 XMM11: > 00000000000000000000000000000000 > XMM12: 00000000000000000000000000000000 XMM13: > 00000000000000000000000000000000 > XMM14: 00000000000000000000000000000000 XMM15: > 00000000000000000000000000000000 > > Backtrace: > > /usr/lib64/libstdc++.so.6(_ZStlsIcSt11char_traitsIcESaIcEERSt13basic_ostreamIT_T0_ES7_RKSbIS4_S5_T1_E+0x3)[0x7f0ddff505e3] > /home/lly/plateform/moses-3.0/bin/moses_chart[0x58400d] > /home/lly/plateform/moses-3.0/bin/moses_chart[0x43ffd6] > /home/lly/plateform/moses-3.0/bin/moses_chart[0x44057e] > /home/lly/plateform/moses-3.0/bin/moses_chart[0x4402fe] > /home/lly/plateform/moses-3.0/bin/moses_chart[0x561d16] > /home/lly/plateform/moses-3.0/bin/moses_chart[0x561a08] > /home/lly/plateform/moses-3.0/bin/moses_chart[0x47baa2] > /home/lly/plateform/moses-3.0/bin/moses_chart[0x530bdd] > /home/lly/plateform/moses-3.0/bin/moses_chart[0x534f41] > /home/lly/plateform/moses-3.0/bin/moses_chart[0x534ea4] > /home/lly/plateform/moses-3.0/bin/moses_chart[0x534e49] > /home/lly/plateform/moses-3.0/bin/moses_chart[0x534e0e] > /home/lly/plateform/moses-3.0/bin/moses_chart[0x8b3892] > /lib64/libpthread.so.0(+0x7e0e)[0x7f0ddf796e0e] > /lib64/libc.so.6(clone+0x6d)[0x7f0ddf4ce2cd] > > Memory map: > > 00400000-00bac000 r-xp 00000000 00:21 36148887 > /home/lly/plateform/moses-3.0/bin/moses > 00dab000-00dac000 r--p 007ab000 00:21 36148887 > /home/lly/plateform/moses-3.0/bin/moses > 00dac000-00dae000 rw-p 007ac000 00:21 36148887 > /home/lly/plateform/moses-3.0/bin/moses > 00dae000-00e14000 rw-p 00000000 00:00 0 > 01d11000-7725c000 rw-p 00000000 00:00 0 > [heap] > 7f0ca8000000-7f0ca96ef000 rw-p 00000000 00:00 0 > 7f0ca96ef000-7f0cac000000 ---p 00000000 00:00 0 > 7f0cb0000000-7f0cb208c000 rw-p 00000000 00:00 0 > 7f0cb208c000-7f0cb4000000 ---p 00000000 00:00 0 > 7f0cb8000000-7f0cbc000000 rw-p 00000000 00:00 0 > 7f0cbc000000-7f0cbdb78000 rw-p 00000000 00:00 0 > 7f0cbdb78000-7f0cc0000000 ---p 00000000 00:00 0 > 7f0cc0000000-7f0cc310b000 rw-p 00000000 00:00 0 > 7f0cc310b000-7f0cc4000000 ---p 00000000 00:00 0 > 7f0cc4000000-7f0cc7c46000 rw-p 00000000 00:00 0 > 7f0cc7c46000-7f0cc8000000 ---p 00000000 00:00 0 > 7f0cc8000000-7f0ccc000000 rw-p 00000000 00:00 0 > 7f0ccc000000-7f0cd0000000 rw-p 00000000 00:00 0 > 7f0cd0000000-7f0cd264f000 rw-p 00000000 00:00 0 > 7f0cd264f000-7f0cd4000000 ---p 00000000 00:00 0 > 7f0cd8000000-7f0cda190000 rw-p 00000000 00:00 0 > 7f0cda190000-7f0cdc000000 ---p 00000000 00:00 0 > 7f0cdc000000-7f0cddec3000 rw-p 00000000 00:00 0 > 7f0cddec3000-7f0ce0000000 ---p 00000000 00:00 0 > 7f0ce0000000-7f0ce4000000 rw-p 00000000 00:00 0 > 7f0ce4000000-7f0ce8000000 rw-p 00000000 00:00 0 > 7f0ce8000000-7f0cec000000 rw-p 00000000 00:00 0 > 7f0cec000000-7f0cf0000000 rw-p 00000000 00:00 0 > 7f0cf0000000-7f0cf23d9000 rw-p 00000000 00:00 0 > 7f0cf23d9000-7f0cf4000000 ---p 00000000 00:00 0 > 7f0cf4000000-7f0cf8000000 rw-p 00000000 00:00 0 > 7f0cfc000000-7f0d00000000 rw-p 00000000 00:00 0 > 7f0d00000000-7f0d04000000 rw-p 00000000 00:00 0 > 7f0d04000000-7f0d08000000 rw-p 00000000 00:00 0 > 7f0d0c000000-7f0d0f4f0000 rw-p 00000000 00:00 0 > 7f0d0f4f0000-7f0d10000000 ---p 00000000 00:00 0 > 7f0d14000000-7f0d17d65000 rw-p 00000000 00:00 0 > 7f0d17d65000-7f0d18000000 ---p 00000000 00:00 0 > 7f0d1c000000-7f0d20000000 rw-p 00000000 00:00 0 > 7f0d20000000-7f0d24000000 rw-p 00000000 00:00 0 > 7f0d24000000-7f0d27f50000 rw-p 00000000 00:00 0 > 7f0d27f50000-7f0d28000000 ---p 00000000 00:00 0 > 7f0d28000000-7f0d2c000000 rw-p 00000000 00:00 0 > 7f0d2c000000-7f0d2dda8000 rw-p 00000000 00:00 0 > 7f0d2dda8000-7f0d30000000 ---p 00000000 00:00 0 > 7f0d30000000-7f0d34000000 rw-p 00000000 00:00 0 > 7f0d34000000-7f0d38000000 rw-p 00000000 00:00 0 > 7f0d38000000-7f0d3a518000 rw-p 00000000 00:00 0 > 7f0d3a518000-7f0d3c000000 ---p 00000000 00:00 0 > 7f0d3c000000-7f0d40000000 rw-p 00000000 00:00 0 > 7f0d40000000-7f0d44000000 rw-p 00000000 00:00 0 > 7f0d44000000-7f0d48000000 rw-p 00000000 00:00 0 > 7f0d4c000000-7f0d50000000 rw-p 00000000 00:00 0 > 7f0d50000000-7f0d54000000 rw-p 00000000 00:00 0 > 7f0d54000000-7f0d58000000 rw-p 00000000 00:00 0 > 7f0d58000000-7f0d5b80d000 rw-p 00000000 00:00 0 > 7f0d5b80d000-7f0d5c000000 ---p 00000000 00:00 0 > 7f0d5c000000-7f0d60000000 rw-p 00000000 00:00 0 > 7f0d60000000-7f0d64000000 rw-p 00000000 00:00 0 > 7f0d64000000-7f0d6714a000 rw-p 00000000 00:00 0 > 7f0d6714a000-7f0d68000000 ---p 00000000 00:00 0 > 7f0d68000000-7f0d6c000000 rw-p 00000000 00:00 0 > 7f0d6c000000-7f0d70000000 rw-p 00000000 00:00 0 > 7f0d70000000-7f0d74000000 rw-p 00000000 00:00 0 > 7f0d74000000-7f0d78000000 rw-p 00000000 00:00 0 > 7f0d78000000-7f0d7c000000 rw-p 00000000 00:00 0 > 7f0d7c000000-7f0d80000000 rw-p 00000000 00:00 0 > 7f0d80000000-7f0d84000000 rw-p 00000000 00:00 0 > 7f0d84000000-7f0d88000000 rw-p 00000000 00:00 0 > 7f0d88000000-7f0d8c000000 rw-p 00000000 00:00 0 > 7f0d8c000000-7f0d90000000 rw-p 00000000 00:00 0 > 7f0d90000000-7f0d94000000 rw-p 00000000 00:00 0 > 7f0d94000000-7f0d98000000 rw-p 00000000 00:00 0 > 7f0d98000000-7f0d9c000000 rw-p 00000000 00:00 0 > 7f0d9c000000-7f0da0000000 rw-p 00000000 00:00 0 > 7f0da0000000-7f0da4000000 rw-p 00000000 00:00 0 > 7f0da4000000-7f0da8000000 rw-p 00000000 00:00 0 > 7f0da8000000-7f0dac000000 rw-p 00000000 00:00 0 > 7f0dac000000-7f0db0000000 rw-p 00000000 00:00 0 > 7f0db0000000-7f0db4000000 rw-p 00000000 00:00 0 > 7f0db4000000-7f0db8000000 rw-p 00000000 00:00 0 > 7f0db8000000-7f0dbc000000 rw-p 00000000 00:00 0 > 7f0dbc000000-7f0dc0000000 rw-p 00000000 00:00 0 > 7f0dc0000000-7f0dc4000000 rw-p 00000000 00:00 0 > 7f0dc4000000-7f0dc8000000 rw-p 00000000 00:00 0 > 7f0dc8000000-7f0dcc000000 rw-p 00000000 00:00 0 > 7f0dcc000000-7f0dd0000000 rw-p 00000000 00:00 0 > 7f0dd3011000-7f0dd3012000 ---p 00000000 00:00 0 > 7f0dd3012000-7f0dd3812000 rw-p 00000000 00:00 0 > [stack:2289] > 7f0dd3812000-7f0dd3813000 ---p 00000000 00:00 0 > 7f0dd3813000-7f0dd4013000 rw-p 00000000 00:00 0 > [stack:2288] > 7f0dd4013000-7f0dd4014000 ---p 00000000 00:00 0 > 7f0dd4014000-7f0dd4814000 rw-p 00000000 00:00 0 > [stack:2287] > 7f0dd4814000-7f0dd4815000 ---p 00000000 00:00 0 > 7f0dd4815000-7f0dd5015000 rw-p 00000000 00:00 0 > [stack:2286] > 7f0dd5015000-7f0dd5016000 ---p 00000000 00:00 0 > 7f0dd5016000-7f0dd5816000 rw-p 00000000 00:00 0 > [stack:2285] > 7f0dd5816000-7f0dd5817000 ---p 00000000 00:00 0 > 7f0dd5817000-7f0dd6017000 rw-p 00000000 00:00 0 > [stack:2284] > 7f0dd6017000-7f0dd6018000 ---p 00000000 00:00 0 > 7f0dd6018000-7f0dd6818000 rw-p 00000000 00:00 0 > [stack:2283] > 7f0dd6818000-7f0dd6819000 ---p 00000000 00:00 0 > 7f0dd6819000-7f0dd7019000 rw-p 00000000 00:00 0 > [stack:2282] > 7f0dd7019000-7f0dd701a000 ---p 00000000 00:00 0 > 7f0dd701a000-7f0dd781a000 rw-p 00000000 00:00 0 > [stack:2281] > 7f0dd781a000-7f0dd781b000 ---p 00000000 00:00 0 > 7f0dd781b000-7f0dd801b000 rw-p 00000000 00:00 0 > [stack:2280] > 7f0dd801b000-7f0dd801c000 ---p 00000000 00:00 0 > 7f0dd801c000-7f0dd881c000 rw-p 00000000 00:00 0 > [stack:2279] > 7f0dd881c000-7f0dd881d000 ---p 00000000 00:00 0 > 7f0dd881d000-7f0dd901d000 rw-p 00000000 00:00 0 > [stack:2278] > 7f0dd901d000-7f0dd901e000 ---p 00000000 00:00 0 > 7f0dd901e000-7f0dd981e000 rw-p 00000000 00:00 0 > [stack:2277] > 7f0dd981e000-7f0dd981f000 ---p 00000000 00:00 0 > 7f0dd981f000-7f0dda01f000 rw-p 00000000 00:00 0 > [stack:2276] > 7f0dda01f000-7f0dda020000 ---p 00000000 00:00 0 > 7f0dda020000-7f0dda820000 rw-p 00000000 00:00 0 > [stack:2275] > 7f0dda820000-7f0dda821000 ---p 00000000 00:00 0 > 7f0dda821000-7f0ddb021000 rw-p 00000000 00:00 0 > [stack:2274] > 7f0ddb021000-7f0ddb022000 ---p 00000000 00:00 0 > 7f0ddb022000-7f0ddb822000 rw-p 00000000 00:00 0 > [stack:2273] > 7f0ddb822000-7f0ddb823000 ---p 00000000 00:00 0 > 7f0ddb823000-7f0ddc023000 rw-p 00000000 00:00 0 > [stack:2272] > 7f0ddc023000-7f0ddc024000 ---p 00000000 00:00 0 > 7f0ddc024000-7f0ddc824000 rw-p 00000000 00:00 0 > [stack:2270] > 7f0ddc824000-7f0ddc825000 ---p 00000000 00:00 0 > 7f0ddc825000-7f0ddd025000 rw-p 00000000 00:00 0 > [stack:2269] > 7f0ddd025000-7f0ddd026000 ---p 00000000 00:00 0 > 7f0ddd026000-7f0ddd826000 rw-p 00000000 00:00 0 > [stack:2268] > 7f0ddd826000-7f0ddd827000 ---p 00000000 00:00 0 > 7f0ddd827000-7f0dde027000 rw-p 00000000 00:00 0 > [stack:2267] > 7f0dde027000-7f0dde028000 ---p 00000000 00:00 0 > 7f0dde028000-7f0dde828000 rw-p 00000000 00:00 0 > [stack:2266] > 7f0dde828000-7f0dde829000 ---p 00000000 00:00 0 > 7f0dde829000-7f0ddf08b000 rw-p 00000000 00:00 0 > [stack:2265] > 7f0ddf1ae000-7f0ddf3ea000 r--s 00000000 00:21 35413235 > /home/lly/work/perceptron/lm/en.binlm3 > 7f0ddf3ea000-7f0ddf585000 r-xp 00000000 08:11 262155 > /lib64/libc-2.15.so > 7f0ddf585000-7f0ddf785000 ---p 0019b000 08:11 262155 > /lib64/libc-2.15.so > 7f0ddf785000-7f0ddf789000 r--p 0019b000 08:11 262155 > /lib64/libc-2.15.so > 7f0ddf789000-7f0ddf78b000 rw-p 0019f000 08:11 262155 > /lib64/libc-2.15.so > 7f0ddf78b000-7f0ddf78f000 rw-p 00000000 00:00 0 > 7f0ddf78f000-7f0ddf7a6000 r-xp 00000000 08:11 262181 > /lib64/libpthread-2.15.so > 7f0ddf7a6000-7f0ddf9a5000 ---p 00017000 08:11 262181 > /lib64/libpthread-2.15.so > 7f0ddf9a5000-7f0ddf9a6000 r--p 00016000 08:11 262181 > /lib64/libpthread-2.15.so > 7f0ddf9a6000-7f0ddf9a7000 rw-p 00017000 08:11 262181 > /lib64/libpthread-2.15.so > 7f0ddf9a7000-7f0ddf9ab000 rw-p 00000000 00:00 0 > 7f0ddf9ab000-7f0ddf9c0000 r-xp 00000000 08:11 262300 > /lib64/libgcc_s.so.1 > 7f0ddf9c0000-7f0ddfbbf000 ---p 00015000 08:11 262300 > /lib64/libgcc_s.so.1 > 7f0ddfbbf000-7f0ddfbc0000 r--p 00014000 08:11 262300 > /lib64/libgcc_s.so.1 > 7f0ddfbc0000-7f0ddfbc1000 rw-p 00015000 08:11 262300 > /lib64/libgcc_s.so.1 > 7f0ddfbc1000-7f0ddfcb6000 r-xp 00000000 08:11 262163 > /lib64/libm-2.15.so > 7f0ddfcb6000-7f0ddfeb6000 ---p 000f5000 08:11 262163 > /lib64/libm-2.15.so > 7f0ddfeb6000-7f0ddfeb7000 r--p 000f5000 08:11 262163 > /lib64/libm-2.15.so > 7f0ddfeb7000-7f0ddfeb8000 rw-p 000f6000 08:11 262163 > /lib64/libm-2.15.so > 7f0ddfeb8000-7f0ddffa0000 r-xp 00000000 08:11 1710646 > /usr/lib64/libstdc++.so.6.0.17 > 7f0ddffa0000-7f0de01a0000 ---p 000e8000 08:11 1710646 > /usr/lib64/libstdc++.so.6.0.17 > 7f0de01a0000-7f0de01a8000 r--p 000e8000 08:11 1710646 > /usSegmentation fault > r/lib64/libstdc++.so.6.0.17 > 7f0de01a8000-7f0de01aa000 rw-p 000f0000 08:11 1710646 > /usr/lib64/libstdc++.so.6.0.17 > 7f0de01aa000-7f0de01bf000 rw-p 00000000 00:00 0 > 7f0de01bf000-7f0de01c6000 r-xp 00000000 08:11 262185 > /lib64/librt-2.15.so > 7f0de01c6000-7f0de03c5000 ---p 00007000 08:11 262185 > /lib64/librt-2.15.so > 7f0de03c5000-7f0de03c6000 r--p 00006000 08:11 262185 > /lib64/librt-2.15.so > 7f0de03c6000-7f0de03c7000 rw-p 00007000 08:11 2621: 0000000000000000 > R12: 0000000000000000 > R13: 00007fff25dc8e90 R14: 0000000000000000 R15: 00007f0dd6817700 > RSP: 00007f0dd68161a8 > > RIP: 00007f0ddff505e3 EFLAGS: 00010206 > > CS: 0033 FS: 0000 GS: 0000 > > Trap: 0000000e Error: 00000005 OldMask: 00000000 CR2: ffffffe8 > > FPUCW: 0000037f FPUSW: 00000000 TAG: 00000000 > RIP: 00000000 RDP: 00000000 > > ST(0) 0000 0000000000000000 ST(1) 0000 0000000000000000 > ST(2) 0000 0000000000000000 ST(3) 0000 0000000000000000 > ST(4) 0000 0000000000000000 ST(5) 0000 0000000000000000 > ST(6) 0000 0000000000000000 ST(7) 0000 0000000000000000 > mxcsr: 1fa4 > XMM0: 00000000000000000000000000000000 XMM1: > 00000000000000000000000000000000 > XMM2: 00000000000000000000000000000000 XMM3: > 00000000000000000000000000000000 > XMM4: 00000000000000000000000000000000 XMM5: > 00000000000000000000000000000000 > XMM6: 00000000000000000000000000000000 XMM7: > 00000000000000000000000000000000 > XMM8: 00000000000000000000000000000000 XMM9: > 00000000000000000000000000000000 > XMM10: 00000000000000000000000000000000 XMM11: > 00000000000000000000000000000000 > XMM12: 00000000000000000000000000000000 XMM13: > 00000000000000000000000000000000 > XMM14: 00000000000000000000000000000000 XMM15: > 00000000000000000000000000000000 > > Backtrace: > 185 /lib64/librt-2.15.so > 7f0de03c7000-7f0de03dc000 r-xp 00000000 08:11 262194 > /lib64/libz.so.1.2.7 > 7f0de03dc000-7f0de05db000 ---p 00015000 08:11 262194 > /lib64/libz.so.1.2.7 > 7f0de05db000-7f0de05dc000 r--p 00014000 08:11 262194 > /lib64/libz.so.1.2.7 > 7f0de05dc000-7f0de05dd000 rw-p 00015000 08:11 262194 > /lib64/libz.so.1.2.7 > 7f0de05dd000-7f0de05e1000 r-xp 00000000 08:11 262152 > /lib64/libSegFault.so > 7f0de05e1000-7f0de07e0000 ---p 00004000 08:11 262152 > /lib64/libSegFault.so > 7f0de07e0000-7f0de07e1000 r--p 00003000 08:11 262152 > /lib64/libSegFault.so > 7f0de07e1000-7f0de07e2000 rw-p 00004000 08:11 262152 > /lib64/libSegFault.so > 7f0de07e2000-7f0de07e5000 r-xp 00000000 08:11 262161 > /lib64/libdl-2.15.so > 7f0de07e5000-7f0de09e4000 ---p 00003000 08:11 262161 > /lib64/libdl-2.15.so > 7f0de09e4000-7f0de09e5000 r--p 00002000 08:11 262161 > /lib64/libdl-2.15.so > 7f0de09e5000-7f0de09e6000 rw-p 00003000 08:11 262161 > /lib64/libdl-2.15.so > 7f0de09e6000-7f0de0a0b000 r-xp 00000000 08:11 1708628 > /usr/lib64/liblzma.so.5.0.3 > 7f0de0a0b000-7f0de0c0a000 ---p 00025000 08:11 1708628 > /usr/lib64/liblzma.so.5.0.3 > 7f0de0c0a000-7f0de0c0b000 r--p 00024000 08:11 1708628 > /usr/lib64/liblzma.so.5.0.3 > 7f0de0c0b000-7f0de0c0c000 rw-p 00025000 08:11 1708628 > /usr/lib64/liblzma.so.5.0.3 > 7f0de0c0c000-7f0de0c2d000 r-xp 00000000 08:11 280462 > /lib64/ld-2.15.so > 7f0de0d06000-7f0de0e0e000 rw-p 00000000 00:00 0 > 7f0de0e2c000-7f0de0e2d000 rw-p 00000000 00:00 0 > 7f0de0e2d000-7f0de0e2e000 r--p 00021000 08:11 280462 > /lib64/ld-2.15.so > 7f0de0e2e000-7f0de0e2f000 rw-p 00022000 08:11 280462 > /lib64/ld-2.15.so > 7f0de0e2f000-7f0de0e30000 rw-p 00000000 00:00 0 > 7fff25daa000-7fff25dcc000 rw-p 00000000 00:00 0 > [stack] > 7fff25dff000-7fff25e00000 r-xp 00000000 00:00 0 > [vdso] > ffffffffff600000-ffffffffff601000 r-xp 00000000 00:00 0 > [vsyscall] > > /usr/lib64/libstdc++.so.6(_ZStlsIcSt11char_traitsIcESaIcEERSt13basic_ostreamIT_T0_ES7_RKSbIS4_S5_T1_E+0x3)[0x7f0ddff505e3] > /home/lly/plateform/moses-3.0/bin/moses_chart[0x58400d] > /home/lly/plateform/moses-3.0/bin/moses_chart[0x43ffd6] > /home/lly/plateform/moses-3.0/bin/moses_chart[0x44057e] > /home/lly/plateform/moses-3.0/bin/moses_chart[0x4402fe] > /home/lly/plateform/moses-3.0/bin/moses_chart[0x561d16] > /home/lly/plateform/moses-3.0/bin/moses_chart[0x561a08] > /home/lly/plateform/moses-3.0/bin/moses_chart[0x47baa2] > /home/lly/plateform/moses-3.0/bin/moses_chart[0x530bdd] > /home/lly/plateform/moses-3.0/bin/moses_chart[0x534f41] > /home/lly/plateform/moses-3.0/bin/moses_chart[0x534ea4] > /home/lly/plateform/moses-3.0/bin/moses_chart[0x534e49] > /home/lly/plateform/moses-3.0/bin/moses_chart[0x534e0e] > /home/lly/plateform/moses-3.0/bin/moses_chart[0x8b3892] > /lib64/libpthread.so.0(+0x7e0e)[0x7f0ddf796e0e] > sh: line 1: 2260 Segmentation fault > /home/lly/plateform/moses-3.0/bin/moses_chart -threads all -config > /home/lly/work/perceptron/tune/moses-sparse.ini -weight-overwrite > 'PhrasePenalty0= -0.086708 WordPenalty0= -0.133063 TranslationModel0= > 0.129426 0.015298 0.147046 -0.033093 TranslationModel1= 0.340195 LM0= > 0.115169' -weight-file run2.sparse-weights -n-best-list run2.best100.out > 100 distinct -input-file /home/lly/work/perceptron/tune/devset.train.zh > > run2.out > > > Regards > Liangyou > > > On Wed, Mar 11, 2015 at 8:58 PM, Barry Haddow <[email protected]> > wrote: > >> Hi Liangyou >> >> This is a bit strange. The stacktrace suggests corruption in the feature >> vector, but it would be surprising that we haven't seen it before. Can you >> reproduce the problem when running under valgrind? The memory could be >> getting corrupted by a completely different source, which we'll really only >> find with a memory checker. >> >> cheers - Barry >> >> >> On 11/03/15 17:50, Liangyou Li wrote: >> >> Thanks Matthias. >> >> This problem doesn't always happen. >> Even on the same data, sometimes it can run without crash, sometimes it >> doesn't. >> But, by now, the error only happens when the decoder outputs features. >> (-n-best-list or -output-search-graph-hypergraph) >> >> Cheers >> Liangyou >> >> >> On Wed, Mar 11, 2015 at 5:38 PM, Matthias Huck <[email protected]> >> wrote: >> >>> Hi, >>> >>> I've recently been using these sparse feature functions without any >>> issues in multi-threaded chart-based decoding. There might be a problem >>> with thread safety, but I currently can't tell why you got the >>> segmentation fault. You should investigate this in more detail. >>> >>> Cheers, >>> Matthias >>> >>> >>> >>> On Wed, 2015-03-11 at 12:12 +0000, Liangyou Li wrote: >>> > When I run moses with sparse features in multi-threads ( parameter >>> -threads all), I got segmentation fault. >>> > >>> > >>> > The three sparse features are: >>> > SourceWordDeletionFeature factor=0 >>> > TargetWordInsertionFeature factor=0 >>> > WordTranslationFeature input-factor=0 output-factor=0 >>> > >>> > >>> > The exact command I used is: >>> > moses_chart -threads all -f moses.ini -i input -n-best-list nbest >>> 100 distinct >>> > >>> > >>> > This error happens kind of randomly. But it only happens when sparse >>> features and multi-threads are used. >>> > >>> > >>> > I've tried several times to use gdb to trace the error. Fortunately, I >>> just get the back-trace info, as listed: >>> > >>> > >>> > Program received signal SIGSEGV, Segmentation fault. >>> > [Switching to Thread 0x7fffdae77700 (LWP 32390)] >>> > 0x00007ffff711f5e3 in std::basic_ostream<char, std::char_traits<char> >>> >& std::operator<< <char, std::char_traits<char>, std::allocator<char> >>> >(std::basic_ostream<char, std::char_traits<char> >&, >>> std::basic_string<char, std::char_traits<char>, std::allocator<char> > >>> const&) () from /usr/lib64/libstdc++.so.6 >>> > Missing separate debuginfos, use: zypper install >>> glibc-debuginfo-2.15-22.17.1.x86_64 >>> libgcc47-debuginfo-4.7.1_20120723-1.1.1.x86_64 >>> liblzma5-debuginfo-5.0.3-12.2.2.x86_64 >>> libstdc++47-debuginfo-4.7.1_20120723-1.1.1.x86_64 >>> zlib-debuginfo-1.2.7-2.1.2.x86_64 >>> > (gdb) backtrace >>> > #0 0x00007ffff711f5e3 in std::basic_ostream<char, >>> std::char_traits<char> >& std::operator<< <char, std::char_traits<char>, >>> std::allocator<char> >(std::basic_ostream<char, std::char_traits<char> >&, >>> std::basic_string<char, std::char_traits<char>, std::allocator<char> > >>> const&) () from /usr/lib64/libstdc++.so.6 >>> > #1 0x0000000000584711 in Moses::operator<< (out=..., name=...) at >>> moses/FeatureVector.cpp:141 >>> > #2 0x0000000000440232 in >>> Moses::ScoreComponentCollection::GetVectorForProducer (this=0x7fffad0e9380, >>> sp=0xe2aab0) at moses/ScoreComponentCollection.cpp:293 >>> > #3 0x00000000004407da in >>> Moses::ScoreComponentCollection::OutputFeatureScores (this=0x7fffad0e9380, >>> out=..., ff=0xe2aab0, lastName="LM0") at >>> moses/ScoreComponentCollection.cpp:351 >>> > #4 0x000000000044055a in >>> Moses::ScoreComponentCollection::OutputAllFeatureScores >>> (this=0x7fffad0e9380, out=...) at moses/ScoreComponentCollection.cpp:319 >>> > #5 0x0000000000561ce4 in Moses::ChartManager::OutputNBestList >>> (this=0x7fffacbe0010, collector=0x9320d210, nBestList=std::vector of length >>> 100, capacity 128 = {...}, translationId=569) >>> > at moses/ChartManager.cpp:381 >>> > #6 0x00000000005619d6 in Moses::ChartManager::OutputNBest >>> (this=0x7fffacbe0010, collector=0x9320d210) at moses/ChartManager.cpp:335 >>> > #7 0x0000000000467cd6 in Moses::TranslationTask::Run >>> (this=0x214d90b0) at moses/TranslationTask.cpp:111 >>> > #8 0x0000000000530b69 in Moses::ThreadPool::Execute >>> (this=0x7fffffffd710) at moses/ThreadPool.cpp:61 >>> > #9 0x0000000000534ecd in boost::_mfi::mf0<void, >>> Moses::ThreadPool>::operator() (this=0xf263088, p=0x7fffffffd710) at >>> /home/lly/plateform/boost_1_55_0/include/boost/bind/mem_fn_template.hpp:49 >>> > #10 0x0000000000534e30 in >>> boost::_bi::list1<boost::_bi::value<Moses::ThreadPool*> >>> >::operator()<boost::_mfi::mf0<void, Moses::ThreadPool>, boost::_bi::list0> >>> (this=0xf263098, f=..., a=...) >>> > at /home/lly/plateform/boost_1_55_0/include/boost/bind/bind.hpp:253 >>> > #11 0x0000000000534dd5 in boost::_bi::bind_t<void, >>> boost::_mfi::mf0<void, Moses::ThreadPool>, >>> boost::_bi::list1<boost::_bi::value<Moses::ThreadPool*> > >::operator() >>> (this=0xf263088) >>> > at >>> /home/lly/plateform/boost_1_55_0/include/boost/bind/bind_template.hpp:20 >>> > #12 0x0000000000534d9a in >>> boost::detail::thread_data<boost::_bi::bind_t<void, boost::_mfi::mf0<void, >>> Moses::ThreadPool>, boost::_bi::list1<boost::_bi::value<Moses::ThreadPool*> >>> > > >::run (this=0xf262ed0) >>> > at >>> /home/lly/plateform/boost_1_55_0/include/boost/thread/detail/thread.hpp:117 >>> > #13 0x00000000008b4752 in thread_proxy () >>> > #14 0x00007ffff6965e0e in start_thread () from /lib64/libpthread.so.0 >>> > #15 0x00007ffff669d2cd in clone () from /lib64/libc.so.6 >>> > >>> > >>> > Has anyone had the problem before ? Any ideas on solving this ? >>> > Many Thanks ? >>> > >>> > >>> > >>> > >>> > PS: In my experiment, I found the function " void >>> CompletedRuleCollection::Add(const TargetPhraseCollection &tpc, const >>> StackVec &stackVec, const std::vector<float> &stackScores, const >>> ChartParserCallback &outColl) " does not consider " m_ruleLimit " . So >>> after adding parameter " -rule-limit 0 ", the decoder can only collect one >>> translation option. >>> > >>> > >>> > >>> > >>> > Cheers >>> > Liangyou >>> > >>> > >>> > >>> > >>> > >>> > >>> > -- >>> > >>> > >>> > Liangyou Li >>> > CNGL >>> > School of Computing >>> > Dublin City University >>> > >>> > >>> > _______________________________________________ >>> > Moses-support mailing list >>> > [email protected] >>> > http://mailman.mit.edu/mailman/listinfo/moses-support >>> >>> >>> >>> -- >>> The University of Edinburgh is a charitable body, registered in >>> Scotland, with registration number SC005336. >>> >>> >> >> >> -- >> >> Liangyou Li >> CNGL >> School of Computing >> Dublin City University >> >> >> >> _______________________________________________ >> Moses-support mailing >> [email protected]http://mailman.mit.edu/mailman/listinfo/moses-support >> >> >> > > > -- > > Liangyou Li > CNGL > School of Computing > Dublin City University > > > -- Liangyou Li CNGL School of Computing Dublin City University
_______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
