Hi, I met similar problem before. Please check your parallel training data and lexical files. Generally speaking, there exists some invalid character in theses files.
在 2013年8月17日，1:21，xiaofeng wu <[email protected]> 写道： > Hi mr > > When I run hierarchical reordering with phrase model, I got the following > error: > > PhraseExtract v1.4, written by Philipp Koehn > phrase extraction from an aligned parallel corpus > *** Segmentation fault > Register dump: > > RAX: 000000000000005c RBX: 0000000000000000 RCX: 00000000027335d0 > RDX: 000000000040d150 RSI: 00007fffbd6ee828 RDI: 00007fffbd6ee7f0 > RBP: 00007fffbd6ee708 R8 : 0000000000000002 R9 : 0000000000000002 > R10: 0000000002720f80 R11: 00007fffbd6ee730 R12: 00007fffbd6ee738 > R13: 00007fffbd6ee7c8 R14: 00007fffbd6ee7f8 R15: 0000000000000007 > RSP: 00007fffbd6ee390 > > RIP: 000000000040de04 EFLAGS: 00010206 > > CS: 0033 FS: 0000 GS: 0000 > > Trap: 0000000e Error: 00000004 OldMask: 00000000 CR2: 0000007c > > FPUCW: 0000037f FPUSW: 00000000 TAG: 00000000 > RIP: 00000000 RDP: 00000000 > > ST(0) 0000 0000000000000000 ST(1) 0000 0000000000000000 > ST(2) 0000 0000000000000000 ST(3) 0000 0000000000000000 > ST(4) 0000 0000000000000000 ST(5) 0000 0000000000000000 > ST(6) 0000 0000000000000000 ST(7) 0000 0000000000000000 > mxcsr: 1f80 > XMM0: 0000000000000000000000007f757773 XMM1: > 0000000000000000000000007f757773 > XMM2: 0000000000000000000000007f757773 XMM3: > 0000000000000000000000007f757773 > XMM4: 0000000000000000000000007f757773 XMM5: > 0000000000000000000000007f757773 > XMM6: 0000000000000000000000007f757773 XMM7: > 0000000000000000000000007f757773 > XMM8: 0000000000000000000000007f757773 XMM9: > 0000000000000000000000007f757773 > XMM10: 0000000000000000000000007f757773 XMM11: > 0000000000000000000000007f757773 > XMM12: 0000000000000000000000007f757773 XMM13: > 0000000000000000000000007f757773 > XMM14: 0000000000000000000000007f757773 XMM15: > 0000000000000000000000007f757773 > > Backtrace: > /home/lly/plateform/moses/scripts/../bin/extract[0x40de04] > /home/lly/plateform/moses/scripts/../bin/extract[0x413b94] > /home/lly/plateform/moses/scripts/../bin/extract[0x40be2d] > /lib64/libc.so.6(__libc_start_main+0xf5)[0x7fbac28dd455] > /home/lly/plateform/moses/scripts/../bin/extract[0x40d059] > > Memory map: > > 00400000-0045e000 r-xp 00000000 00:21 29066575 > /home/lly/plateform/moses/bin/extract > 0065d000-0065e000 r--p 0005d000 00:21 29066575 > /home/lly/plateform/moses/bin/extract > 0065e000-0065f000 rw-p 0005e000 00:21 29066575 > /home/lly/plateform/moses/bin/extract > 0065f000-00660000 rw-p 00000000 00:00 0 > 02642000-0273a000 rw-p 00000000 00:00 0 > [heap] > 7fbac26ad000-7fbac26bb000 r-xp 00000000 08:11 5036 > /usr/lib64/libbz2.so.1.0.6 > 7fbac26bb000-7fbac28ba000 ---p 0000e000 08:11 5036 > /usr/lib64/libbz2.so.1.0.6 > 7fbac28ba000-7fbac28bb000 r--p 0000d000 08:11 5036 > /usr/lib64/libbz2.so.1.0.6 > 7fbac28bb000-7fbac28bc000 rw-p 0000e000 08:11 5036 > /usr/lib64/libbz2.so.1.0.6 > 7fbac28bc000-7fbac2a57000 r-xp 00000000 08:11 524302 > /lib64/libc-2.15.so > 7fbac2a57000-7fbac2c57000 ---p 0019b000 08:11 524302 > /lib64/libc-2.15.so > 7fbac2c57000-7fbac2c5b000 r--p 0019b000 08:11 524302 > /lib64/libc-2.15.so > 7fbac2c5b000-7fbac2c5d000 rw-p 0019f000 08:11 524302 > /lib64/libc-2.15.so > 7fbac2c5d000-7fbac2c61000 rw-p 00000000 00:00 0 > 7fbac2c61000-7fbac2c78000 r-xp 00000000 08:11 524328 > /lib64/libpthread-2.15.so > 7fbac2c78000-7fbac2e77000 ---p 00017000 08:11 524328 > /lib64/libpthread-2.15.so > 7fbac2e77000-7fbac2e78000 r--p 00016000 08:11 524328 > /lib64/libpthread-2.15.so > 7fbac2e78000-7fbac2e79000 rw-p 00017000 08:11 524328 > /lib64/libpthread-2.15.so > 7fbac2e79000-7fbac2e7e000 rw-p 00000000 00:00 0 > 7fbac2e7e000-7fbac2e93000 r-xp 00000000 08:11 524446 > /lib64/libgcc_s.so.1 > 7fbac2e93000-7fbac3092000 ---p 00015000 08:11 524446 > /lib64/libgcc_s.so.1 > 7fbac3092000-7fbac3093000 r--p 00014000 08:11 524446 > /lib64/libgcc_s.so.1 > 7fbac3093000-7fbac3094000 rw-p 00015000 08:11 524446 > /lib64/libgcc_s.so.1 > 7fbac3094000-7fbac3189000 r-xp 00000000 08:11 524310 > /lib64/libm-2.15.so > 7fbac3189000-7fbac3389000 ---p 000f5000 08:11 524310 > /lib64/libm-2.15.so > 7fbac3389000-7fbac338a000 r--p 000f5000 08:11 524310 > /lib64/libm-2.15.so > 7fbac338a000-7fbac338b000 rw-p 000f6000 08:11 524310 > /lib64/libm-2.15.so > 7fbac338b000-7fbac3473000 r-xp 00000000 08:11 6602 > /usr/lib64/libstdc++.so.6.0.17 > 7fbac3473000-7fbac3673000 ---p 000e8000 08:11 6602 > /usr/lib64/libstdc++.so.6.0.17 > 7fbac3673000-7fbac367b000 r--p 000e8000 08:11 6602 > /usr/lib64/libstdc++.so.6.0.17 > 7fbac367b000-7fbac367d000 rw-p 000f0000 08:11 6602 > /usr/lib64/libstdc++.so.6.0.17 > 7fbac367d000-7fbac3692000 rw-p 00000000 00:00 0 > 7fbac3692000-7fbac3699000 r-xp 00000000 08:11 524332 > /lib64/librt-2.15.so > 7fbac3699000-7fbac3898000 ---p 00007000 08:11 524332 > /lib64/librt-2.15.so > 7fbac3898000-7fbac3899000 r--p 00006000 08:11 524332 > /lib64/librt-2.15.so > 7fbac3899000-7fbac389a000 rw-p 00007000 08:11 524332 > /lib64/librt-2.15.so > 7fbac389a000-7fbac38b2000 r-xp 00000000 08:11 7833 > /usr/lib64/libboost_iostreams.so.1.49.0 > 7fbac38b2000-7fbac3ab2000 ---p 00018000 08:11 7833 > /usr/lib64/libboost_iostreams.so.1.49.0 > 7fbac3ab2000-7fbac3ab3000 r--p 00018000 08:11 7833 > /usr/lib64/libboost_iostreams.so.1.49.0 > 7fbac3ab3000-7fbac3ab4000 rw-p 00019000 08:11 7833 > /usr/lib64/libboost_iostreams.so.1.49.0 > 7fbac3ab4000-7fbac3ac9000 r-xp 00000000 08:11 524340 > /lib64/libz.so.1.2.7 > 7fbac3ac9000-7fbac3cc8000 ---p 00015000 08:11 524340 > /lib64/libz.so.1.2.7 > 7fbac3cc8000-7fbac3cc9000 r--p 00014000 08:11 524340 > /lib64/libz.so.1.2.7 > 7fbac3cc9000-7fbac3cca000 rw-p 00015000 08:11 524340 > /lib64/libz.so.1.2.7 > 7fbac3cca000-7fbac3cce000 r-xp 00000000 08:11 524299 > /lib64/libSegFault.so > 7fbac3cce000-7fbac3ecd000 ---p 00004000 08:11 524299 > /lib64/libSegFault.so > 7fbac3ecd000-7fbac3ece000 r--p 00003000 08:11 524299 > /lib64/libSegFault.so > 7fbac3ece000-7fbac3ecf000 rw-p 00004000 08:11 524299 > /lib64/libSegFault.so > 7fbac3ecf000-7fbac3ee9000 r-xp 00000000 08:11 7817 > /usr/lib64/libboost_thread.so.1.49.0 > 7fbac3ee9000-7fbac40e8000 ---p 0001a000 08:11 7817 > /usr/lib64/libboost_thread.so.1.49.0 > 7fbac40e8000-7fbac40ea000 r--p 00019000 08:11 7817 > /usr/lib64/libboost_thread.so.1.49.0 > 7fbac40ea000-7fbac40eb000 rw-p 0001b000 08:11 7817 > /usr/lib64/libboost_thread.so.1.49.0 > 7fbac40eb000-7fbac40ee000 r-xp 00000000 08:11 7820 > /usr/lib64/libboost_system.so.1.49.0 > 7fbac40ee000-7fbac42ed000 ---p 00003000 08:11 7820 > /usr/lib64/libboost_system.so.1.49.0 > 7fbac42ed000-7fbac42ee000 r--p 00002000 08:11 7820 > /usr/lib64/libboost_system.so.1.49.0 > 7fbac42ee000-7fbac42ef000 rw-p 00003000 08:11 7820 > /usr/lib64/libboost_system.so.1.49.0 > 7fbac42ef000-7fbac4314000 r-xp 00000000 08:11 4928 > /usr/lib64/liblzma.so.5.0.3 > 7fbac4314000-7fbac4513000 ---p 00025000 08:11 4928 > /usr/lib64/liblzma.so.5.0.3 > 7fbac4513000-7fbac4514000 r--p 00024000 08:11 4928 > /usr/lib64/liblzma.so.5.0.3 > 7fbac4514000-7fbac4515000 rw-p 00025000 08:11 4928 > /usr/lib64/liblzma.so.5.0.3 > 7fbac4515000-7fbac4536000 r-xp 00000000 08:11 534085 > /lib64/ld-2.15.so > 7fbac4710000-7fbac4718000 rw-p 00000000 00:00 0 > 7fbac4735000-7fbac4736000 rw-p 00000000 00:00 0 > 7fbac4736000-7fbac4737000 r--p 00021000 08:11 534085 > /lib64/ld-2.15.so > 7fbac4737000-7fbac4738000 rw-p 00022000 08:11 534085 > /lib64/ld-2.15.so > 7fbac4738000-7fbac4739000 rw-p 00000000 00:00 0 > 7fffbd6eb000-7fffbd8d9000 rw-p 00000000 00:00 0 > [stack] > 7fffbd9ff000-7fffbda00000 r-xp 00000000 00:00 0 > [vdso] > ffffffffff600000-ffffffffff601000 r-xp 00000000 00:00 0 > [vsyscall] > Segmentation fault > .................................................................................................................................. > when I go to gdb. > > (gdb) bt > #0 _M_lower_bound (__y=<optimized out>, __k=<synthetic pointer>, __x=0x5c, > this=<optimized out>) > at /usr/include/c++/4.7/bits/stl_tree.h:1114 > #1 find (__k=<synthetic pointer>, this=0x7fffffe15170) at > /usr/include/c++/4.7/bits/stl_tree.h:1557 > #2 find (__x=<synthetic pointer>, this=0x7fffffe15170) at > /usr/include/c++/4.7/bits/stl_set.h:617 > #3 MosesTraining::getOrientHierModel (sentence=..., modelType=<optimized > out>, > connectedLeftTop=connectedLeftTop@entry=false, > connectedRightTop=connectedRightTop@entry=false, > startF=startF@entry=2, endF=endF@entry=2, startE=startE@entry=6, > endE=endE@entry=6, countF=countF@entry=0, > zero=zero@entry=49, unit=unit@entry=-1, ge=ge@entry=0x40d150 > <MosesTraining::lt(int, int)>, > Python Exception <type 'exceptions.IndexError'> list index out of range: > Python Exception <type 'exceptions.IndexError'> list index out of range: > lt=lt@entry=0x40d140 <MosesTraining::ge(int, int)>, > inBottomRight=std::map with 47 elements, inBottomLeft= > Python Exception <type 'exceptions.IndexError'> list index out of range: > Python Exception <type 'exceptions.IndexError'> list index out of range: > std::map with 47 elements, outBottomRight=std::map with 29 elements, > outBottomLeft=std::map with 29 elements, > phraseOrient=phraseOrient@entry=MosesTraining::UNKNOWN) at > phrase-extract/extract-main.cpp:574 > #4 0x0000000000413b94 in MosesTraining::ExtractTask::extract > (this=this@entry=0x73b110, sentence=...) > at phrase-extract/extract-main.cpp:454 > #5 0x000000000040be2d in Run (this=0x73b110) at > phrase-extract/extract-main.cpp:303 > #6 main (argc=<optimized out>, argv=<optimized out>) at > phrase-extract/extract-main.cpp:275 > > > Best > -- > Xiaofeng Wu > CNGL, School of Computing, > Dublin City University, > Glasnevin, Dublin 9. > Email: [email protected] > Tel: +353 (0)1 700 6715 > _______________________________________________ > Moses-support mailing list > [email protected] > http://mailman.mit.edu/mailman/listinfo/moses-support
_______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
