Hi, this strongly suggests that your process ran out of memory. Try filtering the phrase table and/or use the binary translation table format.
-phi On Wed, Sep 10, 2008 at 4:25 AM, Thang Luong Minh <[EMAIL PROTECTED]> wrote: > Dear all, > > I keep having the "decoder died" problem when running mert-moses(details > below). The decoder died in the middle of the process, e.g. at run 2, 8, 13, > ... When I rerun the mert-mose with "--continue", normally it runs fine. > Maybe someone could help enlighten me on what could possible cause the > problem? I ofter run multiple mert-moses at the same time on around 4-6 > corpora, so I'm not sure whether the problem below is due to the machine > resource being overloaded. (I attached the system "top" information here as > well). > > The error message, I normally encounter is: > sh: line 1: 12100 Segmentation fault > /home/lmthang/HYP/src/moses/moses-cmd/src/moses -config filtered/moses.ini > -inputtype 0 -w -0.687588 -lm 0.009388 -d 0.039359 0.083356 0.000572 > -0.007485 0.003778 -0.023522 -0.046637 -tm -0.005330 0.024834 0.064540 > 0.000418 0.003193 -n-best-list run2.best100.out 100 -i > /mnt/homes/lmthang/HYP/scripts/acl05_full_10/w-m_100/acl05_full.dev.processed.en >> run2.out > Exit code: 139 > The decoder died. at > /home/lmthang/HYP/bin_02_June_08/moses-scripts/scripts-20080602-2352/training/mert-moses.pl > line 772. > > Sometimes, I saw the more detailed error here: > *** glibc detected *** /home/lmthang/HYP/src/moses/moses-cmd/src/moses: > free(): invalid pointer: 0x3599f890 *** > ======= Backtrace: ========= > /lib/libc.so.6[0xab3b16] > /lib/libc.so.6(cfree+0x90)[0xab7070] > /usr/lib/libstdc++.so.6(_ZdlPv+0x21)[0xf7f52151] > /home/lmthang/HYP/src/moses/moses-cmd/src/moses[0x806e977] > /home/lmthang/HYP/src/moses/moses-cmd/src/moses[0x806e965] > /home/lmthang/HYP/src/moses/moses-cmd/src/moses[0x806e965] > /home/lmthang/HYP/src/moses/moses-cmd/src/moses[0x806e965] > /home/lmthang/HYP/src/moses/moses-cmd/src/moses[0x806e965] > /home/lmthang/HYP/src/moses/moses-cmd/src/moses[0x806e965] > /home/lmthang/HYP/src/moses/moses-cmd/src/moses[0x806e965] > /home/lmthang/HYP/src/moses/moses-cmd/src/moses[0x806e965] > /home/lmthang/HYP/src/moses/moses-cmd/src/moses[0x806e965] > /home/lmthang/HYP/src/moses/moses-cmd/src/moses[0x806e965] > /home/lmthang/HYP/src/moses/moses-cmd/src/moses[0x806e965] > /home/lmthang/HYP/src/moses/moses-cmd/src/moses[0x8064c43] > /home/lmthang/HYP/src/moses/moses-cmd/src/moses[0x8061850] > /home/lmthang/HYP/src/moses/moses-cmd/src/moses[0x80621b8] > /home/lmthang/HYP/src/moses/moses-cmd/src/moses[0x809eb92] > /home/lmthang/HYP/src/moses/moses-cmd/src/moses[0x8095b7a] > /lib/libc.so.6(exit+0xe9)[0xa769d9] > /lib/libc.so.6(__libc_start_main+0xe4)[0xa60df4] > /home/lmthang/HYP/src/moses/moses-cmd/src/moses(__gxx_personality_v0+0xbd)[0x804bc81] > ======= Memory map: ======== > 00a2d000-00a47000 r-xp 00000000 09:02 15171585 > /lib/ld-2.5.so > 00a47000-00a48000 r--p 00019000 09:02 15171585 > /lib/ld-2.5.so > 00a48000-00a49000 rw-p 0001a000 09:02 15171585 > /lib/ld-2.5.so > 00a4b000-00b88000 r-xp 00000000 09:02 8716308 > /lib/libc-2.5.so > 00b88000-00b8a000 r--p 0013c000 09:02 8716308 > /lib/libc-2.5.so > 00b8a000-00b8b000 rw-p 0013e000 09:02 8716308 > /lib/libc-2.5.so > 00b8b000-00b8e000 rw-p 00b8b000 00:00 0 > 00ba9000-00bce000 r-xp 00000000 09:02 8716346 > /lib/libm-2.5.so > 00bce000-00bcf000 r--p 00024000 09:02 8716346 > /lib/libm-2.5.so > 00bcf000-00bd0000 rw-p 00025000 09:02 8716346 > /lib/libm-2.5.so > 00cd2000-00cdd000 r-xp 00000000 09:02 8717060 > /lib/libgcc_s-4.1.2-20080102.so.1 > 00cdd000-00cde000 rw-p 0000a000 09:02 8717060 > /lib/libgcc_s-4.1.2-20080102.so.1 > 00d12000-00d24000 r-xp 00000000 09:02 10961094 > /usr/lib/libz.so.1.2.3 > 00d24000-00d25000 rw-p 00011000 09:02 10961094 > /usr/lib/libz.so.1.2.3 > 08048000-08114000 r-xp 00000000 00:15 105283593 > /mnt/homes/lmthang/HYP/src/moses/moses-cmd/src/moses > 08114000-08115000 rw-p 000cb000 00:15 105283593 > /mnt/homes/lmthang/HYP/src/moses/moses-cmd/src/moses > 08115000-085ac000 rw-p 08115000 00:00 0 > 095db000-e57c7000 rw-p 095db000 00:00 0 > f7d00000-f7d21000 rw-p f7d00000 00:00 0 > f7d21000-f7e00000 ---p f7d21000 00:00 0 > f7e9f000-f7ea1000 rw-p f7e9f000 00:00 0 > f7ea1000-f7f7f000 r-xp 00000000 09:02 10965054 > /usr/lib/libstdc++.so.6.0.8 > f7f7f000-f7f82000 r--p 000dd000 09:02 10965054 > /usr/lib/libstdc++.so.6.0.8 > f7f82000-f7f84000 rw-p 000e0000 09:02 10965054 > /usr/lib/libstdc++.so.6.0.8 > f7f84000-f7f8a000 rw-p f7f84000 00:00 0 > f7f9f000-f7fa1000 rw-p f7f9f000 00:00 0 > ffe9d000-ffea1000 rw-p ffe9d000 00:00 0 > [stack] > ffffe000-fffff000 r-xp ffffe000 00:00 0 > sh: line 1: 11579 Aborted > /home/lmthang/HYP/src/moses/moses-cmd/src/moses -config filtered/moses.ini > -inputtype 0 -w -0.427595 -lm 0.010922 -d 0.099354 0.032944 -0.001238 > -0.170074 0.041642 0.081615 -0.033839 -tm 0.003272 0.025515 0.030671 > 0.029248 -0.012071 -n-best-list run2.best100.out 100 -i > /mnt/homes/lmthang/HYP/scripts/acl05_full_10/w-m_10/acl05_full.dev.processed.en >> run2.out > Exit code: 134 > The decoder died. at > /home/lmthang/HYP/bin_02_June_08/moses-scripts/scripts-20080602-2352/training/mert-moses.pl > line 772. > > Thank you, > > Regards, > Thang > > > -- > Luong Minh Thang > WING group, School of Computing, National University of Singapore > http://wing.comp.nus.edu.sg/~lmthang > > _______________________________________________ > Moses-support mailing list > [email protected] > http://mailman.mit.edu/mailman/listinfo/moses-support > > _______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
