Hi all,
I'm using a system with current CentOS 7, Boost 1.60.0 and moses from
git master (SHA: 42b8b89d54a5c670f02a16426a92cc1d0fb97754).
While playing with basic hierarchical models I found the following
(probably buggy) behaviour:
1.) INITIALIZE ...
% wget "http://www.statmt.org/moses/download/sample-models.tgz"; && tar
xfz sample-models.tgz && cd sample-models
2.) TRANSLATE WITHOUT SERVER ... (ok)
% echo 'dies ist ein haus' | moses -f string-to-tree/moses.ini
Defined parameters (per moses.ini or switch):
config: string-to-tree/moses.ini
cube-pruning-pop-limit: 1000
feature: KENLM name=LM factor=0 order=3 num-features=1
path=lm/europarl.srilm.gz WordPenalty UnknownWordPenalty
PhraseDictionaryMemory input-factor=0 output-factor=0
path=string-to-tree/rule-table num-features=1 table-limit=20
input-factors: 0
inputtype: 3
mapping: 0 T 0
max-chart-span: 20 1000
non-terminals: X S
search-algorithm: 3
translation-details: translation-details.log
weight: WordPenalty0= 0 LM= 0.5 PhraseDictionaryMemory0= 0.5
line=KENLM name=LM factor=0 order=3 num-features=1
path=lm/europarl.srilm.gz
Loading the LM will be faster if you build a binary file.
Reading lm/europarl.srilm.gz
----5---10---15---20---25---30---35---40---45---50---55---60---65---70---75---80---85---90---95--100
**The ARPA file is missing <unk>. Substituting log10 probability
-100.000.
**************************************************************************************************
FeatureFunction: LM start: 0 end: 0
line=WordPenalty
FeatureFunction: WordPenalty0 start: 1 end: 1
line=UnknownWordPenalty
FeatureFunction: UnknownWordPenalty0 start: 2 end: 2
line=PhraseDictionaryMemory input-factor=0 output-factor=0
path=string-to-tree/rule-table num-features=1 table-limit=20
FeatureFunction: PhraseDictionaryMemory0 start: 3 end: 3
Loading LM
Loading WordPenalty0
Loading UnknownWordPenalty0
Loading PhraseDictionaryMemory0
Start loading text phrase table. Moses format : [0.795] seconds
Reading string-to-tree/rule-table
----5---10---15---20---25---30---35---40---45---50---55---60---65---70---75---80---85---90---95--100
****************************************************************************************************
max-chart-span: 20
Created input-output object : [0.796] seconds
Line 0: Initialize search took 0.000 seconds total
Translating: <s> das ist ein haus </s> ||| [0,0]=X (1) [0,1]=X (1)
[0,2]=X (1) [0,3]=X (1) [0,4]=X (1) [0,5]=X (1) [1,1]=X (1) [1,2]=X
(1) [1,3]=X (1) [1,4]=X (1) [1,5]=X (1) [2,2]=X (1) [2,3]=X (1)
[2,4]=X (1) [2,5]=X (1) [3,3]=X (1) [3,4]=X (1) [3,5]=X (1) [4,4]=X
(1) [4,5]=X (1) [5,5]=X (1)
0 1 2 3 4 5
0 3 2 2 1 0
0 0 0 2 0
0 0 4 0
0 8 0
0 0
1
BEST TRANSLATION: 31 TOP -> <s> S </s> :1-1 : term=: nonterm=1-1 :
c=-3.206 core=(-6.413,-2.000,0.000,0.000) [0..5] 15 [total=-12.332]
core=(-22.361,-6.000,0.000,-2.303)
this is a house
Line 0: Additional reporting took 0.000 seconds total
Line 0: Translation took 0.001 seconds total
Translation took 0.010 seconds
Name:moses VmPeak:79168 kB VmRSS:7392 kB RSSMax:35916 kB
user:0.783 sys:0.022 CPU:0.805 real:0.799
3.) SET UP XMLRPC FILE ...
% echo '<?xml version="1.0" encoding="UTF-8"?>
<methodCall>
<methodName>translate</methodName>
<params><param><value>
<struct>
<member>
<name>text</name>
<value>
<string>dies ist ein haus .</string>
</value>
</member>
</struct></value></param>
</params>
</methodCall>
' > rpc.xml
4.) START MOSES SERVER ...
% moses --server --config string-to-tree/moses.ini &
Defined parameters (per moses.ini or switch):
config: string-to-tree/moses.ini
cube-pruning-pop-limit: 1000
feature: KENLM name=LM factor=0 order=3 num-features=1
path=lm/europarl.srilm.gz WordPenalty UnknownWordPenalty
PhraseDictionaryMemory input-factor=0 output-factor=0
path=string-to-tree/rule-table num-features=1 table-limit=20
input-factors: 0
inputtype: 3
mapping: 0 T 0
max-chart-span: 20 1000
non-terminals: X S
search-algorithm: 3
server:
translation-details: translation-details.log
weight: WordPenalty0= 0 LM= 0.5 PhraseDictionaryMemory0= 0.5
line=KENLM name=LM factor=0 order=3 num-features=1
path=lm/europarl.srilm.gz
Loading the LM will be faster if you build a binary file.
Reading lm/europarl.srilm.gz
----5---10---15---20---25---30---35---40---45---50---55---60---65---70---75---80---85---90---95--100
**The ARPA file is missing <unk>. Substituting log10 probability
-100.000.
**************************************************************************************************
FeatureFunction: LM start: 0 end: 0
line=WordPenalty
FeatureFunction: WordPenalty0 start: 1 end: 1
line=UnknownWordPenalty
FeatureFunction: UnknownWordPenalty0 start: 2 end: 2
line=PhraseDictionaryMemory input-factor=0 output-factor=0
path=string-to-tree/rule-table num-features=1 table-limit=20
FeatureFunction: PhraseDictionaryMemory0 start: 3 end: 3
Loading LM
Loading WordPenalty0
Loading UnknownWordPenalty0
Loading PhraseDictionaryMemory0
Start loading text phrase table. Moses format : [0.817] seconds
Reading string-to-tree/rule-table
----5---10---15---20---25---30---35---40---45---50---55---60---65---70---75---80---85---90---95--100
****************************************************************************************************
max-chart-span: 20
RUN SERVER at pid 0
[moses/server/Server.cpp:49] Listening on port 8080
5.) TRANSLATE WITH SERVER ... (not ok)
% curl --data @rpc.xml '192.168.178.14:8080/RPC2'
[moses/server/TranslationRequest.cpp:317] Input: dies ist ein haus .
Translating: <s> dies ist ein haus . </s>
0 1 2 3 4 5 6
0 1 2 2 1 1 0
0 0 0 0 0 0
0 0 0 0 0
0 0 0 0
0 0 0
0 0
0
*** Segmentation fault
Register dump:
RAX: 0000000000000006 RBX: 0000000000000000 RCX: 0000000000000001
RDX: 00000000028fe000 RSI: 00007f7ae25fe5d0 RDI: 00000000025ffaa0
RBP: 00007f7ae25fe940 R8 : 00000000028fe000 R9 : 00007f7ae4d24f90
R10: 00007f7ae4d3f960 R11: 0000000000000000 R12: 0000000000000000
R13: 00007f7ae25fe5d0 R14: 0000000000000000 R15: 00000000028ec268
RSP: 00007f7ae25fe540
RIP: 0000000000571c70 EFLAGS: 00010206
CS: 0033 FS: 0000 GS: 0000
Trap: 0000000e Error: 00000004 OldMask: 00000000 CR2: 00000000
FPUCW: 0000037f FPUSW: 00000000 TAG: 00000000
RIP: 00000000 RDP: 00000000
ST(0) 0000 0000000000000000 ST(1) 0000 0000000000000000
ST(2) 0000 0000000000000000 ST(3) 0000 0000000000000000
ST(4) 0000 0000000000000000 ST(5) 0000 0000000000000000
ST(6) 0000 0000000000000000 ST(7) 0000 0000000000000000
mxcsr: 1fa4
XMM0: 000000000000000000000000ff0000ff XMM1:
000000000000000000000000ff0000ff
XMM2: 000000000000000000000000ff0000ff XMM3:
000000000000000000000000ff0000ff
XMM4: 000000000000000000000000ff0000ff XMM5:
000000000000000000000000ff0000ff
XMM6: 000000000000000000000000ff0000ff XMM7:
000000000000000000000000ff0000ff
XMM8: 000000000000000000000000ff0000ff XMM9:
000000000000000000000000ff0000ff
XMM10: 000000000000000000000000ff0000ff XMM11:
000000000000000000000000ff0000ff
XMM12: 000000000000000000000000ff0000ff XMM13:
000000000000000000000000ff0000ff
XMM14: 000000000000000000000000ff0000ff XMM15:
000000000000000000000000ff0000ff
Backtrace:
/home/maba/bin/moses[0x571c70]
/home/maba/bin/moses[0x503c48]
/home/maba/bin/moses[0x504031]
/home/maba/bin/moses[0x501a21]
/home/maba/bin/moses[0x564309]
/home/maba/bin/moses[0x7deec9]
/usr/lib64/libpthread.so.0(+0x7dc5)[0x7f7ae430cdc5]
/usr/lib64/libc.so.6(clone+0x6d)[0x7f7ae403a21d]
Memory map:
00400000-00945000 r-xp 00000000 fd:02
5162546 /home/maba/bin/moses
00b45000-00b46000 r--p 00545000 fd:02
5162546 /home/maba/bin/moses
00b46000-00b48000 rw-p 00546000 fd:02
5162546 /home/maba/bin/moses
00b48000-00b4d000 rw-p 00000000 00:00 0
01df3000-02bf6000 rw-p 00000000 00:00
0 [heap]
7f7adadf1000-7f7adadf2000 ---p 00000000 00:00 0
7f7adadf2000-7f7adb5f2000 rw-p 00000000 00:00
0 [stack:34973]
7f7adb5f2000-7f7adb5f3000 ---p 00000000 00:00 0
7f7adb5f3000-7f7adbdf3000 rw-p 00000000 00:00
0 [stack:34972]
7f7adbdf3000-7f7adbdf4000 ---p 00000000 00:00 0
7f7adbdf4000-7f7adc5f4000 rw-p 00000000 00:00
0 [stack:34971]
7f7adc5f4000-7f7adc5f5000 ---p 00000000 00:00 0
7f7adc5f5000-7f7adcdf5000 rw-p 00000000 00:00
0 [stack:34970]
7f7adcdf5000-7f7adcdf6000 ---p 00000000 00:00 0
7f7adcdf6000-7f7add5f6000 rw-p 00000000 00:00
0 [stack:34969]
7f7add5f6000-7f7add5f7000 ---p 00000000 00:00 0
7f7add5f7000-7f7adddf7000 rw-p 00000000 00:00
0 [stack:34968]
7f7adddf7000-7f7adddf8000 ---p 00000000 00:00 0
7f7adddf8000-7f7ade5f8000 rw-p 00000000 00:00
0 [stack:34967]
7f7ade5f8000-7f7ade5f9000 ---p 00000000 00:00 0
7f7ade5f9000-7f7adedf9000 rw-p 00000000 00:00
0 [stack:34966]
7f7adedf9000-7f7adedfa000 ---p 00000000 00:00 0
7f7adedfa000-7f7adf5fa000 rw-p 00000000 00:00
0 [stack:34965]
7f7adf5fa000-7f7adf5fb000 ---p 00000000 00:00 0
7f7adf5fb000-7f7adfdfb000 rw-p 00000000 00:00
0 [stack:34964]
7f7adfdfb000-7f7adfdfc000 ---p 00000000 00:00 0
7f7adfdfc000-7f7ae05fc000 rw-p 00000000 00:00
0 [stack:34963]
7f7ae05fc000-7f7ae05fd000 ---p 00000000 00:00 0
7f7ae05fd000-7f7ae0dfd000 rw-p 00000000 00:00
0 [stack:34962]
7f7ae0dfd000-7f7ae0dfe000 ---p 00000000 00:00 0
7f7ae0dfe000-7f7ae15fe000 rw-p 00000000 00:00
0 [stack:34961]
7f7ae15fe000-7f7ae15ff000 ---p 00000000 00:00 0
7f7ae15ff000-7f7ae1dff000 rw-p 00000000 00:00
0 [stack:34960]
7f7ae1dff000-7f7ae1e00000 ---p 00000000 00:00 0
7f7ae1e00000-7f7ae2600000 rw-p 00000000 00:00
0 [stack:34959]
7f7ae2600000-7f7ae3f2d000 rw-p 00000000 00:00 0
7f7ae3f44000-7f7ae40fa000 r-xp 00000000 fd:01
201327759 /usr/lib64/libc-2.17.so
7f7ae40fa000-7f7ae42fa000 ---p 001b6000 fd:01
201327759 /usr/lib64/libc-2.17.so
7f7ae42fa000-7f7ae42fe000 r--p 001b6000 fd:01
201327759 /usr/lib64/libc-2.17.so
7f7ae42fe000-7f7ae4300000 rw-p 001ba000 fd:01
201327759 /usr/lib64/libc-2.17.so
7f7ae4300000-7f7ae4305000 rw-p 00000000 00:00 0
7f7ae4305000-7f7ae431b000 r-xp 00000000 fd:01
202647953 /usr/lib64/libpthread-2.17.so
7f7ae431b000-7f7ae451b000 ---p 00016000 fd:01
202647953 /usr/lib64/libpthread-2.17.so
7f7ae451b000-7f7ae451c000 r--p 00016000 fd:01
202647953 /usr/lib64/libpthread-2.17.so
7f7ae451c000-7f7ae451d000 rw-p 00017000 fd:01
202647953 /usr/lib64/libpthread-2.17.so
7f7ae451d000-7f7ae4521000 rw-p 00000000 00:00 0
7f7ae4521000-7f7ae4536000 r-xp 00000000 fd:01 219147257
/usr/lib64/libgcc_s-4.8.5-20150702.so.1
7f7ae4536000-7f7ae4735000 ---p 00015000 fd:01 219147257
/usr/lib64/libgcc_s-4.8.5-20150702.so.1
7f7ae4735000-7f7ae4736000 r--p 00014000 fd:01 219147257
/usr/lib64/libgcc_s-4.8.5-20150702.so.1
7f7ae4736000-7f7ae4737000 rw-p 00015000 fd:01 219147257
/usr/lib64/libgcc_s-4.8.5-20150702.so.1
7f7ae4737000-7f7ae4838000 r-xp 00000000 fd:01
201328059 /usr/lib64/libm-2.17.so
7f7ae4838000-7f7ae4a37000 ---p 00101000 fd:01
201328059 /usr/lib64/libm-2.17.so
7f7ae4a37000-7f7ae4a38000 r--p 00100000 fd:01
201328059 /usr/lib64/libm-2.17.so
7f7ae4a38000-7f7ae4a39000 rw-p 00101000 fd:01
201328059 /usr/lib64/libm-2.17.so
7f7ae4a39000-7f7ae4b22000 r-xp 00000000 fd:01
201328136 /usr/lib64/libstdc++.so.6.0.19
7f7ae4b22000-7f7ae4d22000 ---p 000e9000 fd:01
201328136 /usr/lib64/libstdc++.so.6.0.19
7f7ae4d22000-7f7ae4d2a000 r--p 000e9000 fd:01
201328136 /usr/lib64/libstdc++.so.6.0.19
7f7ae4d2a000-7f7ae4d2c000 rw-p 000f1000 fd:01
201328136 /usr/lib64/libstdc++.so.6.0.19
7f7ae4d2c000-7f7ae4d41000 rw-p 00000000 00:00 0
7f7ae4d41000-7f7ae4d48000 r-xp 00000000 fd:01
202647957 /usr/lib64/librt-2.17.so
7f7ae4d48000-7f7ae4f47000 ---p 00007000 fd:01
202647957 /usr/lib64/librt-2.17.so
7f7ae4f47000-7f7ae4f48000 r--p 00006000 fd:01
202647957 /usr/lib64/librt-2.17.so
7f7ae4f48000-7f7ae4f49000 rw-p 00007000 fd:01
202647957 /usr/lib64/librt-2.17.so
7f7ae4f49000-7f7ae4f4d000 r-xp 00000000 fd:01
201327752 /usr/lib64/libSegFault.so
7f7ae4f4d000-7f7ae514c000 ---p 00004000 fd:01
201327752 /usr/lib64/libSegFault.so
7f7ae514c000-7f7ae514d000 r--p 00003000 fd:01
201327752 /usr/lib64/libSegFault.so
7f7ae514d000-7f7ae514e000 rw-p 00004000 fd:01
201327752 /usr/lib64/libSegFault.so
7f7ae514e000-7f7ae5174000 r-xp 00000000 fd:01 202808298
/usr/lib64/libtcmalloc_minimal.so.4.2.6
7f7ae5174000-7f7ae5374000 ---p 00026000 fd:01 202808298
/usr/lib64/libtcmalloc_minimal.so.4.2.6
7f7ae5374000-7f7ae5375000 r--p 00026000 fd:01 202808298
/usr/lib64/libtcmalloc_minimal.so.4.2.6
7f7ae5375000-7f7ae5376000 rw-p 00027000 fd:01 202808298
/usr/lib64/libtcmalloc_minimal.so.4.2.6
7f7ae5376000-7f7ae539c000 rw-p 00000000 00:00 0
7f7ae539c000-7f7ae53ab000 r-xp 00000000 fd:01
201360080 /usr/lib64/libbz2.so.1.0.6
7f7ae53ab000-7f7ae55aa000 ---p 0000f000 fd:01
201360080 /usr/lib64/libbz2.so.1.0.6
7f7ae55aa000-7f7ae55ab000 r--p 0000e000 fd:01
201360080 /usr/lib64/libbz2.so.1.0.6
7f7ae55ab000-7f7ae55ac000 rw-p 0000f000 fd:01
201360080 /usr/lib64/libbz2.so.1.0.6
7f7ae55ac000-7f7ae55c1000 r-xp 00000000 fd:01
201327745 /usr/lib64/libz.so.1.2.7
7f7ae55c1000-7f7ae57c0000 ---p 00015000 fd:01
201327745 /usr/lib64/libz.so.1.2.7
7f7ae57c0000-7f7ae57c1000 r--p 00014000 fd:01
201327745 /usr/lib64/libz.so.1.2.7
7f7ae57c1000-7f7ae57c2000 rw-p 00015000 fd:01
201327745 /usr/lib64/libz.so.1.2.7
7f7ae57c2000-7f7ae57e3000 r-xp 00000000 fd:01
201327775 /usr/lib64/ld-2.17.so
7f7ae59b9000-7f7ae59ba000 ---p 00000000 00:00 0
7f7ae59ba000-7f7ae59e3000 rw-p 00000000 00:00
0 [stack:36125]
7f7ae59e3000-7f7ae59e4000 r--p 00021000 fd:01
201327775 /usr/lib64/ld-2.17.so
7f7ae59e4000-7f7ae59e5000 rw-p 00022000 fd:01
201327775 /usr/lib64/ld-2.17.so
7f7ae59e5000-7f7ae59e6000 rw-p 00000000 00:00 0
7ffc55ee1000-7ffc55f03000 rw-p 00000000 00:00
0 [stack]
7ffc55fb5000-7ffc55fb7000 r-xp 00000000 00:00
0 [vdso]
ffffffffff600000-ffffffffff601000 r-xp 00000000 00:00
0 [vsyscall]
[2] 34958 segmentation fault /home/maba/bin/moses --server
--config string-to-tree/moses.ini
Any idea what's been going wrong? Thanks in advance.
Cheers,
Martin
--
*STAR Group* <http://www.star-group.net>
<http://www.star-group.net/>
*Martin Baumgärtner*
STAR Language Technology & Solutions GmbH
Umberto-Nobile-Straße 19 | 71063 Sindelfingen | Germany
Tel. +49 70 31-4 10 92-0 [email protected]
<mailto:[email protected]>
Fax +49 70 31-4 10 92-70 www.star-group.net <http://www.star-group.net/>
Geschäftsführer: Oliver Rau, Bernd Barth
Handelsregister Stuttgart HRB 245654 | St.-Nr. 56098/11677
_______________________________________________
Moses-support mailing list
[email protected]
http://mailman.mit.edu/mailman/listinfo/moses-support
