Hi Henry,
please make sure the format of your command input in your terminal. I noted
that in your command there was no space in the "-tttble" parameter.
In the reference manual, -ttable int int string -- translation table file, use
'-' for stdin,
so, there is one space between the two "-", please try the following command:
cat phrase-table | sort |
/home/aaa/moses/mosesdecoder/dist/bin/processPhraseTable -ttable 0 0- -nscores
5 -out phrase-table
Of cource, If your data is encoded in UTF8, make sure you set the environment
variable with the export LC_ALL=C before sorting.
------------------------------------------------------------------------------------------------------------------------------------
Name: Liang Tian (田亮)
Lab: Natural Language Processing& Portuguese Chinese Machine Translation
Laboratory
(澳门大学中葡机器翻译实验室NLP2CT)
Email: [email protected]
Phone: (853)62059782
(+86)18676421801
------------------------------------------------------------------------------------------------------------------------------------
________________________________
发件人： Henry Hu <[email protected]>
收件人： [email protected]
发送日期： 2012年5月15日, 星期二, 下午 2:37
主题: [Moses-support] Can't binary phrase table
Hi folks,
I followed the guide:
http://www.statmt.org/moses/?n=Moses.AdvancedFeatures#ntoc3
My phrase-table is about 4G size and the machine I'm using has 8G RAM.
But after running about 5 minutes, the command broke:
$ cat phrase-table | sort |
/home/aaa/moses/mosesdecoder/dist/bin/processPhraseTable -ttable 0 0 -
-nscores 5 -out phrase-table
processing ptree for stdin
ERROR: xsource phrase already inserted (B)!
line(8): '000 ||| 000 - ||| 0.142857 0.82872 0.000498008 0.00133883
2.718 ||| ||| 7 2008'
f: 1 0
Aborted
I have no idea how to fix it. Thanks for any suggestion.
Best Regards,
Henry
_______________________________________________
Moses-support mailing list
[email protected]
http://mailman.mit.edu/mailman/listinfo/moses-support
_______________________________________________
Moses-support mailing list
[email protected]
http://mailman.mit.edu/mailman/listinfo/moses-support
