Hi all, I'm trying to binary phrase table and reordering table. But alway comes to interruption after running a period of time. I got the output info:
$ export LC_ALL=C $ cat phrase-table | sort | ~/moses/mosesdecoder/dist/bin/processPhraseTable -ttable 0 0 - -nscores 5 -out phrase-table processing ptree for stdin ..................................................[phrase:500000] ..................................................[phrase:1000000] ..................................................[phrase:22000000] ..................................................[phrase:22500000] ..................................................[phrase:23000000] ................................distinct source phrases: 23324503 distinct first words of source phrases: 81381 number of phrase pairs (line count): 36816735 WARNING: there are src voc entries with no phrase translation: count 9450 There exists phrase translations for 71931 entries I have no idea what it means. There are several files produced, but I suppose the process of binary is not completed. How can I do with it? Thanks in advance. Best Regards, Henry _______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
