Hi all,
I wanna filter the rule-table and pick up the better rules, I follow the
instructions on moses webpage:
http://www.statmt.org/moses/?n=Moses.AdvancedFeatures#ntoc19
but the bin file filter-pt doesn't work at all for hierarchical model:
$zcat data/rule-table.gz | bin/filter-pt -h -e data/corpus.en -f
data/corpus.ch -l a+e -n 5 > rule-table.pruned
bin/filter-pt: invalid option -- h
Filter phrase table using significance testing as described
in H. Johnson, et al. (2007) Improving Translation Quality
by Discarding Most of the Phrasetable. EMNLP 2007.
Usage:
filter-pt -e english.suf-arr -f french.suf-arr
[-c] [-p] [-l threshold] [-n num] < PHRASE-TABLE > FILTERED-PHRASE-TABLE
[-l threshold] >0.0, a+e, or a-e: keep values that have a -log significance
> this
[-n num ] 0, 1...: 0=no filtering, >0 sort by P(e|f) and keep the top
num elements
[-c ] add the cooccurence counts to the phrase table
[-p ] add -log(significance) to the phrasetable
It seems that the -h option doesn't work !_______________________________________________
Moses-support mailing list
[email protected]
http://mailman.mit.edu/mailman/listinfo/moses-support
