Re: [Moses-support] prune phrase table

2015-10-02 Thread Barry Haddow
And there's prunePhraseTable, which prunes according to weighted TM score (as Moses does at runtime). Some day there will be one pruner to rule them all ... On 02/10/15 18:39, Philipp Koehn wrote: Hi, there is also scripts/training/threshold-filter.perl which filters out phrase pairs based on

Re: [Moses-support] prune phrase table

2015-10-02 Thread Philipp Koehn
Hi, there is also scripts/training/threshold-filter.perl which filters out phrase pairs based on minimum scores - which is not quite what you want but similar enough. There is also the corresponding remove-orphan-phrase-pairs-from-reordering-table.perl which removes phrase pairs from the reorderi

[Moses-support] prune phrase table

2015-10-02 Thread Hieu Hoang
I can't remember, but is there a script that prune the pt, keeping just the best x rules, according to p(t|s) ? Hieu Hoang http://www.hoang.co.uk/hieu ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-supp

Re: [Moses-support] prune phrase table

2015-10-02 Thread Marcin Junczys-Dowmunt
You can use filter-pt from contrib/sigtestfilter without the suffix arrays, needs SALM to compile though. When you only specifg -n 100 it will prune according to p(t|s) W dniu 2015-10-02 17:35, Hieu Hoang napisaƂ(a): > I can't remember, but is there a script that prune the pt, keeping just t

Re: [Moses-support] prune phrase table

2015-10-02 Thread DUGAST, LOIC
: [Moses-support] prune phrase table I can't remember, but is there a script that prune the pt, keeping just the best x rules, according to p(t|s) ? Hieu Hoang http://www.hoang.co.uk/hieu ___ Moses-support mailing list Moses-support@mit.edu