Hi, Moses has an implementation of modified Moore-Lewis filtering which may be roughly what you want: http://www.statmt.org/moses/?n=Moses.AdvancedFeatures#ntoc66
-phi On Thu, Jan 16, 2014 at 10:43 AM, Saeed Farzi <[email protected]> wrote: > Dear all, > > I am working on a translation task with a very large parallel corpus. > Because of computational cost of training such a parallel corpus, i am > going to filter it regarding to the test set ( of course , by the > filtering, the evaluation must be still fair). > > I am looking for a solution or a tool for filtering parallel corpus > sentences. > > Note that i do not need to filter phrase table. I know that the > filter_ moses tool reduces the phrase table size. > > cheers > -- > S.Farzi, Ph.D. Student > Natural Language Processing Lab, > School of Electrical and Computer Eng., > Tehran University > Tel: +9821-6111-9719 > _______________________________________________ > Moses-support mailing list > [email protected] > http://mailman.mit.edu/mailman/listinfo/moses-support _______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
