Hi, filtering was original introduced as a necessity to deal with memory usage of the translation model. Since then, the language models have become bigger and the data structures to store the translation model more compact, so it may not be a useful step anymore.
There may be a bit of a speed effect, especially during startup, but it is mainly done for memory size. -phi On Mon, Oct 10, 2016 at 11:41 PM, Nat Gillin <nat.gil...@gmail.com> wrote: > Dear Moses community, > > I have a question regarding filtered and non-filtered translation models, > is it a common methodology to always filter the models prior to testing? > > Is it right that the filtering is to reduce the phrase-table and > reordering table size such that decoding is faster? Given the appropriate > beam size and more computing power the same accuracy (BLEU or otherwise) > can also be achieved without a filtering? > > Regards, > Nat > > _______________________________________________ > Moses-support mailing list > Moses-support@mit.edu > http://mailman.mit.edu/mailman/listinfo/moses-support > >
_______________________________________________ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support
