I found it useful even with these models in terms of memory usage. I remember I once filtered and binarized for hierarchical and it slightly affected the results. I made sure that filtering wasn't the cause then concluded that bizarization was.
Regards, Rasul. Quoting Hieu Hoang <[email protected]>: > When I use tree-to-string models, I didn't bother filtering. > > I just binarized the whole phrase table and run. If your server > doesn't have lots of memory, it will be slow, but it will still run > > Hieu > Sent from my flying horse > > On 3 Aug 2012, at 01:19 PM, [email protected] wrote: > >> Hi Philip, >> >> Thanks for the information. I tried filter-model-given-input.pl on >> tree-to-string and it worked. In fact, I had been previously using it >> for this model and it used to work. However, I needed to filter >> against a SAMT-relaxed input and was not sure. So, I did that, >> translated the input using the filtered table, and compared to a >> translation with original table; those were the same, then I concluded >> that it can be used for source-tree models as well. I hope I have not >> made a mistake, though! >> >> Do you have any idea on this, as you are the author of filter-rule-table.py? >> >> Best Regards, >> Rasul. >> >> Quoting Philip Williams <[email protected]>: >> >>> Hi Rasul, >>> >>> the filter-rule-table.py script can filter string-to-tree or >>> hierarchical rule tables. The filter-model-given-input.pl script >>> (with the --Hierarchical option) calls the former script to perform >>> filtering in addition to performing some extra steps that are >>> required in the standard Moses MT pipeline (such as generating a new >>> Moses config file). >>> >>> I'm assuming those are the two scripts you meant. As far as I know, >>> there aren't any scripts for filtering tree-to-string or >>> tree-to-tree tables yet... >>> >>> Phil >>> >>> >>> On 2 Aug 2012, at 11:35, [email protected] wrote: >>> >>>> Hi all, >>>> >>>> I was wondering which script is used for filtering tree-based rule >>>> tables, including hierarchical, tree-to-string, string-to-tree, and >>>> tree-to-tree. There are two filtering scripts in training scripts >>>> directory. >>>> >>>> Thanks in advance. >>>> >>>> Regards, >>>> Rasul. >>>> _______________________________________________ >>>> Moses-support mailing list >>>> [email protected] >>>> http://mailman.mit.edu/mailman/listinfo/moses-support >>> >>> >> >> >> _______________________________________________ >> Moses-support mailing list >> [email protected] >> http://mailman.mit.edu/mailman/listinfo/moses-support > _______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
