Hi Anoop, The Moses documentation for PhraseDictionaryGroup <http://www.statmt.org/moses/?n=Advanced.Models#ntoc7> that you originally referenced is the most up-to-date description of this capability in Moses. If you're looking for something to cite, the original version of the "union" capability in Moses (arbitrary number of models, full feature set from each, and zeros when a phrase is not in a model) is described in my thesis "Machine Translation for Human Translators <https://www.cs.cmu.edu/~mdenkows/pdf/denkowski-mtht-2015.pdf>", Sections 3.4 and 3.4.1. There it's being used for a very specific application so it's described in that context rather than as a general model combination approach. If anything still isn't clear, it probably means I should expand the Moses documentation, so let me know. : )
Best, Michael On Fri, Dec 25, 2015 at 3:40 AM, Anoop (അനൂപ്) <[email protected] > wrote: > Hi Michael, > > Is there a publication/document describing the *union *option or its use > in an MT scenario? > > Regards, > Anoop. > > On Sat, Dec 19, 2015 at 3:38 AM, Michael Denkowski < > [email protected]> wrote: > >> Hi Anoop, >> >> Confirming that your reading of "union" is in fact how it works. If you >> want each phrase to be scored by all tables without having to worry about >> making sure every phrase is in every table, I you can use >> PhraseDictionaryGroup with default-average-others=true. This multiplies >> the size of the phrase feature set by the number of models, so I recommend >> running mer-moses.pl with --batch-mira. >> >> Best, >> Michael >> >> On Fri, Dec 18, 2015 at 1:08 PM, Philipp Koehn <[email protected]> wrote: >> >>> Hi, >>> >>> that sounds right. >>> >>> The "union" option is fairly new, developed by Michael Denkowski. >>> I am not aware of any empirical study of the different methods, >>> so I'd be curious to see what you find. >>> >>> -phi >>> >>> On Fri, Dec 18, 2015 at 1:35 AM, Anoop (അനൂപ്) < >>> [email protected]> wrote: >>> >>>> Hi, >>>> >>>> I am trying to understand the multiple decoding paths feature in Moses. >>>> >>>> The documentation (http://www.statmt.org/moses/?n=Advanced.Models#ntoc7) >>>> describes 3 methods: both, either and union >>>> >>>> The following is my understanding of the options. Please let me know if >>>> it is correct: >>>> >>>> >>>> - With *both* option, the constituent phrases of the target >>>> hypothesis come from both tables (since they are shared) and are scored >>>> with both the tables. >>>> - With *either* option, all the constituent phrases of a target >>>> hypothesis come from a single table, but different hypothesis can use >>>> different tables. Each hypothesis is scored using one table only. I did >>>> not >>>> understand the " additional options are collected from the other tables" >>>> bit in the documentation. >>>> - With *union* option, the constituent phrases of a target >>>> hypothesis come from different tables and are scored using scores from >>>> all >>>> the tables. Use 0 if the option doesn't appear in some table, unless the >>>> *default-average-others=true* option is used. >>>> >>>> >>>> Regards, >>>> Anoop. >>>> >>>> -- >>>> I claim to be a simple individual liable to err like any other fellow >>>> mortal. I own, however, that I have humility enough to confess my errors >>>> and to retrace my steps. >>>> >>>> http://flightsofthought.blogspot.com >>>> >>>> _______________________________________________ >>>> Moses-support mailing list >>>> [email protected] >>>> http://mailman.mit.edu/mailman/listinfo/moses-support >>>> >>>> >>> >>> _______________________________________________ >>> Moses-support mailing list >>> [email protected] >>> http://mailman.mit.edu/mailman/listinfo/moses-support >>> >>> >> > > > -- > I claim to be a simple individual liable to err like any other fellow > mortal. I own, however, that I have humility enough to confess my errors > and to retrace my steps. > > http://flightsofthought.blogspot.com >
_______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
