Hi everyone, Ken and I just spoke about this.
Here's a quick synopsis of our semi-recent experience at Stanford with discontinuous/gappy phrases: - Source side gaps are effectively free and don't really degrade decoding time. - Target side gaps are fine for smaller beam sizes (e.g., < 200). - When using large beams, our current implementation slows down dramatically. For example, with a stack size of 500, I think it was sometimes taking over an hour to translate some sentences. While discontinuous phrases can moderately increase the BLEU score, but we get a bigger increase by just using very large beam sizes. Dan On Sun, Nov 3, 2013 at 8:34 PM, Kenneth Heafield <[email protected]>wrote: > Hi, > > I'll throw in the anecdote that gappy phrases are currently not in > use > at Stanford. My predecessor told me that it took a lot longer and only > improved BLEU slightly on Chinese-English. But it's also possible that > something didn't get passed down correctly from Michel to my predecessor > to me. . . > > Kenneth > > On 11/03/13 14:18, Read, James C wrote: > > My understanding is that they used a similar approach as the grammar > extraction to extract the gappy phrases. Would it be a massive undertaking > to get Moses to support this? > > > > James > > ________________________________________ > > From: Barry Haddow [[email protected]] > > Sent: 30 October 2013 09:26 > > To: Read, James C > > Cc: [email protected] > > Subject: Re: [Moses-support] gappy phrases > > > > No, but it does support hiero and syntax models. > > > > On 29/10/13 22:23, Read, James C wrote: > >> Hi, > >> > >> does anybody know if Moses supports gappy phrases > http://www-nlp.stanford.edu/pubs/naacl10-discontinuous_phrases.pdf > >> > >> James > >> > >> _______________________________________________ > >> Moses-support mailing list > >> [email protected] > >> http://mailman.mit.edu/mailman/listinfo/moses-support > >> > > > > > > -- > > The University of Edinburgh is a charitable body, registered in > > Scotland, with registration number SC005336. > > > > > > _______________________________________________ > > Moses-support mailing list > > [email protected] > > http://mailman.mit.edu/mailman/listinfo/moses-support > > > _______________________________________________ > Moses-support mailing list > [email protected] > http://mailman.mit.edu/mailman/listinfo/moses-support >
_______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
