Hi, historically, there was not phrase length limit in the decoder at all, and only after I started translating sentences with more than 1000 words I noticed inefficiencies, so I added the limit. The limit is intentionally chosen wide, so that phrase tables with longer phrases are still served without the need to set just another switch.
It's worth finding out if there any speed improvements with setting the maximum phrase length to the same limit as the phrase table. Note: the decoder's phrase limit only concerns the source phrases, target phrases can be of any length. -phi On Tue, Mar 20, 2012 at 3:26 PM, Marcin Junczys-Dowmunt <[email protected]> wrote: > Hi all, > I have just notice that the default MaxPhraseLength in Moses is set to > 20, while in the training script phrases are by default limited to 7 > symbols. Isn't this a potential problem for performance? After all the > decoder will fruitlessly call CreateTranslationOptionsForRange(...) 13 > times per start position for most phrase tables ... > > Caused me a lot of headache to figure out where all that long false > positives are coming from in my hash function based index. > Best, > Marcin > > _______________________________________________ > Moses-support mailing list > [email protected] > http://mailman.mit.edu/mailman/listinfo/moses-support _______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
