Thanks a lot for helping. Best regards, Kaveh
On Mon, Oct 3, 2011 at 2:33 PM, Philipp Koehn <[email protected]> wrote: > Hi, > > if the input is provided as a lattice, then it is not > the case that all translations have the same number > of unknown words. > > -phi > > On Mon, Oct 3, 2011 at 11:28 AM, Kaveh Taghipour > <[email protected]> wrote: > > Hi Christian, > > > > Thanks. You are right. But I think there is no need for such a penalty, > > since all candidates for a given source sentence contain the same number > of > > OOVs and so the penalty does not help at all. Do you know the reason? > > > > Cheers, > > Kaveh > > > > > > > > On Sun, Oct 2, 2011 at 9:53 PM, Christian Hardmeier <[email protected]> wrote: > >> > >> I think you're on the right track. For some reason, moses doesn't report > >> the OOV penalty feature, which adds a hardcoded penalty of -100 to the > total > >> score for each input word that was copied to the output because no > suitable > >> translation was found in the phrase table. Your test sentence probably > >> contains two unknown words that account for the -200 difference between > the > >> score you calculated and the one output by the decoder. Does that make > >> sense? > >> > >> Best, > >> Christian > >> > >> Kaveh Taghipour <[email protected]> wrote: > >> > >> >Hi, > >> > > >> >I have generated an N-best list with moses, but I do not know how to > >> > compute > >> >the final score. I tried a log-linear model but came up with a wrong > >> > number. > >> >For example: > >> > > >> >moses.ini: > >> >---------------------------------------- > >> ># distortion (reordering) weight > >> >[weight-d] > >> >0.120662 > >> > > >> ># language model weights > >> >[weight-l] > >> >0.251853 > >> > > >> ># translation model weights > >> >[weight-t] > >> >0.0675335 > >> >0.103843 > >> >0.0720954 > >> >0.00630806 > >> >0.101934 > >> > > >> ># word penalty > >> >[weight-w] > >> >-0.275771 > >> > > >> >Assuming a log-linear model, the score for the following sentence > should > >> > be > >> >*-54.076* but the decoder prints: > >> > > >> >0 ||| .... ||| d: 0 lm: -219.367 w: -6 tm: -3.17999 -4.43847 -2.63049 > >> >-3.87513 3.99959 ||| *-254.076* > >> > > >> >Thank you in advance for helping. > >> > > >> >Cheers, > >> >Kaveh > >> > > >> >_______________________________________________ > >> >Moses-support mailing list > >> >[email protected] > >> >http://mailman.mit.edu/mailman/listinfo/moses-support > > > > > > _______________________________________________ > > Moses-support mailing list > > [email protected] > > http://mailman.mit.edu/mailman/listinfo/moses-support > > > > >
_______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
