John Morgan wrote: > One more question: > To get the individual 1, 2, 3, and 4 -gram scores you divide by a > total number of corresponding ngrams. > From reading the multi-bleu.perl code the total comes from ngrams in > the hypothesis (I think). > Do you want the total to come from the references or the hypothesis?
BLEU is a precision score, so it comes from the hypothesis. - John Burger MITRE > On 2/22/11, Loïc BARRAULT <[email protected]> wrote: >> Hi John, >> >> yes this is what we want. Consider the following : >> REF : the the the the >> HYP : the >> Choosing the max would give 4 unigram matches instead of only 1. >> >> Cheers, >> >> Loïc >> >> Le 22/02/11 01:44, John Morgan a écrit : >>> Sorry for the empty message. >>> The attached file has a segment of code that I think is choosing the >>> minimum ngram match count. >>> Is this what you want for BLEU? >>> Don't you want the max? >>> Thanks, >>> John >>> >>> >>> >>> >>> _______________________________________________ >>> Moses-support mailing list >>> [email protected] >>> http://mailman.mit.edu/mailman/listinfo/moses-support >> >> -- >> Loïc BARRAULT >> LIUM - Equipe LST >> Université du Maine >> >> > > > -- > Regards, > John J Morgan > > _______________________________________________ > Moses-support mailing list > [email protected] > http://mailman.mit.edu/mailman/listinfo/moses-support _______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
