Hi, while the original BLEU paper mentions co-efficients, there are not used (i.e., all are set to 1/4).
There have efforts to create tunable metrics, but these are not widely used. -phi On Mon, Feb 2, 2015 at 4:34 AM, Mikel L. Forcada <[email protected]> wrote: > Dear list, > > the correlation of BLEU with manual measurements of quality has > extensively been studied (Callison-Burch et al., WMT "Findings" paper). > But, would anyone know of any paper where people have actually tuned the > BLEU coefficients to approximate some kind of manual measurement of > quality? This is hard to search for as most papers talk about tuning the > coefficients of something else to BLEU. > > Thanks a million! > > All the best, > > Mikel > > -- > Mikel L. Forcada (http://www.dlsi.ua.es/~mlf/) > Departament de Llenguatges i Sistemes InformĂ tics > Universitat d'Alacant > E-03071 Alacant, Spain > Phone: +34 96 590 9776 > Fax: +34 96 590 9326 > > _______________________________________________ > Moses-support mailing list > [email protected] > http://mailman.mit.edu/mailman/listinfo/moses-support _______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
