Thank you! Any guideline is available to add new scorer like NIST? If not kindly suggest.
On Tue, Jan 6, 2015 at 4:18 PM, Christophe Servan < [email protected]> wrote: > Hi, > As far as I know, you can use these metrics BLEU, BLEUDOC, PER, TER, CDER, > WER, METEOR. > The NIST scorer is not included but you can add it to moses if you wish to. > > Christophe > > 2015-01-06 11:35 GMT+01:00 Rajnath Patel <[email protected]>: > >> Thanks all for your quick response. >> >> Hi Christophe, >> >> Is it not possible to use any other metrics other than BLEU and TER, like >> NIST or METEOR? Please suggest. >> >> Thank you. >> >> On Tue, Jan 6, 2015 at 3:48 PM, Christophe Servan < >> [email protected]> wrote: >> >>> Hi, >>> you can use the switch --sctype with mert (and the extractor) like this: >>> >>> --sctype BLEU >>> >>> You can also specify a combination of metrics (separated with a comma): >>> >>> --sctype TER,BLEU >>> >>> specify the weights: >>> >>> --sctype TER,BLEU --scconfig weights:0.6+0.4 >>> >>> and use it within mert-moses.pl: >>> >>> --mertargs=" --sctype TER,BLEU --scconfig weights:0.6+0.4 " >>> >>> Cheers, >>> >>> Christophe >>> >>> >>> 2015-01-06 8:33 GMT+01:00 Hieu Hoang <[email protected]>: >>> >>>> I wouldn't use zmert for moses these days. It's rather old and I'm sure >>>> Moses' tuning script can use other metrics. Hopefully, someone who knows >>>> how will tell you shortly >>>> >>>> On 6 January 2015 at 12:37, HOANG Cong Duy Vu <[email protected]> >>>> wrote: >>>> >>>>> Hi, >>>>> >>>>> You can use other metrics by using ZMERT together with Moses: >>>>> *ZMERT toolkit*: http://cs.jhu.edu/~ozaidan/zmert/ >>>>> >>>>> >>>>> -- >>>>> Cheers, >>>>> Vu >>>>> >>>>> On Tue, Jan 6, 2015 at 12:35 PM, Rajnath Patel <[email protected] >>>>> > wrote: >>>>> >>>>>> Hi All, >>>>>> As we know, MOSES uses BLEU for evaluation in tuning process . We >>>>>> want to use evaluation metrics NIST instead of BLEU. Please suggest how >>>>>> it >>>>>> can be done? >>>>>> >>>>>> Thank you. >>>>>> >>>>>> -- >>>>>> Regards: >>>>>> Raj Nath Patel >>>>>> >>>>>> >>>>>> _______________________________________________ >>>>>> Moses-support mailing list >>>>>> [email protected] >>>>>> http://mailman.mit.edu/mailman/listinfo/moses-support >>>>>> >>>>>> >>>>> >>>>> _______________________________________________ >>>>> Moses-support mailing list >>>>> [email protected] >>>>> http://mailman.mit.edu/mailman/listinfo/moses-support >>>>> >>>>> >>>> >>>> >>>> -- >>>> Hieu Hoang >>>> Research Associate >>>> University of Edinburgh >>>> http://www.hoang.co.uk/hieu >>>> >>>> >>>> _______________________________________________ >>>> Moses-support mailing list >>>> [email protected] >>>> http://mailman.mit.edu/mailman/listinfo/moses-support >>>> >>>> >>> >> >> >> -- >> Regards: >> Raj Nath Patel >> >> > -- Regards: Raj Nath Patel
_______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
