Hi, it's very hard to say if this is a good score. For comparison, this is a score in the neighborhood of what many participants received in the WMT08 evaluation on the Hungarian <-> English task.
The sgm format is best described on the NIST web pages (who supply the most commonly used BLEU scoring tool). It wraps up every sentence in a <seg> tag and documents into <doc> tags and then the whole file as either <tstset>, <refset>, or <srcset>. It's not all that complicated. -phi On Mon, Nov 24, 2008 at 3:33 PM, Nirav <[EMAIL PROTECTED]> wrote: > Hi, > > I tried the steps given in moses step by step guide but was not able to > figure out how to generate or get devtest2006-ref.en.sgm file. Also i > found one link in which they used > > multi-bleu.perl and i found following result > BLEU = 9.88, 45.5/15.0/5.9/2.5 (BP=0.983, ration=0.983) > > I do not know how to interpret this and is this a good score? Also please help > me in how to get the above "sgm" file or how can i make it for my own regional > > language (Hindi). > > -- > > Nirav Shah > > _______________________________________________ > Moses-support mailing list > [email protected] > http://mailman.mit.edu/mailman/listinfo/moses-support > >
_______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
