As an alternative, you can score with bleu.py under the scripts/ training/cmert-0.5 directory. It does not require a source file and has options to use both NIST and IBM version of BLEU -- when I have tested it in the past it gets scores that are quite close these, provided that you have tokenized the file according to the requirements of those scripts. The interface is undocumented but looks fairly easy to to decipher from the main method at the bottom of the file. It looks like it's probably this:
> bleu.py <testfile> <reffile> If it complains about psyco, you can disable that import without any effect. Disclaimer: I am not the author of this code and make no representations about being able to track down any problems with it. Good luck. Cheers Adam On 8 Aug 2008, at 09:40, Vineet Kashyap wrote: > Hi Musa > > I did exactly what you told but got the same error again > > FATAL INPUT ERROR: no 'src_set' tag in src_file > > for some reason it is having problem with the src file > which is in hindi > > perl /home/vineet/Desktop/MOSES/mteval-v11b.pl -r > /home/vineet/Desktop/MOSES/corpus/output/test1-ref.en.sgm -t > /home/vineet/Desktop/MOSES/corpus/output/test1-tst.en.sgm -s > /home/vineet/Desktop/MOSES/corpus/output/test1-src.en.sgm -c > > i dont understand why does it need a source file i mean the comparison > will be based on just the reference and the actual output right > > Thanks > > Vineet > > > > > _______________________________________________ > Moses-support mailing list > [email protected] > http://mailman.mit.edu/mailman/listinfo/moses-support -- The University of Edinburgh is a charitable body, registered in Scotland, with registration number SC005336. _______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
