Hi,
slightly off-topic: I have a question concerning the evaluation practice during WMT. I have noticed that the standard NIST script mteval-v1.3a.pl (or any other versions) does not split on apostrophes for English contractions. How was this handled during the WMT? Did you use the official NIST scripts for BLEU calculation after detokenization? If yes, this would severely penalize the use of contractions over non-contracted forms (around 2-3% BLEU), is this just generally accepted? Thanks, Marcin
_______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
