5 BLEU points !? i wish. there are small differences between moses & pharaoh which usually makes moses slightly better (less than 0.5 BLEU) for traditional phrase based decoder. i recent paper @ IWSLT compared the difference between the 2 systems http://www.cs.ust.hk/~dekai/library/WU_Dekai/ShenLoCarpuatWu_IWSLT2007.p df u can get better results by adding linguistic information, which is the reason for moses
Hieu Hoang www.hoang.co.uk/hieu -----Original Message----- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of corporalist corporalist Sent: 12 November 2007 08:58 To: [email protected] Subject: [Moses-support] About the comparison between Pharaoh and Moses. Hi, guys, Anyone have ever done some comparison between Pharaoh and Moses in open data set? I wonder how much difference is reasonable. I have tried a comparison experiment on NIST05 Chinese-English test using FBIS. My results showed that Moses can outperform Pharaoh by 5 Bleu score. Is this difference reasonable? Anyone did similar comaparison pls kindly tell me your results. -fei _______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
