Dear MT Community, We are pleased to announce the next NIST Open Machine Translation evaluation, OpenMT14. Continuing the tradition of investigating the limits of translation technologies and measurement techniques, OpenMT14 will focus on system performance on informal data genres and explore common MT measurement methods on these data types. Highlights of OpenMT14 include:
* Evaluation on informal data genres (SMS/Chat, Conversational Telephone Speech) for Arabic-to-English and Chinese-to-English, * Inclusion of audio input track, and * Explore common MT measurement techniques on these informal data genres. Schedule (Tentative): * February 1, 2014: Initial draft evaluation plan available * February 1 - April 30, 2014: Registration period * February - April, 2014: Training data available from LDC with incremental releases of new data until the end of April 2014 * TBD: Dry run period * May 12 - 16, 2014: Main evaluation period for audio track; output due at NIST May 16, 11.59am ET * May 19 - 23, 2014: Main evaluation period for text track; output due at NIST May 23, 11.59am ET * May 28 - June 18, 2014: Human assessment period * July, 2014: Workshop in the Washington DC area Updates will be posted to the OpenMT14 website http://www.nist.gov/itl/iad/mig/openmt14.cfm If you have any questions or comments, please email us at [email protected]<mailto:[email protected]>. Feel free to pass this on to those who may be interested. Best Regards, Audrey -- Audrey Tong NIST Multimodal Information Group 100 Bureau Drive, Stop 8940 Gaithersburg, MD 20899 U.S.A. Tel: 301-975-6091 Fax: 301-670-0939
_______________________________________________ Mt-list site list [email protected] http://lists.eamt.org/mailman/listinfo/mt-list
