ACL 2016 FIRST CONFERENCE ON MACHINE TRANSLATION (WMT16)
Shared Tasks on translation, evaluation, automated post-editing and
document alignment.
August 2016, in conjunction with ACL 2016 in Berlin, Germany
http://www.statmt.org/wmt16
As part of WMT, as in previous years, we will be organising a collection
of shared tasks related to machine translation. We hope that both
beginners and established research groups will participate. This year we
are pleased to present the following 10 tasks:
- Translation tasks
- News
- IT-domain
- Biomedical
- Multimodal
- Pronoun
- Evaluation tasks
- Metrics
- Quality estimation
- Tuning
- Other tasks
- Automatic post-editing
- Bilingual document alignment
Further information, including task rationale, timetables and data will
be posted on the WMT16 website, and fully announced in January. Brief
descriptions of each task are given below. Intending participants are
encouraged to register with the mailing list for further announcements
(https://groups.google.com/forum/#!forum/wmt-tasks)
For all tasks, participants will also be invited to submit a short
paper describing their system.
News Translation Task
-----------------------------
This is the translation task run at most of the past WMT editions. This
year the language pairs will be English to/from Czech, Finnish, German,
Romanian, Russian and Turkish. Sponsorship for the task comes from the
EU H2020 projects QT21 and Cracker, Yandex and the University of Helsinki.
IT Domain Translation Task
---------------------
This guest task will involve translation of queries and their responses,
on the topic of information technology. It will cover English to/from
Bulgarian, Czech, German, Spanish, Basque, Dutch and Portugese, and be
sponsored by the EU FP7 project QTLeap.
Biomedical Translation Task
-------------------------------------
This guest task will focus on the translation of biomedical research
abstracts from English to and from Spanish, Portuguese and French.
Multimodal Translation Task
-------------------------------------
This task will aim at generating image descriptions in a target
language, given equivalent descriptions in one or more languages. The
dataset will consist of 30,000 image--description tuples in three
languages -- English, German and French.
Pronoun Translation Task
---------------------------------
This will be similar to the task run last year as part of the DiscoMT
workshop (https://www.idiap.ch/workshop/DiscoMT/shared-task)
Metrics
----------
The idea here is that participants propose evaluation metrics for
machine translation, which compare the MT output against a reference.
The metrics will be correlated against the human judgements produced in
the news translation task. This task is sponsored by QT21.
Quality Estimation
-------------------------
This consists of several sub-tasks, all of which are concerned with the
idea of assessing the quality of MT output without using a reference, at
different levels of granularity: word, phrase, sentence and document.
This task is sponsored by QT21.
Tuning
---------
Participants in this task are asked to come up with algorithms and
objectives (i.e. metrics) for tuning the parameters of a given MT system.
Automatic Post-editing
-------------------------------
In this task participants will aim to create systems that can
automatically correct machine translation outputs, given a corpus of
human post-edits. This task is sponsored by QT21.
Bilingual document alignment
----------------------------------------
The aim is to find translated document pairs from a large collection of
documents in two languages.
Best wishes
Barry Haddow
(On behalf of the organisers)
The University of Edinburgh is a charitable body, registered in
Scotland, with registration number SC005336.
_______________________________________________
Mt-list site list
[email protected]
http://lists.eamt.org/mailman/listinfo/mt-list
