We invite you to participate in the MT task as a part of the Covid-19 MLIA
@ Eval.
The goal is to organize a community evaluation effort aimed at accelerating
the creation of resources and tools for improved MultiLingual Information
Access (MLIA) in the current emergency situation.
Covid-19 MLIA @ Eval adopts an incremental and iterative evaluation
methodology to:
- enable the release of intermediate (but functional) resources, and
- move progressively (iteration-after-iteration) towards consolidated tools
and resources.
We plan for three rounds, tentatively 1.5 month each.
Each round consists of the following phases:
data release
submission of participants’ runs
scoring of participants’ runs
transwriting of the rolling technical report
round wrap virtual meeting
An integral part of the Covid-19 MLIA @ Eval approach consists in sharing
information and ideas among the participants. This will be made possible
through both the rolling technical report where participants describe their
solutions throughout the evaluation rounds and the virtual meetings held at
the end of each round where participants present briefly the main
highlights of what did/did not work and exchange with each others in order
to share ideas and improve for the next round.
Moreover, to boost the exchange of resources and components, and to work
together towards improving MLIA technologies for Covid-19, participants are
provided with a dedicated git repository where to push and share the
outcomes of their participation in the different rounds, i.e. runs, code,
(language) resources, and a technical report. To facilitate sharing and
re-use, all the repositories contents are released under the Creative
Commons Attribution-ShareAlike 4.0 International License.
We offer tasks in the following language pairs: English->French,
English->German, English->Greek, English->Italian, English->Spanish and
English->Swedish.
Registration for the tasks is open at:
http://eval.covid19-mlia.eu/registration/
Important dates - First round:
Registration Opens: 19 October 2020
First Round Starts: 23 October 2020 (data release)
Release of test data: 20 November 2020
Submission of Runs: 27 November 2020
Submission of Technical Report: 8 January 2021
Round Wrap-up Virtual Meeting: 12-14 January 2021 (exact date TBD)
First Round Ends: 15 January 2021
Registration Closes: 14 May 2021
More information at: http://eval.covid19-mlia.eu/task3/
Organizers:
Overall
Khalid Choukri, ELDA, France
Nicola Ferro, University of Padua, Italy
Machine Translation
Francisco Casacuberta, Universitat Politècnica de València, Spain
Miguel Domingo, Universitat Politècnica de València, Spain
Mercedes García-Martínez, Pangeanic, Spain
Manuel Herranz, Pangeanic, Spain
Supporters
Covid-19 MLIA @ Eval is an evaluation effort promoted by several
communities which are closely working together.
European Commission
https://ec.europa.eu/
European Language Resources Coordination (ELRC),
http://www.lr-coordination.eu/
European Language Resources Association (ELRA)
http://www.elra.info/en/
European Research Infrastructure for Language Resources and Technology
(CLARIN)
https://www.clarin.eu/
CLEF Initiative
http://www.clef-initiative.eu/
We hope that other communities will join us in this shared effort. You are
very welcome!
Additional Information
You can find additional information on our Website:
http://eval.covid19-mlia.eu/
You can follow updates through our Twitter account
@covid19mlia
Any requests or comments? Drop us an email at:
i...@covid19-mlia.eu
_______________________________________________
Mt-list site list
Mt-list@eamt.org
http://lists.eamt.org/mailman/listinfo/mt-list
