Curva Fin Bloque
NEWS 30 NOVEMBER, 2020

Pangeanic is organizing the MT task as a part of the Covid-19 MLIA @ Eval

Pangeanic is organizing the MT task as a part of the Covid-19 MLIA @ Eval. The goal is to organize a community evaluation effort aimed at accelerating the creation of resources and tools for improved MultiLingual Information Access (MLIA) in the current emergency situation

We invite you to participate in the MT task as a part of the Covid-19 MLIA @ Eval.

The goal is to organize a community evaluation effort aimed at accelerating the creation of resources and tools for improved Multilingual Information Access (MLIA) in the current emergency situation.

Covid-19 MLIA @ Eval adopts an incremental and iterative evaluation methodology to:

  • enable the release of intermediate (but functional) resources, and
  • move progressively (iteration-after-iteration) towards consolidated tools and resources.

We plan for three rounds, tentatively 1.5 month each.

Each round consists of the following phases:

  • Data release
  • Submission of participants’ runs
  • Scoring of participants’ runs
  • Trans writing of the rolling technical report
  • Round wrap virtual meeting

An integral part of the Covid-19 MLIA @ Eval approach consists in sharing information and ideas among the participants. This will be made possible through both the rolling technical report where participants describe their solutions throughout the evaluation rounds and the virtual meetings held at the end of each round where participants present briefly the main highlights of what did/did not work and exchange with each other’s in order to share ideas and improve for the next round.

We offer tasks in the following language pairs:  English->French, English->German, English->Greek, English->Italian, English->Spanish, and English->Swedish.

Registration for the tasks is open at: http://eval.covid19-mlia.eu/registration/

Important Dates – Round 1:

  • Round starts: October 23, 2020
  • Release of training data: October 23, 2020
  • Release of test data: November 20, 2020
  • Translations submission deadline: December 2, 2020
  • Translations scored: December 4, 2020
  • Rolling report submission deadline (preliminary version): December 23, 2020
  • Rolling report submission deadline (camera ready): January 8, 2021
  • Slot for a virtual meeting to discuss the results: January 12-14, 2021
  • Round ends: January 15, 2021

More information at this link

Organizers:

  • Overall

Khalid Choukri, ELDA, France

Nicola Ferro, University of Padua, Italy

  • Machine Translation

Francisco Casacuberta, Universitat Politècnica de València, Spain

Miguel Domingo, Universitat Politècnica de València, Spain

Mercedes García-Martínez, Pangeanic, Spain

Manuel Herranz, Pangeanic, Spain

Supporters

Covid-19 MLIA @ Eval is an evaluation effort promoted by several communities which are closely working together.

European Commission

European Language Resources Coordination (ELRC),

European Language Resources Association (ELRA)

European Research Infrastructure for Language Resources and Technology (CLARIN)

CLEF Initiative

We hope that other communities will join us in this shared effort. You are very welcome!

Additional Information

You can find additional information on our Website, click here

You can follow updates through our Twitter account: @covid19mlia

Any requests or comments? Drop us an email at: info@covid19-mlia.eu