[Apologies for cross-posting]
Evaluation of NLP and Speech Tools for Italian
***EVALITA 2018 - Tasks and Call for Registration***

Following the success of the previous editions, we are pleased to announce 
EVALITA 2018, the sixth evaluation campaign of Natural Language Processing and 
Speech tools for Italian.

The general objective of EVALITA (http://www.evalita.it 
<http://www.evalita.it/>) is to promote the development of language 
technologies for the Italian language, providing a shared framework where 
different systems and approaches can be evaluated in a consistent manner. 
EVALITA is an initiative of the Italian Association for Computational 
Linguistics <http://www.ai-lc.it/> (AILC) and it is endorsed by the Italian 
Association for Artificial Intelligence <http://www.aixia.it/> (AI*IA) and the 
Italian Association for Speech Sciences <http://www.aisv.it/index.php> (AISV).

For the 2018 edition tasks are organized along the following tracks:

Affect, Creativity and Style    
ABSITA <http://sag.art.uniroma2.it/absita/> - Aspect-based Sentiment Analysis 
ITAMoji <https://sites.google.com/view/itamoji/> - Italian Emoji Prediction 
IronITA <http://di.unito.it/ironita18> - Irony Detection in Twitter 
GxG <https://sites.google.com/view/gxg2018> - Cross-Genre Gender Prediction 
Dialogue Systems        
iLISTEN <https://ilisten2018.github.io/> - itaLIan Speech acT labEliNg
IDIAL <https://sites.google.com/view/idial/> - Italian DIALogue systems 
Hate Speech     
AMI <https://amievalita2018.wordpress.com/> - Automatic Misogyny Identification 
(aligned with IberEval2018 <https://sites.google.com/view/ibereval-2018>)
HaSpeeDe <http://di.unito.it/haspeedeevalita18> - Hate Speech Detection 
NLP4FUN <https://nlp4fun.github.io/> - Solving language games 
SUGAR <https://sites.google.com/view/sugar-evalita/> - Spoken Utterances 
Guiding chef’s Assistant Robots 

As with other international evaluation campaigns, guidelines describing the 
different tasks will be distributed among the participants.
Participants to the tasks will also be provided with training data and will 
have the chance to test their systems according to the metrics and procedures 
to be used in the formal evaluation. 

The results of the evaluation will be disseminated at the final workshop, which 
will be organised in Turin as a co-located event of the 5th Italian Conference 
on Computational Linguistics - CLiC-it 2018 (December 10-12, 2018).

We encourage participation from both academic institutions and industrial 
organisations. Please visit the EVALITA web site where information about all 
tasks is currently available, and indicate your intention to participate and 
the specific task(s) you are interested in. You can do so by filling out the 
registration form at the following link, which will be available until 
September 3rd 2018, when test sets will be made available by the task 

Registration is compulsory to participate in the task(s) you selected, although 
it is not binding. In any case, independently of your registration, you can 
decide to withdraw from participating by not sending the system results during 
the evaluation stage. 

28th May 2018: development data available to participants
3rd September 2016: registration closes
3rd - 23rd September 2018: evaluation windows and collection of participants 
results, as follows:
3rd - 10th Sept. 2018: Evaluation Window I - Tasks: ITAMoji; HaSpeeDe
10th - 16th Sept. 2018: Evaluation Window II - Task: GxG, SUGAR, ABSITA, NLP4FUN
16th - 23rd Sept. 2018: Evaluation Window III - Tasks:  iLISTEN, AMI, IronITA
30th September 2018: assessment returned to participants
5th November 2018 (tentative): technical reports due to organisers
12th or 13th December 2018: final workshop

Scientific coordination:
Tommaso Caselli (Center for Language and Cognition Groningen, Rijksuniversiteit 
Groningen, The Netherlands)
Nicole Novielli (Dipartimento di Informatica, Università di Bari “A. Moro”, 
Viviana Patti (Dipartimento di Informatica, Università degli Studi di Torino, 
Paolo Rosso (PRHLT Research Center, Universitat Politècnica de València, Spain)

evalita2018[AT]gmail.com <http://gmail.com/>
Twitter: @EVALITAcampaign
Facebook: https://www.facebook.com/evalita2018/ 

UNSUBSCRIBE from this page: http://mailman.uib.no/options/corpora
Corpora mailing list

Reply via email to