Dear colleagues,

We are pleased to announce the Long-Form Analogy Evaluation Challenge, a shared 
task focused on automatically evaluating generated analogies for explaining 
Computer Science concepts. The shared task will be co-located with INLG 2026 
(https://2026.inlgmeeting.org/), and participants will have the opportunity to 
write a paper describing their system and approach.

Submission Deadline: August 1, 2026

Prizes: The top 3 participants will receive $100, $50, and $25, respectively.

About the Challenge

Participants are asked to develop a system that predicts human quality ratings 
for long-form analogies. Given a concept, its description, a textual analogy, 
and an accompanying animation video, systems must predict scores across textual 
and video-based criteria. Submissions are evaluated using rank correlation with 
human judgments.

Links

  *   Competition: 
https://huggingface.co/spaces/analogy-evaluation/Analogy-Evaluation-Challenge
  *   Dataset: 
https://huggingface.co/datasets/analogy-evaluation/challenge-dataset
  *   Baseline code: https://github.com/yurinoviello/analogy-eval-baseline-INLG

We warmly encourage members of this community to participate and share this 
announcement with colleagues and students who may be interested.

Best regards,
Bhavya
Research Scientist, IBM

Yuri Noviello
PhD Student, Delft University of Technology


_______________________________________________
Corpora mailing list -- [email protected]
https://list.elra.info/mailman3/postorius/lists/corpora.list.elra.info/
To unsubscribe send an email to [email protected]

Reply via email to