===================================================================
*Call For Shared Task Participation: Perspective Argument Retrieval
Shared Task@ArgMining2024*
===================================================================
The shared task will be co-located with the Argument Mining Workshop
2024, at ACL in Bangkok, Thailand.
*------ **About* *-----------------------*
The "Perspective Argument Retrieval" task addresses the often-overlooked
challenge of incorporating socio-cultural factors (such as political
views, occupation, age, gender) in argument retrieval. By focusing on
these aspects, we acknowledge their potential latent influence on
argumentation.
With this shared task, we invite the community to develop methods that
concentrate on this crucial area and advance state-of-the-art retrieval
models by considering the perspective of societal diversity. This task
introduces three scenarios with varying levels of difficulty related to
socio-cultural alignment.
The scenarios include: a baseline, where arguments are selected purely
by topic relevance without considering perspectivism; explicit
perspectivism, where queries and candidates are matched based on a
specified attribute, ensuring retrieved arguments align with this
attribute; and implicit perspectivism, where the attribute is specified
in the query but absent in the candidates.
Beyond relevance, we evaluate the diversity of the ranking to assess to
what extend the top-ranked arguments reflect a variety of socio-cultural
profiles.
*------ **Important dates
**------------------------------------------------------------*
* *Release Training Data:* 4th March
* *Release Test Data:* 17 March
* *First Evaluation Circle:* 24 April
* *Second Evaluation Circle:* 30 April
* *Submission Final Run:* 7 May
* *Submission System Description Paper:* 20 May
* *Camera-ready papers due:* 1st July
* *Workshop / Shared Task:* 15th of August 2024
All deadlines are 11.59 pm UTC -12h (“anywhere on Earth”).
------*-Registration
----------------------------------------------------------
*
Register for the task using this form. <https://forms.gle/98gFuJi8fVNZ4qn89>
Check our website
<https://blubberli.github.io/perspective-argument-retrieval.github.io/>
for more details.
You can download the data and evaluation script from this repository
<https://github.com/Blubberli/argmin2024-perspective/tree/main>
Join our slack channel for any information or to ask questions here
<https://join.slack.com/t/perspectivear-zzl7474/shared_invite/zt-2dy0c082t-P~1s~jiVkjekmqI9H6oGpg>
Or write us an e-mail [email protected]
*-------Sponsoring*
-----------------------------------------------------------------------
Thanks to our sponsor Summetix <https://www.summetix.com> we will be
able to provide prizes in form of Amazon vouchers for the three best
teams in each track: relevance and diversity.
* 1st place: 130 $
* 2nd place: 80 $
* 3rd place: 40 $
===================================================================
Best,
Neele Falk (on behalf of the organizers of PerpectiveArgR)
_______________________________________________
Corpora mailing list -- [email protected]
https://list.elra.info/mailman3/postorius/lists/corpora.list.elra.info/
To unsubscribe send an email to [email protected]
