FoRC 2025: Shared Task on Field of Research Classification
of Scholarly Publications
Hosted as part of the NSLP 2025 Workshop
1 or 2 June 2024 (tbc)
Portoroz, Slovenia
(co-located with ESWC 2025)
FoRC Shared Task: https://nfdi4ds.github.io/nslp2025/docs/forc_shared_task.html
NSLP 2025 Workshop: https://nfdi4ds.github.io/nslp2025/
A core application of Natural Scientific Language Processing (NSLP) is
classifying scientific articles for their respective field of research (FoR).
The 2025 iteration of the FoRC shared task builds on the data developed for
Subtask II of FoRC in 2024
<https://nfdi4ds.github.io/nslp2024/docs/forc_shared_task.html>, adding to it a
weakly supervised dataset of over 40K ACL publications. Participants are asked
to design classification systems based on FoRC4CL, a corpus of 1500 English
scholarly articles in Computational Linguistics (CL), collected from the ACL
Anthology (CC BY 4.0) and manually annotated according to a novel hierarchical
taxonomy, Taxonomy4CL, which consists of 170 core CL (sub-)topics. In addition,
over 40K weakly supervised publications are provided to supplement the corpus
and potentially increase model capabilities. Metadata fields include ACL
Anthology ID, title, abstract, author(s), URL to the full text, publisher,
publication year and month, proceedings title, DOI, venue, and the full text of
the respective article.
Task Overview
Given an article from the ACL Anthology and a taxonomy of NLP/CL sub-topics
(Taxonomy4CL), predict the entities from the taxonomy that correspond to the
main contributions of the article.
As a highly unbalanced, multi-label, hierarchical classification problem, this
task will be evaluated by computing micro, macro and weighted precison, recall,
and F1-score.
Codabench page for participation: https://www.codabench.org/competitions/5779
Important dates
Training and testing data release: February 18, 2025
System submissions deadline: March 25, 2025
Paper submissions: March 27, 2025
Notification of acceptance: April 10, 2025
Camera-ready submission: April 17, 2025
We encourage and invite participation from junior researchers and students from
diverse backgrounds. Participants are also encouraged to submit a paper
describing their systems to the NSLP 2025 workshop.
Organisers
Maria Francis (DFKI, Berlin, Germany & University of Trento, Italy)
Raia Abu Ahmad (DFKI, Berlin, Germany)
Ekaterina Borisova (DFKI, Berlin, Germany)
Georg Rehm (DFKI, Berlin, Germany)
_______________________________________________
Corpora mailing list -- [email protected]
https://list.elra.info/mailman3/postorius/lists/corpora.list.elra.info/
To unsubscribe send an email to [email protected]
