*Call for Tracks*
*FIRE 2025: 17th meeting of the Forum for Information Retrieval Evaluation*
Indian Institute of Technology (BHU) Varanasi
17th - 20th December
Website: fire.irsi.org.in <http://fire.irsi.org.in/>
*Call for Tracks*
We invite proposals for offering evaluation tracks at FIRE 2025.
FIRE 2025 is the 17th edition of the annual meeting of Forum for
Information Retrieval Evaluation (fire.irsi.org.in). Since its inception
in 2008, FIRE had a strong focus on shared tasks similar to those
offered at Evaluation forums like TREC, CLEF, and NTCIR. The shared
tasks focus on solving specific problems in the area information access
and, more importantly help in generating evaluation datasets for the
research community.
It is not required for the tasks to focus on a specific language, and
they can broadly cover any problem in the fields related (but not
limited) to IR, NLP, multi-modal information access, and ML. However,
the organizers especially encourage proposals for tracks related to
South Asian, African, and Middle Eastern languages. In the past, FIRE
has hosted tracks from Arabic, Persian, German, Russian, and Urdu
languages besides several Indian languages. We aim to continue these
efforts and include more language groups from these regions. For knowing
more about tracks in past FIRE meetings, you can visit fire.irsi.org.in
<http://fire.irsi.org.in>
Informal inquiries can also be sent to the track chairs.
Please include the following details in your proposal:
1. Track name
2. Track description
3. Use case/s
4. Target Audience and number of expected submissions
5. Data(*) (Fair Details)
6. Evaluation plan
7. Timeline: Please try to align with the FIRE conference dates as given
below
8. Organizer/s Details
9. Prior experience in organizing shared task/workshop at relevant venues
*Tentative Timeline*
*23rd March, 2025* Track proposals due
*10th April, 2025* Track acceptance notification
*15th May, 2025* Open track websites and release of training data
*15th June, 2025* Test data release
*30th June, 2025* Run submission deadline
*15th July, 2025* Track results declaration
*30th August, 2025* Working notes due
*30th September, 2025* Camera-ready copies of working notes and
overview paper due
*17th December, 2025* FIRE Conference
Please send these details in a pdf format to [email protected] with a
copy to [email protected] , [email protected] and
[email protected]
(*) We require that after FIRE, the data should be made publicly
available through Information Retrieval Society of India. In case, data
can not be distributed publicly (e.g., Twitter data), a unique
identifier that can be used to recreate the original corpus can be
provided (e.g., tweet ids in case of Twitter data). This disbursal will
be governed by a copyright form, which the users have to sign before
getting the data. A sample form is available at (
fire.irsi.org.in/fire/static/data
<http://fire.irsi.org.in/fire/static/data> ).
_______________________________________________
Corpora mailing list -- [email protected]
https://list.elra.info/mailman3/postorius/lists/corpora.list.elra.info/
To unsubscribe send an email to [email protected]
