Apologies for cross-posting We are pleased to announce the Model Compression track <https://iwslt.org/2025/model-compression> at IWSLT 2025 <https://iwslt.org/2025/> (22nd International Conference on Spoken Language Translation, in conjunction with ACL 2025 <https://2025.aclweb.org/>). Motivation
Text and speech foundation models have revolutionized many natural language processing tasks, including speech-to-text translation. However, their large size and high computational demands present significant challenges for real-world deployment, particularly in resource-constrained environments such as mobile devices, embedded systems, and edge computing. Reducing the size of large, general-purpose models while preserving—or even enhancing—their performance in specific tasks or language settings is essential for making them more efficient, accessible, and sustainable. The Task in a Nutshell The Model Compression track evaluates participants’ ability to apply model compression techniques to a large multilingual speech-to-text model, the need for accessibility and deployment feasibility with the requirement for good performance in speech-to-text translation. Participants are invited to apply pruning, quantization, distillation, or other compression techniques to optimize Qwen2-Audio <https://huggingface.co/Qwen/Qwen2-Audio-7B> (8.2B parameters, 16GB storage) for English-German and English-Chinese speech translation. Submissions and Evaluation Submissions under either of the two allowed data conditions (constrained or unconstrained, depending on the datasets used to support the model compression process) will be categorized into five compression bins, ranging from less than 200MB to 4GB of storage demand, and evaluated based on model size and COMET <https://huggingface.co/Unbabel/wmt22-comet-da> translation scores. Multiple submissions are allowed, with human evaluation conducted for the top-performing models. Guidelines, details, and contact information For submission guidelines and further details, please visit the IWSLT 2025 Model Compression track web page <https://iwslt.org/2025/model-compression> or contact us at [email protected]. Conference Information IWSLT 2025 will be co-located with ACL 2025 <https://2025.aclweb.org/>, taking place from 31 July to 1 August 2025 in Vienna, Austria. Important Dates - Test set release: April 1, 2025 - Submission of system outputs: April 15, 2025 - System description paper submission deadline: April 21, 2025 - Camera-ready deadline: June 1, 2025 - IWSLT conference in Vienna: July 31 – August 1, 2025 Best regards, Matteo Negri (Fondazione Bruno Kessler) On behalf of the IWSLT 2025 Model Compression track organizers: Marco Gaido (FBK), Marco Turchi (Zoom), Sebastian Stüker (Zoom), Jan Niehues (KIT) -- -- Le informazioni contenute nella presente comunicazione sono di natura privata e come tali sono da considerarsi riservate ed indirizzate esclusivamente ai destinatari indicati e per le finalità strettamente legate al relativo contenuto. Se avete ricevuto questo messaggio per errore, vi preghiamo di eliminarlo e di inviare una comunicazione all’indirizzo e-mail del mittente. -- The information transmitted is intended only for the person or entity to which it is addressed and may contain confidential and/or privileged material. If you received this in error, please contact the sender and delete the material.
_______________________________________________ Corpora mailing list -- [email protected] https://list.elra.info/mailman3/postorius/lists/corpora.list.elra.info/ To unsubscribe send an email to [email protected]
