|
[Apologies for multiple postings] CALL FOR PAPERS Evaluation of Information Filtering Systems in a Competitive Intelligence Framework Workshop 22 May 2010 Held in conjunction with LREC 2010, Malta Aims The constant growth of publicly available information has entailed a consequently similar growth in the research areas devoted to the automated organization of this information. In particular, Information Filtering systems have been developed to tackle the issues of many applications of business intelligence, from mail categorization to news routing and technology watch. However, the theoretically challenging models of these systems have seldom been evaluated in real usage context. Indeed, standard evaluation benchmarks usually introduce artefacts that simplify the task. For instance, in the context of competitive intelligence, systems must filter documents without any global information on a “collection” but can use feedback from the user, and must be efficient enough to deal with a real-time document stream. Furthermore, with the increase of mondialized access and availability of the information, sources may be found in many languages, and the multilinguality issue must also be considered. TREC Adaptive Filtering Track and INFILE track at CLEF for multilingual information filtering have tried to propose evaluation frameworks closer to the usage. The goal of this workshop is to study different aspects of Information Filtering Evaluation and to bring together researchers from the community of Information Filtering to develop new evaluation frameworks and confront current models with these new evaluation models. Submissions are expected to propose new insights on evaluation methodologies and resources for Information Filtering or to present Information Filtering models that will meet the requirements of a real usage evaluation (in particular, researchers that submit papers presenting Information Filtering Models are encouraged to evaluate their model using an existing benchmark such as the INFILE benchmark, available at http://www.infile.org). Topics Both theoretical and practical research papers are welcome from both research and industrial communities addressing the main workshop theme, in any aspect including: - Resources and methodologies for Evaluation of Information Filtering Systems in real usage context - New models for Information Filtering, that tackle one or several issues of this kind of evaluation: efficiency, adaptivity, multilinguality, etc. - Results of the Evaluation of Information Filtering Systems - User studies of the use of Information Filtering Systems in Competitive Intelligence Submission information Papers will be submitted to the workshop via the START LREC Conference Manager, under https://www.softconf.com/lrec2010/InFile2010/ Authors should submit a PDF file of no more than 10 pages, following the LREC conference formatting details. Papers will be reviewed by three members of the Program Committee, Accepted papers will be published in the workshop Proceedings. When submitting a paper from the START page, authors will be asked to provide essential information about resources (in a broad sense, i.e. also technologies, standards, evaluation kits, etc.) that have been used for the work described in the paper or are a new result of your research. For further information on this new iniative, please refer to http://www.lrec-conf.org/lrec2010/?LREC2010-Map-of-Language-Resources. Important dates Paper submission deadline (extended) 12 March 2010 Notification of acceptance 25 March 2010 Final version of accepted paper 4 April 2010 Workshop half-day 22 May 2010 Workshop Organizers Romaric Besançon CEA LIST BP 6 92265 Fontenay-aux-roses CEDEX FRANCE Tel: +33 1 46 54 80 16 Fax: +33 1 46 54 75 80 email: [email protected] Djamel Mostefa ELDA 55-57,rue Brillat Savarin 75013 Paris FRANCE Tel: +33 1 43 13 33 33 email: [email protected] Program Committee Romaric Besançon, CEA LIST Stéphane Chaudiron Université Lille 3 Khalid Choukri, ELDA Christian Fluhr, HossurTech Meriama Laïb, CEA LIST Djamel Mostefa, ELDA Ismail Timimi, Université Lille 3 |
_______________________________________________ Mt-list mailing list
