TrebleCLEF Logo
Evaluation, Best Practices and Collaboration for Multilingual Information Access
Latest News
CLEF 2010: Padua, Italy September 2010
Read more - Link

TrebleCLEF workshop at eChallenges : Best Practices for Multilingual Information Access Istanbul,...
Read more - Link

Read all news

HOME | PROGRAMME | LECTURERS | PARTICIPANTS | LOGISTICS

Evaluation for (Cross-Language) Information Retrieval

Mark Sanderson
Dept. of Information Studies, University of Sheffield, United Kingdom

Abstract

Evaluation of search output is a critical component of any form of Information Access, however in MLIA, evaluation is additionally challenging. In this session, I will provide a broad introduction to evaluation of information access systems, where the main focus of will be on evaluation using test collections. Here the design and use of test collections will be described along with the measures employed to determine the effectiveness of a searching system. Alternative evaluation methods such as query log analysis and user studies will also be described. Next, the means by which evaluation methods have been adapted to work with multi-lingual systems are described. Finally, the additional assessments that need to be conducted to fully understand the success of MLIA are detailed.

Course Material

Evaluation in IR