The Faculty of Informatics is pleased to announce a seminar given by Dr. Omar Alonso
TITLE: Crowdsourcing for relevance evaluation
SPEAKER: Dr. Omar Alonso, A9.com, Palo Alto, USA
DATE: Tuesday, February 17th, 2009
PLACE: USI Università della Svizzera italiana, room SI-006, Informatics building (Via G. Buffi 13)
Relevance evaluation is an essential part of the development and maintenance of information retrieval systems. Yet traditional evaluation approaches have several limitations; in particular, conducting new editorial evaluations of a search system can be very expensive. I'll describe a new approach to evaluation based on the crowdsourcing paradigm, in which many online users, drawn from a large community each performs a small evaluation task. I'll also provide an introduction to Amazon's Mechanical Turk showing some real-world examples of tasks.
HOST: Prof. Fabio Crestani
URL 1: http://www.inf.unisi.ch