Seminars at the Faculty of Informatics

The Faculty of Informatics is pleased to announce a seminar given by Dr. Omar Alonso

 

TITLE: Crowdsourcing for relevance evaluation

 

SPEAKER: Dr. Omar Alonso, A9.com, Palo Alto, USA

 

DATE: Tuesday, February 17th, 2009

 

PLACE: USI Università della Svizzera italiana, room SI-006, Informatics building (Via G. Buffi 13)

 

TIME: 15.30

 

ABSTRACT:

Relevance evaluation is an essential part of the development and maintenance of information retrieval systems. Yet traditional evaluation approaches have several limitations; in particular, conducting new editorial evaluations of a search system can be very expensive. I'll describe a new approach to evaluation based on the crowdsourcing paradigm, in which many online users, drawn from a large community each performs a small evaluation task. I'll also provide an introduction to Amazon's Mechanical Turk showing some real-world examples of tasks.

 

 

HOST: Prof. Fabio Crestani

URL 1: http://www.inf.unisi.ch