Seminars at the Faculty of Informatics
Crowdsourcing Relevance Magnitudes
Magnitude estimation is a psychophysical scaling technique for the measurement of sensations, where observers assign numbers to stimuli in response to their perceived intensity. I will report some results of a study on the use of magnitude estimation for judging the relevance of documents in the context of information retrieval evaluation. This large scale study involved collecting more than 50,000 magnitude estimation relevance judgments by means of crowdsourcing.
Stefano Mizzaro is Associate Professor at the University of Udine, Italy, since 2006. His main research interests for the last 20 years have been (and still are) information retrieval evaluation, mobile and context-aware retrieval, and scholarly publishing and peer review. After publishing is 100th paper, he stopped counting them. He is co-founder of MoBe Ltd., a spinoff company dealing with software and services for mobile devices. In 2014 he spent his sabbatical at RMIT, Melbourne; now he is back home enjoying the good old world