Current status of the evaluation of information retrieval.
This is the second in the series of the articles on an application of the systems analytic approach to evaluation of information retrieval (IR). In the previous article a historical overview of IR was presented and existing terminological problems associated with IR were identified and discussed. In the presented article the current status of IR evaluation is summarized, and different evaluation approaches are discussed. The Cranfield evaluation model and the most often used relevance-based measures of recall and precision are explained, and their problems are presented. Possible evaluation alternatives to the Cranfield model are discussed, and the case for a systems analytic approach to IR is summarized.
Kagolovsky
Yuri
Y
School of Health Information Science, University of Victoria, P.O. Box 3050, Victoria, British Columbia, Canada V8W 3P5. ykagolov@uvic.ca
Moehr
Jochen R
JR
D000043:Abstracting and Indexing; D003199:Computer Systems / Q000592:standards; D003657:Decision Making; D005069:Evaluation Studies as Topic; D006801:Humans; D016247:Information Storage and Retrieval / Q000379:methods / Q000592:standards*; D007256:Information Systems / Q000592:standards*; D009323:Natural Language Processing; D013597:Systems Analysis; D014584:User-Computer Interface