Evaluation of Information Retrieval Systems
Posted by Lovable Leona on July 4, 2008
Reading Assignment
Title: Reflections on Information Retrieval Evaluation
Author: Mei-Mei Wu & Diane H. Sonnenwald
Publisher: pnclink.org (online)
URL: pnclink.org/annual/annual1999/1999pdf/wu-mm.pdf
Abstract of the article
Research in information retrieval (IR) research has primarily consisted of two paradigms: systems-oriented research and user studies. These paradigms have contributed new IR algorithms and insights into IR processes. However, problematic issues concerning IR evaluation exist in both communities. In this paper, a brief overview of IR evaluation, including systems-oriented research and user studies, is presented and problematic issues in IR evaluation are discussed
.3 Things I learned from my Reading Assignment:
The evaluation of information retrieval systems has gained considerable momentum in the last few years.
- Two paradigms arise. First is the systems-oriented research which includes the process development and its evaluation.
- Next paradigm is the User studies which includes human information behavior and their information seeking research.
- And I have learned that both of them are essential in evaluating the information retrieval systems.
Implications of the new things I learned to my work/ to me as a person:
Being a High School Librarian, it is my responsibility to make a way to prepare our students for their college life. One of these is to improve the OPAC that they are using because its features are limited. Upon reading this article, I have learned that I should consider two things in having information retrieval systems: its systems requirements and user studies. Without these two paradigms it would be impossible to improve and develop our Information Retrieval Systems.
