Maglaughlin, K. L. and Sonnenwald, D. H. User Perspectives on Relevance Criteria: A Comparison among Relevant, Partially Relevant, and Not-Relevant Judgments. Journal of the American Society for Information Science and Technology, 2002, vol. 53, n. 5, pp. 327-342. [Journal article (Paginated)]
Preview |
PDF
jasist-2002-maglaughlin-sonnenwald.pdf Download (229kB) | Preview |
English abstract
This study investigates the use of criteria to assess relevant, partially relevant and not relevant documents. Each study participant identified passages within 20 document representations that were used in making relevance judgments, judged each document representation as a whole to be relevant, partially relevant or not relevant to their information need, and explained their decisions in an interview. Analysis revealed 29 criteria, discussed positively and negatively, used by the participants when selecting passages that contributed or detracted from a document's relevance. These criteria can be grouped into 6 categories: author, abstract, content, full text, journal or publisher and personal. Results indicate that multiple criteria are used when making relevant, partially relevant and not relevant judgments. Additionally, most criteria can have both a positive or negative contribution to the relevance of a document. The criteria most frequently mentioned by study participants in this study was content, followed by criteria concerning the full text document. These findings may have implications for relevance feedback in information retrieval systems, suggesting that users give relevance feedback using multiple criteria and indicate positive and negative criteria contributions. Systems designers may want to focus on supporting content criteria followed by full text criteria as this may provide the greatest cost benefit.
Item type: | Journal article (Paginated) |
---|---|
Keywords: | searching, search term selection, professional librarian |
Subjects: | I. Information treatment for information services > IJ. Reference work. A. Theoretical and general aspects of libraries and information. > AZ. None of these, but in this section. H. Information sources, supports, channels. > HZ. None of these, but in this section. |
Depositing user: | Diane Sonnenwald |
Date deposited: | 20 Aug 2006 |
Last modified: | 02 Oct 2014 12:04 |
URI: | http://hdl.handle.net/10760/7997 |
References
Downloads
Downloads per month over past year
Actions (login required)
View Item |