The Effect of Named Entities on Effectiveness in Cross-Language Information Retrieval Evaluation

Mandl, Thomas and Womser-Hacker, Christa The Effect of Named Entities on Effectiveness in Cross-Language Information Retrieval Evaluation., 2005 . In 2005 ACM SAC Symposium on Applied Computing (SAC). Information Access and Retrieval (IAR) Track., Santa Fe, New Mexico, USA, March 13.-17. 2005. (Unpublished) [Presentation]

Preview

PDF sac2005MandlPresented.PDF Download (678kB) | Preview

English abstract

The large number of experiments carried out within evaluation initiatives for information retrieval has led to an invaluable source for further research and meta-analysis. In this study, an analysis of the results of the Cross Language Evaluation Forum (CLEF) campaigns for the years 2000 to 2003 is presented. This study considers the performance of the systems for each individual topic. It is dedicated to the influence of named entities on retrieval performance. Named entities in topics lead to significant improvement of the retrieval quality in general and for most systems and tasks. The performance of systems varies for topics without, with one or two and with three or more named entities. This knowledge gained by data mining on the evaluation results can be exploited for the improvement of retrieval systems as well as for the design of topics for future CLEF campaigns.

Item type:	Presentation
Keywords:	information retrieval, named entities
Subjects:	L. Information technology and library technology > LM. Automatic text retrieval. I. Information treatment for information services > IK. Design, development, implementation and maintenance L. Information technology and library technology > LS. Search engines. L. Information technology and library technology > LC. Internet, including WWW.
Depositing user:	Thomas Mandl
Date deposited:	28 Aug 2006
Last modified:	02 Oct 2014 12:04
URI:	http://hdl.handle.net/10760/8035

Downloads

Actions (login required)

View Item