Visualizing Meta Search Results: Evaluating the MetaCrystal Toolset

Spoerri, Anselm Visualizing Meta Search Results: Evaluating the MetaCrystal Toolset., 2006 . In 69th Annual Meeting of the American Society for Information Science and Technology (ASIST), Austin (US), 3-8 November 2006. [Conference paper]

[thumbnail of Spoerri_Visualizing.pdf]
Preview
 PDF
Spoerri_Visualizing.pdf
Download (208kB) | Preview

English abstract

MetaCrystal aims to help users find the documents that are most likely to be relevant. It compares the results returned by multiple search engines and displays the documents based on the number of engines that found them and their rank positions in the result lists. First, this paper examines the validity of the MetaCrystal design approach by calculating the probability that a document is relevant based on the number of engines that found it and its rank positions in the result lists. Using TREC data, it is shown that MetaCrystal’s visual design is sound because it visually emphasizes documents based on their likelihood of being relevant. Second, this paper investigates if users are able to use the MetaCrystal‘s visualizations to find the documents that are most likely to be relevant. The results of a user study are reported that show that novice users are able to accomplish this task.

Item type: Conference paper
Keywords: relevancy ; search engines
Subjects: B. Information use and sociology of information > BI. User interfaces, usability.
L. Information technology and library technology > LS. Search engines.
Depositing user: Norm Medeiros
Date deposited: 18 Dec 2006
Last modified: 02 Oct 2014 12:05
URI: http://hdl.handle.net/10760/8643

References

Banks D., Over P. & Zhang N. (1999) Blind Men and Elephants: Six Approaches to TREC data Information Retrieval 1, 7-34

Benford, S. D., Snowdon, D N., Greenhalgh, C M., Ingram, R J., Knox, I. & Brown, C C., (1995) VR-VIBE: A Virtual Environment for Co-operative Information Retrieval Computer Graphics Forum 14, (3), pp. 349-360

Callan. J. (2000) Distributed information retrieval In Croft W.B. (Ed.) Advances in Information Retrieval Kluwer Academic Publishers. pp. 127-150

Chen H., Fan H., Chau M. and Zeng D. MetaSpider: (2001) Meta-Searching and Categorization on the Web JASIST 52 (13), 1134-1147

Cugini, J., Piatko, C. & Laskowski, S. (1996) Interactive 3D Visualization for Document Retrieval Proc. of Workshop on New Paradigms in Information Visualization & Manipulation, CIKM '96

Foltz, P. and Dumais, S. (1992) Personalized information delivery: An analysis of information-filtering methods Comm. of the ACM 35 (12):51-60

Fox, E. & Shaw, J. (1994) Combination of Multiple Searches 2nd Annual Text Retrieval Conference (TREC-2), Gaithersburg, MD, 2000 U.S. Government Printing Office, Washington

Grokker http://www.groxis.com

Havre, S., Hetzler, E., Perrine K., Jurrus E., & Miller N. (2001) Interactive Visualization of Multiple Query Results Proc. IEEE Information Visualization Symposium. 2001

Hearst M. (1999) User interfaces and visualization Modern Information Retrieval R. Baeza-Yates and B. Ribeiro-Neto (eds.). Addison-Wesley, 257-323

Hemmje, M., C. Kunkel, & A. Willet (1994) LyberWorld - a visualization user interface supporting fulltext retrieval Proceedings of ACM SIGIR pp. 254-259

Kartoo http://www.kartoo.com

Keim, D. A.& Kriegel, H.P. (1994) VisDB: Database Exploration Using Multidimensional Visualization IEEE CG&A, Sept. 1994 pp. 40-49

Lawrence, S., & Giles, C.L. (1999) Accessibility of information on the Web Nature 400, 107-109

Mann T. (2002) Visualization of Search Results from the WWW Ph.D. Thesis, University of Konstanz

Olsen, K. A., Korfhage, R. R., Sochats, K. M., Spring, M. B., & Williams, J. G. (1993) Visualization of a Document Collection: the VIBE System Information Processing & Management 29 (1), 69-81

Saracevic, T. and Kantor, P. (1988) A study of information seeking and retrieving. III. Searchers, searches and overlap JASIST Volume 39, 3, 197-216

Spoerri, A. (2004a) Visual Editor for Composing Meta Searches Proc. of the 67th Annual Meeting of the American Society for Information Science and Technology (ASIST 2004)

Spoerri, A. (2004b) RankSpiral: Toward Enhancing Search Result Visualizations Proc. IEEE Information Visualization Symp. 2004

Spoerri, A. (2004c) Toward Enabling Users to Visually Evaluate the Effectiveness of Different Queries or Engines Journal of Web Engineering 3(3 & 4) 297-313

Spoerri, A. (2005) How the Overlap Between the Search Results of Different Retrieval Systems Correlates with Document Relevance Proc. of the 68th Annual Meeting of the American Society for Information Science and Technology (ASIST 2005)

Torres, R., Silva, C., Medeiros, C. &. Rocha, H. (2003) Visual Structures for Image Browsing CIKM’03, November 3-8, 2003, New Orleans, Louisiana

Vivisimo http://www.vivisimo.com

Voorhees, E. & Harman, D. (1999) Overview of the Eighth Text REtrieval Conference (TREC-8) The Eighth Text REtrieval Conference (TREC-8), Gaithersburg, MD 2000. U.S. Government Printing Office, Washington


Downloads

Downloads per month over past year

Actions (login required)

View Item View Item
Contact us
Send email Sponsors
Sponsor: AIMS Sponsor: D&P Sponsor: UniNa CAB Get connected
Facebook Facebook Twitter Twitter Linkedin LinkedIn RSS RSS