Qualitätsmessung bei Suchmaschinen: System- und nutzerbezogene Evaluationsmaße.

Lewandowski, Dirk and Höchstötter, Nadine Qualitätsmessung bei Suchmaschinen: System- und nutzerbezogene Evaluationsmaße. Informatik Spektrum, 2007, vol. 30, n. 3. [Journal article (Unpaginated)]

[thumbnail of Lewandowski-Höchstötter.pdf]
Preview
 PDF
Lewandowski-Höchstötter.pdf
Download (314kB) | Preview

English abstract

Search engines are the most important medium to find content on the web. In the past, several studies were conducted, which examined the quality of search engines. But, this evaluation of the quality so far only include a few and often very one-sided aspects. The quality of a search engine is usually equated with its ability to retrieve relevant results. In this work, we will present a full spectrum of measurable aspects of quality, in order to show that more varied measures are necessary, which do not only evaluate the technology of search engines, but also involve the users of search engines in order to get a more comprehensive view on the quality measurement of search engines.

German abstract

Suchmaschinen stellen mittlerweile das wichtigste Medium dar, um Inhalte im Internet zu finden. Es gab deswegen in der Vergangenheit verschiedene Studien, welche die Qualität von Suchmaschinen untersuchten. Bei der Bewertung der Qualität wurden bisher jedoch nur wenige und oft sehr einseitige Aspekte benutzt. Die Qualität einer Suchmaschine wird meist mit der Bewertung der gefundenen Dokumente oder ihrer Inhalte gleichgesetzt. In dieser Arbeit wird der Fächer der messbaren Qualitätsaspekte aufgespannt, um zu zeigen, dass vielfältigere Maße nötig sind. Es wird nicht nur die Technik von Suchmaschinen bewertet, sondern es werden auch die Nutzer der Suchmaschinen einbezogen, um eine umfassendere Sicht auf die Qualitätsmessung zu bekommen.

Item type: Journal article (Unpaginated)
Keywords: World Wide Web, search engines, quality measurement
Subjects: L. Information technology and library technology > LS. Search engines.
Depositing user: Dirk Lewandowski
Date deposited: 05 Jul 2007
Last modified: 02 Oct 2014 12:08
URI: http://hdl.handle.net/10760/9992

References

Vaughan, L.: New Measurements for Search Engine Evaluation Proposed and Tested. Information Processing & Management 40, 677-691 (2004)

Ingwersen, P., Järvelin, K.: The Turn: Integration of Information Seeking and Retrieval in Context. Dordrecht: Springer 2005

Kleinberg, J. M.: Authoritative Sources in a Hyperlinked Environment. Journal of the ACM 46, 604-632 (1999)

The PageRank Citation Ranking: Bringing order to the Web. http://dbpubs.stanford.edu:8090/pub/1999-66, 24.7.2006

Lewandowski, D.: Web Information Retrieval: Technologien zur Informationssuche im Internet. Frankfurt am Main: DGI 2005

Lewandowski, D., Höchstötter, N.: Web Searching: A Quality Measurement Perspective. In: Spink, A., Zimmer, M. (Hrsg.): Web Searching: Interdisciplinary Perspectives. Berlin, Heidelberg: Springer 2007 [im Druck]

Wang, H., Xie, M., Goh, T. N.: Service Quality of Internet Search Engines. Journal of Information Science 25, 499-507 (1999)

Xie, M., Wang, H., Goh, T. N. Quality Dimensions of Internet Search Engines. Journal of Information Science 24, 365-372 (1998)

Parasuraman, A., Zeithaml, V.A., Berry, L.L. SERVQUAL: A Multiple-item Scale for Measuring Consumer Perceptions of Service Quality. Journal of Retailing 64, 12-40 (1988)

Korfhage, R. R.: Information Storage and Retrieval. New York: Wiley 1997

Greisdorf, H., Spink, A.: Median Measure: an Approach to IR Systems Evaluation. Information Processing & Management 37, 843-857 (2001)

Su, L. T.: Value of Search Results as a Whole as the Best Single Measure of Information Retrieval Performance. Information Processing & Management 34, 557-579 (1998)

Lewandowski, D.: Zur Bewertung der Qualität von Suchmaschinen. In: Eberspächer, J., Holtel, St. (Hrsg.): Suchen und Finden im Internet. Berlin, Heidelberg: Springer 2006

Machill, M., Neuberger, Ch., Schweiger, W., Wirth, W.: Qualität und Nutzung von Suchmaschinen. In: Machill, M., Welp, C. (Hrsg.): Wegweiser im Netz. Gütersloh: Verlag Bertelsmann Stiftung 2003

Schmidt-Maenz, N., Bomhardt, Ch.: Wie Suchen Onliner im Internet?. Science Factory 2/2005, Absatzwirtschaft, 5-8 (2005)

Dujmovic, J., Bai, H.: Evaluation and Comparison of Search Engines Using the LSP Method. Computer Science and Information Systems 3, 31-56 (2006)

Schmidt-Maenz, N., Koch, M.: A General Classification of (Search) Queries and Terms. Proceedings of International Conference on Information Technologies: Next Generations, Las Vegas, Nevada, USA, 375-381 (2006)

Search Engine Sizes. http://searchenginewatch.com/showPage.html?page=2156481 24.7.2006

Bharat, K., Broder, A.: A Technique for Measuring the Relative Size and Overlap of Public Web Search Engines. Computer Networks and ISDN Systems 30, 379-388 (1998)

Lawrence, St., and Giles, C.L.: Searching the World Wide Web. Science 280, 98-100 (1998)

Lawrence, St., Giles, C.L: Accessibility of Information on the web. Nature 400, 107-109 (1999)

Gulli, A., Signorini, A.: The Indexable Web is more than 11.5 Billion Pages. Special Interest Tracks and Posters of the 14th International Conference on World Wide Web, Chiba, Japan, 902-903 (2005)

Sherman, Ch., Price, G.: The Invisible Web: Uncovering Information Sources Search Engines Can't See. Medford, NJ: Information Today 2001

Bergman, M. K.: The Deep Web: Surfacing Hidden Value. Journal of Electronic Publishing 7 (2001)

Lewandowski, D., Mayr, Ph.: Exploring the Academic Invisible Web. Library Hi Tech 24 (2006)

Vaughan, L., Thelwall, M.: Search Engine Coverage Bias: Evidence and Possible Causes. Information Processing & Management 40, 693-707 (2004)

Acharya, A., Cutts, M., Dean, J., Haahr, P., Henzinger, M., Hoelzle, U., Lawrence, St., Pfleger, K., Sercinoglu, O., Tong, S.: Information Retrieval based on Historical Data. Google Patent, USA 2005

Lewandowski, D.: Date-restricted Queries in Web Search Engines. Online Information Review 28, 420-427 (2004)

Ntoulas, A., Cho, J., Olston, Ch.: What's New on the Web? The Evolution of the Web from a Search Engine Perspective. Thirteenth WWW Conference, New York, USA 2004

Notess, G.: Search Engine Statistics: Freshness Showdown. URL: http://www.searchengineshowdown.com/stats/freshness.shtml

Lewandowski, D., Wahlig, H., Meyer-Bautor, G.: The Freshness of Web Search Engine Databases. Journal of Information Science 32, 133-150 (2006)

Chu, H.: Information Representation and Retrieval in the Digital Age. Medford, NJ: Information Today 2003

Griesbaum, J.: Evaluation of three German Search Engines: Altavista.de, Google.de and Lycos.de. Information Research 9 (2004)

Véronis, J.: A Comparative Study of six Search Engines. URL: http://www.up.univ-mrs.fr/veronis/pdf/2006-comparative-study.pdf

Spink, A., Park, M., Jansen, B. J., Pedersen, J.: Multitasking during Web Search Sessions. Information Processing & Management 42, 264-275 (2006)

Chignell, M. H., Gwizdka, J., Bodner, R. C.: Discriminating Meta-Search: a Framework for Evaluation. Information Processing and Management 35, 337-362 (1999)

Gordon, M., Pathak, P.: Finding Information on the World Wide Web: the Retrieval Effectiveness of Search Engines. Information Processing & Management 35, 141-180 (1999)

Schwartz, C.: Web Search Engines. Journal of the American Society for Information Science and Technology 49, 973-982 (1998)

Spink, A., Jansen, B. J., Blakely, Ch., Koshman, Sh.: A Study of Results Overlap and Uniqueness among Major Web Search Engines. Information Processing & Management 42, 1379-1391 (2006)

Lewandowski, D.: Abfragesprachen und erweiterte Suchfunktionen von WWW-Suchmaschinen. Information: Wissenschaft und Praxis 55, 97-102 (2004)

Notess, G.: Search Engine Features Chart. URL: http://www.searchengineshowdown.com/features/, 5.2.2007

Notess, G.: Boolean Searching on Google. URL: http://www.searchengineshowdown.com/features/google/googleboolean.html, 5.2.2007

Eastman, C., Jansen, B.: Coverage, Relevance, and Ranking: The Impact of Query Operators on Web Search Engine Results. ACM Transactions on Information Systems 21, 383-411 (2003)

Search Engine Usage in North America, A Research Initiative by Enquiro. www.enquiro.com, 16.3.2006

Spink, A., Jansen, B. J.: Web Search: Public Searching of the Web. Dordrecht, Boston, London: Kluwer Academic Publishers 2004

Geoghegan, T.: Search Wars - Which is Best? news.bbc.co.uk/2/hi/uk_news/magazine/4003193.stm, 2.2.2007

Fauldrath, J., Kunisch, A.: Kooperative Evaluation der Usability von Suchmaschineninterfaces. Information: Wissenschaft und Praxis 56, 21-28


Downloads

Downloads per month over past year

Actions (login required)

View Item View Item
Contact us
Send email Sponsors
Sponsor: AIMS Sponsor: D&P Sponsor: UniNa CAB Get connected
Facebook Facebook Twitter Twitter Linkedin LinkedIn RSS RSS