What a Difference a Tag Cloud Makes: Effects of Tasks and Cognitive Abilities on Search Results Interface Use

Gwizdka, Jacek What a Difference a Tag Cloud Makes: Effects of Tasks and Cognitive Abilities on Search Results Interface Use. Information Research, 2009, vol. 14, n. 4. [Journal article (Unpaginated)]

[thumbnail of paper414.html] HTML
paper414.html
Download (132kB)

English abstract

The goal of this study is to expand our understanding of the relationships between selected tasks, cognitive abilities and search result interfaces. The underlying objective is to understand how to select search results presentation for tasks and user contexts. Twenty-three participants conducted four search tasks of two types and used two interfaces (List and Overview) to refine and examine search results. Click-through data were recorded. This controlled study employed a mixed model design with two within-subject factors (task and interface) and two between-subject factors (two cognitive abilities: memory span and verbal closure). Quantitative analyses were carried out by means of the statistical package SPSS. Specifically, multivariate analysis of variance with repeated measures and non-parametric tests were performed on the collected data. The overview of search results appeared to have benefited searchers in several ways. It made them faster; it facilitated formulation of more effective queries and helped to assess search results. Searchers with higher cognitive abilities were faster in the Overview interface and in less demanding situations (on simple tasks), while at the same time they issued about the same number of queries as lower-ability searchers. In more demanding situations (on complex tasks and in the List interface), the higher ability searchers expended more search effort, although they were not significantly slower than the lower ability people in these situations. The higher search effort, however, did not result in a measurable improvement of task outcomes for high-ability searchers. These findings have implications for the design of search interfaces. They suggest benefits of providing result overviews. They also suggest the importance of considering cognitive abilities in the design of search results’ presentation and interaction.

Item type: Journal article (Unpaginated)
Keywords: search results interfaces, tag clouds, cognitive abilities, interface design
Subjects: L. Information technology and library technology > LS. Search engines.
C. Users, literacy and reading. > CB. User studies.
L. Information technology and library technology > LK. Software methodologies and engineering.
Depositing user: Jacek Gwizdka
Date deposited: 24 Nov 2009
Last modified: 02 Oct 2014 12:15
URI: http://hdl.handle.net/10760/13738

References

Allen, B. (2000). Individual differences and the conundrums of user-centered design: two experiments. Journal of the American Society for Information Science, 51(6), 508-520.

Baddley, A. (1986). Working memory. Oxford: Clarendon Press.

Bateman, S., Gutwin, C. & Nacenta, M.A. (2008). Seeing things in the clouds: the effect of visual features on tag cloud selections. In P. Brusilovsky and H.C. Davis (Eds.), Hypertext 2008: Proceedings of the 19th ACM Conference on Hypertext and Hypermedia Pittsburg, PA, USA, June 19-21, 2008. (pp. 193-202). New York, NY: ACM Press. Retrieved 31, October 2009 from http://hci.usask.ca/publications/2008/fp039-bateman.pdf (Archived by WebCite® at http://www.webcitation.org/5kwguG7KB)

Belkin, N.J. (1980). Anomalous states of knowledge as a basis for information retrieval. Canadian Journal of Information Science, 6(5), 133-143.

Belkin, N.J. (2008). Some(what) grand challenges for information retrieval. SIGIR Forum, 42(1), 47-54.

Bhavnani, S. K. (2001). Important cognitive components of domain-specific search knowledge. Paper presented at TREC'2001: the Tenth Text REtrieval Conference. Retrieved 1 March, 2009 from http://trec.nist.gov/pubs/trec10/papers/TREC-2001-04.pdf (Archived by WebCite® at http://www.webcitation.org/5kunWWLIv)

Borgman, C. L. (1989). All users of information retrieval systems are not created equal: an exploration into individual differences. Information Processing and Management, 25(3), 237-251.

Borlund, P. (2003). The IIR evaluation model: a framework for evaluation of interactive information retrieval systems. Information Research, 8(3), paper 152. Retrieved 1 March, 2009 from http://informationr.net/ir/8-3/paper152.html (Archived by WebCite® at http://www.webcitation.org/5kunkcfpC)

Buntine, W.L., Valtonen, K. & Taylor, M.P. (2005). The ALVIS document model for a semantic search engine. Paper presented at the 2nd Annual European Semantic Web Conference (ESWC'05), Heraklion, Crete. Retrieved 1 March, 2009 from http://cosco.hiit.fi/Articles/eswc_buntine.pdf (Archived by WebCite® at http://www.webcitation.org/5kunt2FNq)

Card, S.K., Moran, T.P. & Newell, A. (Eds.). (1983). The psychology of human-computer interaction. Hillsdale, NJ: Lawrence Erlbaum.

Carroll, J.B. (1993). Human cognitive abilities: a survey of factor analytic studies. Cambridge: Cambridge University Press.

Chen, S.Y. & Ford, N. (1998). Modelling user navigation behaviours in a hypermedia-based learning system: an individual differences approach. Knowledge Organization, 25(3), 67-78.

Chen, S.Y., Magoulas, G. D. & Dimakopoulos, D. (2005). A flexible interface design for web directories to accommodate different cognitive styles. Journal of the American Society for Information Science and Technology, 56(1), 70-83.

Chen, S.Y., Magoulas, G.D. & Macredie, R.D. (2004). Cognitive styles and users' responses to structured information representation. International Journal on Digital Libraries, 4(2), 93-107.

Duggan, G. B. & Payne, S. J. (2008). Knowledge in the head and on the Web: using topic expertise to aid search. In Proceeding of the twenty-sixth annual SIGCHI conference on Human Factors in Computing Systems, Florence, Italy, April 05-10, 2008. (pp. 39-48). New York, NY: ACM Press.

Dumais, S., Cutrell, E. & Chen, H. (2001). Optimizing search by showing results in context. In Proceedings of the SIGCHI conference on Human Factors in Computing Systems: CHI'08, Florence, Italy, April 05-10, 2008. (pp. 277-284). New York, NY: ACM Press.

Dziadosz, S. & Chandrasekar, R. (2002). Do thumbnail previews help users make better relevance decisions about Web search results? In Proceedings of the 25th annual international ACM SIGIR conference on Research and Development in Information Retrieval, Tampere, Finland. (pp. 365-366). New York, NY: ACM Press.

Egan, D.E. (1988). Individual differences in human-computer interaction. In M. Helander (Ed.), Handbook of human-computer interaction. (pp. 543-568). New York, NY: North-Holland.

Ekstrom,R. B. (1976). Manual for kit of factor-referenced cognitive tests, 1976. Princeton, NJ: Education Testing Service

English, J., Hearst, M., Sinha, R., Swearingen, K. and Yee, K. (2002). Hierarchical faceted metadata in site search interfaces. In Extended Abstracts on Human Factors in Computing Systems (Minneapolis, Minnesota, USA, April 20 - 25, 2002). CHI '02 (pp. 628-639). New York, NY: ACM Press.

Fallows, D. (2008). Search engine use. Washington, DC: Pew Internet & American Life Project. Retrieved 31 October, 2009 from http://www.pewinternet.org/Reports/2008/Search-Engine-Use.aspx?r=1 (Archived by WebCite® at http://www.webcitation.org/5kwhyYCMg)

Ford, N. (1986). Pyschological determinants of information needs. Journal of Librarianship, 18(1), 47-62

Ford, N. and Chen, S. Y. (2000) Individual differences, hypermedia navigation and learning: an empirical study. Journal of Educational Multimedia and Hypermedia, 9(4), 281-312.

Ford, N., Miller, D. & Moss, N. (2001). The role of individual differences in Internet searching: an empirical study. Journal of the American Society for Information Science and Technology, 52(12), 1049-1066.

Ford, N., Miller, D. & Moss, N. (2005a). Web search strategies and human individual differences: a combined analysis. Journal of the American Society for Information Science and Technology, 56(7), 757-764

Ford, N., Miller, D. & Moss, N. (2005b). Web search strategies and human individual differences: cognitive and demographic factors, Internet attitudes and approaches. Journal of the American Society for Information Science and Technology, 56(7), 741-756

Francis, G. & Neath, I. (2003). CogLab on a CD. 3rd ed. Boston, MA: Wadsworth Publishing.

Golder, S.A. & Huberman, B.A. (2006). Usage patterns of collaborative tagging systems. Journal of Information Science, 32(2), 198-208.

Greene, S., Marchionini, G., Plaisant, C. & Shneiderman, B. (2000). Previews and overviews in digital libraries: designing surrogates to support visual information seeking. Journal of the American Society for Information Science, 51(4), 380-393.

Gwizdka, J. (2008). Cognitive load on Web search tasks. In JoséJ. Cañas & Herre Van Oostendorp (Eds.) Proceedings of Workshop on Cognition and the Web, Information Processing, Comprehension and Learning, Granada, 24-26 April 2008. (pp. 83-86). Granada, Spain: University of Granada

Gwizdka, J. (in press). Assessing cognitive load on Web search tasks. To appear in The Ergonomics Open Journal.

Gwizdka, J. & Bakelaar, P. (2009). Tag trails: navigating with context and history. In Proceedings of the 27th international Conference Extended Abstracts on Human Factors in Computing Systems (Boston, MA, USA, April 04 - 09, 2009). CHI EA '09. (pp. 4579-4584). New York, NY: ACM Press.

Gwizdka, J. & Chignell. M.H. (2004). Individual differences and task-based user interface evaluation: a case study of pending tasks in e-mail. Interacting with Computers, 16(4), 769-797.

Gwizdka, J. & Cole, M. (2007). Finding it on Google, finding it on del.icio.us. In L. Kovács, N. Fuhr & C. Meghini (Eds.), Research and advanced technology for digital libraries (pp. 559–562). Berlin and Heidelberg: Springer-Verlag. (Lecture Notes in Computer Science LN4675)

Halvey, M. & Keane, M. T. (2007). An assessment of tag presentation techniques. Paper presented at the 16th International World Wide Web Conference, WWW2007, May 8-12, 2007. Retrieved 21 July 2009 from http://www2007.org/htmlposters/poster988/ (Archived by WebCite® at http://www.webcitation.org/5kurART33)

Harper, S., Michailidou, E. & Stevens, R. (2009). Toward a definition of visual complexity as an implicit measure of cognitive load. ACM Transactions on Applied Perception (TAP), 6(2), 1-18.

Harrison, A.W. & Rainer, R.K. (1992). The influence of individual differences on skill in end-user computing. Journal of Management Information Systems, 9(2), 93–111.

Hearst, M. A. (1995). TileBars: visualization of term distribution information in full text information access. In Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems (Denver, CO) CHI'95, (pp. 59-66). New York, NY: ACM Press.

Ingwersen, P. (1996). Cognitive perspectives of information retrieval interaction: elements of a cognitive IR theory. Journal of Documentation, 52(1), 3-50

Ingwersen, P. & Järvelin, K. (2005). The turn: integration of information seeking and retrieval in context. Dordrecht, Netherlands: Springer Verlag.

Joho, H. & Jose, J. M. (2008). Effectiveness of additional representations for the search result presentation on the Web. Information Processing & Management, 44(1), 226-241.

Kim, K. S. (2001). Implications of user characteristics in information seeking on the World Wide Web. International Journal of Human-Computer Interaction, 13(3), 323-340.

Kim, K. S. & Allen, B. (2002). Cognitive and task influences on Web searching behavior. Journal of the American Society for Information Science and Technology, 53(2), 109-119.

Kline, P. (2000). The new psychometrics. London; Philadelphia, PA: Routledge.

Krishnan, A. & Jones, S. (2005). TimeSpace: activity-based temporal visualisation of personal information spaces. Personal and Ubiquitous Computing, 9(1), 46-65.

Kules, B., Capra, R., Banta, M. and Sierra, T. (2009). What do exploratory searchers look at in a faceted search interface? In Proceedings of the 9th ACM/IEEE-CS Joint Conference on Digital Libraries, Austin, TX, USA, June 15 - 19, 2009: JCDL '09 (pp. 313-322). New York, NY: ACM Press.

Kuo, B.Y.-L., Hentrich, T., Good, B.M. & Wilkinson, M.D. (2007). Tag clouds for summarizing web search results. In Proceedings of the 16th international conference on World Wide Web (Banff, Alberta, Canada, May 8-12, 2007). (pp. 1203-1204). New York, NY: ACM Press. Retrieved 31 October, 2009 from http://www2007.org/posters/poster1046.pdf (Archived by WebCite® at http://www.webcitation.org/5kxV7Gwqn)

Lam, T.H.W., Liu, J.N.K. & Lee, R.S.T. (2009). Master: an intelligent ontology-based multi-agent system for sightseer. International Journal of Software Engineering and Knowledge Engineering, 19(2), 137-147.

Lieberman, H. (1997). Autonomous interface agents. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems: CHI'97, Atlanta, Georgia, United States (pp. 67-74). New York, NY: ACM Press.

Lohse, G. (1997). The role of working memory on graphical information processing. Behaviour & Information Technology, 16(6), 297-308.

Marlow, C., Naaman, M., Boyd, D. & Davis, M. (2006). HT06, tagging paper, taxonomy, Flickr, academic article, to read. In Proceedings of the Seventeenth Conference on Hypertext and Hypermedia, Odense, Denmark, August 22 - 25, 2006: HYPERTEXT '06 (pp. 31-40). New York, NY: ACM Press.

McGrew, K.S. (1997). Analysis of the major intelligence batteries according to a proposed comprehensive Gf-Gc framework. In D. P. Flanagan, J. L. Genshaft & P. L. Harrison (Eds.), Contemporary intellectual assessment: theories, tests and issues (pp. 151-179). New York, NY: Guildord.

Messick, S. (1970). The criterion problem in the evaluation of instruction: assessing possible, not just intended outcomes. In M.C. Wittrock & D.E. Wiley (Eds.), The evaluation of instruction: issues and problems. (pp. 183-220). New York, NY: Holt Rinehart and Winston.

Miller, G. (1956). The magical number seven, plus or minus two: some limits on our capacity for processing information. Psychological Review, 63(2), 81-97.

Modjeska, D. & Chignell, M. (2003). Individual differences in exploration using desktop VR. Journal of the American Society for Information Science and Technology, 54(3), 216-228.

Moulaison, H.L. (2008). Social tagging in the Web 2.0 environment: author vs. user tagging. Journal of Library Metadata, 8(2), 101-111.

Nov, O., Naaman, M. & Ye, C. (2008). What drives content tagging: the case of photos on Flickr. In Proceeding of the Twenty-Sixth Annual SIGCHI Conference on Human Factors in Computing Systems, Florence, Italy, April 05 - 10, 2008: CHI '08 (pp. 1097-1100). New York, NY: ACM Press.

Palmquist, R.A. & Kim, K.S. (2000). Cognitive style and on-line database search experience as predictors of Web search performance. Journal of the American Society for Information Science, 51(6), 558-566.

Parry, D. (2008). 'Tell me the important stuff': fuzzy ontologies and personal assessments for interaction with the semantic Web. In Fuzzy Systems 2008, FUZZ-IEEE 2008 (Hong Kong) (IEEE International Conference on Computational Intelligence). (pp. 1295-1300). Edison, NJ: IEEE.

Riding, R. & Rayner, S. G. (1998). Cognitive styles and learning strategies. London: David Fulton Publisher.

Rivadeneira, A.W., Gruen, D.M., Muller, M.J. & Millen, D.R. (2007). Getting our head in the clouds: toward evaluation studies of tagclouds. In Proceedings of the SIGCHI conference on Human Factors in Computing Systems: CHI'07 (pp. 995-998). San Jose, CA: ACM Press.

Rosenholtz, R., Li, Y. & Nakano, L. (2007). Measuring visual clutter. Journal of Vision, 7(2), 1-22. Retrieved 1 March, 2009 from http://journalofvision.org/7/2/17/article.aspx (Archived by WebCite® at http://www.webcitation.org/5kus136qz)

Saracevic, T. (1991). Individual differences in organizing, searching and retrieving information. In ASIS '91: Proceedings of the 54th ASIS Annual Meeting, Washington, DC, October 27-31, 1991. Medford, NJ: Learned Information Inc. for the American Society for Information Science.

Sein, M.K., Olfman, L., Bostrom, R.P. & Davis, S.A. (1993). Visualization ability as a predictor of user learning success. International Journal of Man-Machine Studies, 39(4), 599-620.

Shiri, A.A. & Revie, C. (2003). The effects of topic complexity and familiarity on cognitive and physical moves in a thesaurus-enhanced search environment. Journal of Information Science, 29(6), 517-526.

Sinclair, J. & Cardew-Hall, M. (2008). The folksonomy tag cloud: when is it useful? Journal of Information Science, 34(1), 15-29

Sweller, J., van Merrienboer, J. & Paas, F. (1998). Cognitive architecture and instructional design. Educational Psychology Review, 10(3), 251-296.

Toms, E., O'Brien, H., Mackenzie, T., Jordan, C., Freund, L., Toze, S. and others. (2008). Task effects on interactive search: the query factor. In Focused access to XML documents (pp. 359-372). Berlin: Springer. (Lecture notes in computer science).

Weller, H.G., Repman, J. & Rooze, G.E. (1994). The relationship of learning, behavior and cognitive styles in hypermedia-based instruction: implications for design of HBI. Computers in the Schools, 10(3/4), 401-420

Westerman, S.J. (1995). Computerised information retrieval: individual differences in the use of spatial and non-spatial information. Perceptual and Motor Skills, 81(3, part 1), 771-786

Westerman, S.J., & Cribbin, T. (2000). Mapping semantic information in virtual space: dimensions, variance and individual differences. International Journal of Human-Computer Studies, 53(5), 765-787

White, R. W., Jose, J. M. & Ruthven, I. (2003). A task-oriented study on the influencing effects of query-biased summarisation in web searching. Information Processing and Management, 39(5), 707-733

Wickens, C.D. (2002). Multiple resources and performance prediction. Theoretical Issues in Ergonomics Science, 3(2), 159-177.

Witkin, H.A., & Goodenough, D.R. (1981). Cognitive styles: essence and origins. Field dependence and field independence. New York, NY: International Universities Press.

Woodruff, A., Faulring, A., Rosenholtz, R., Morrison, J. & Pirolli, P. (2001). Using thumbnails to search the Web. In Proceedings of the SIGCHI conference on Human Factors in Computing Systems: CHI'01 (pp. 198-205). New York, NY: ACM Press.

Woodruff, A., Rosenholtz, R., Morrison, J. B., Faulring, A. & Pirolli, P. (2002). A comparison of the use of text summaries, plain thumbnails and enhanced thumbnails for Web search tasks. Journal of the American Society for Information Science and Technology, 53(2), 172-185

Zhang, H. & Salvendy, G. (2001). The implication of visualization ability and structure preview design for Web information search tasks. International Journal of Human-Computer Interaction, 13(1), 75-95


Downloads

Downloads per month over past year

Actions (login required)

View Item View Item
Contact us
Send email Sponsors
Sponsor: AIMS Sponsor: D&P Sponsor: UniNa CAB Get connected
Facebook Facebook Twitter Twitter Linkedin LinkedIn RSS RSS