Revisiting Search Task Difficulty: Behavioral and Individual Difference Measures

Gwizdka, Jacek Revisiting Search Task Difficulty: Behavioral and Individual Difference Measures., 2008 . In 71st Annual Meeting of the American Society for Information Science & Technology, Columbus, OH, 24-29 October 2008. [Conference paper]

[thumbnail of Gwizdka_2008_TaskDifficultyCogComplexity_ASIST08_final.pdf]
Preview
 PDF
Gwizdka_2008_TaskDifficultyCogComplexity_ASIST08_final.pdf
Download (76kB) | Preview

English abstract

Search task characteristics are recognized as important factors that affect search process and its outcomes. We examine the relationships among operational measures of searcher's behavior, individual cognitive differences, subjective task difficulty and mental effort assessed by dual-task performance. A web-based information study was conduced in a controlled experimental setting. Forty eight study participants performed six search tasks of varying type and structure. Subjective task difficulty was found to be influenced by the searcher's effort measured as the number of result pages and individual documents visited, the number of documents marked as relevant, as well as by individual cognitive differences, and mental effort assessed by performance on the secondary task. In contrast to previous studies, no strong effects of user navigation graph structure were found.

Item type: Conference paper
Keywords: search tasks, user studies, searching behavior, information seeking behaviors
Subjects: L. Information technology and library technology > LS. Search engines.
C. Users, literacy and reading. > CB. User studies.
Depositing user: Jacek Gwizdka
Date deposited: 24 Nov 2009
Last modified: 02 Oct 2014 12:15
URI: http://hdl.handle.net/10760/13699

References

Belkin, N. J. (1980). Anomalous states of knowledge as a basis for information retrieval. Canadian Journal of Information Science, 5, 133-143.

Botafogo, R. A., Rivlin, E., & Shneiderman, B. (1992). Structural analysis of hypertexts: Identifying hierarchies and useful metrics. ACM Transactions on Information Systems, 10, 142-180.

Buntine, W., Taylor, M. (2004). ALVIS: Superpeer Semantic Search Engine. European Workshop on the Integration of Knowledge, Semantic and Digital Media Technologies on November 25-26, 2004, Royal Statistical Society, London.

Byström, K. & Järvelin, K. (1995). Task complexity affects information seeking and use. Information Processing and Management, 31, 191-213.

Byström, K. (2002). Information and information sources in tasks of varying complexity. Journal of the American Society for Information Science and Technology, 53, 581-591.

Byström, K. & Hansen, P. (2002). Work tasks as unit for analysis in information seeking and retrieval studies. Proceedings of the 4th International Conference on Conceptions of Library & Information Science (CoLIS4), 239-252.

Chen, C. M., Czerwinski, M., & Macredie, R. (2000). Individual differences in virtual environments - Introduction and overview. Journal of the American Society for Information Science, 51(6), 499-507.

Chen, S. Y., Magoulas, G. D., & Macredie, R. D. (2004). Cognitive styles and users’ responses to structured information representation. International Journal on Digital Libraries, V4(2), 93-107.

Francis, G., Neath, I. (2003). CogLab on a CD. 3rd Ed. Wadsworth Publishing.

Gwizdka, J., Spence, I., (2005a). Predicting Outcomes of Web Navigation. Poster presented at WWW’2005, Chiba, Japan.

Gwizdka, J., Spence, I. (2005b). Indirect Assessment of Web Navigation Success. Extended Abstracts of ACM Conference on Human Factors in Computing Systems CHI'2005. ACM Press. 1427 - 1430.

Gwizdka, J., & Spence, I. (2006). What Can Searching Behavior Tell Us About the Difficulty of Information Tasks? A Study of Web Navigation. Paper presented at the ASIS&T 2006.

Gwizdka, J., & Spence, I. (2007). Implicit Measures of Lostness and Success in Web Navigation. Interacting with Computers, 19(3), 357-369.

Gwizdka, J., & Chignell, M. (2004). Individual differences and task-based user interface evaluation: A case study of pending tasks in email. Interacting with Computers, 16(4), 769-797.

Hansen, P. (1999). User interface design for IR interaction: A task-oriented approach. Proceedings of the Third International Conference on Conceptions of Library and Information Science (CoLIS 3). 191-205.

Herder, E. (2003). Revisitation Patterns and Disorientation. Proceedings of the German Workshop on Adaptivity and User Modeling in Interactive Systems ABIS 2003, 291-294.

Ingwersen, P. (1992). Information Retrieval Interaction.

Juvina, I. & van Oostendorp, H. (2004). Individual Differences and Behavioral Aspects Involved in Modeling Web Navigation. Lecture Notes In Computer Science, 3196, 77-95.

Kim, J.-H. (2006). Task as a Predictable Indicator for Information Seeking Behavior on the Web. An unpublished dissertation. SCILS, Rutgers University.

Kim, Y. M. & Rieh, S. Y. (2005). Dual-Task Performance as a Measure for Mental Effort in Library Searching and Web Searching. Proceedings of the 68th Annual Meeting of the American Society for Information Science and Technology.

Kim, S. & Soergel, D. (2005). Selecting and Measuring Task Characteristics as Independent Variables. Proceedings of the 68th Annual Meeting of the American Society for Information Science and Technology.

Larsen, B., Tombros, T. & Malik, S. (2007). Interactive Track Guidelines for the Initiative for the Evaluation of XML Retrieval (INEX) 2007.

Li, Y. (2004). Task type and a faceted classification of task. Proceedings of American Society for Information Science and Technology 2004, November 13-17, RI: Providence, USA. [Retrieved Jan 2, 2008, from http://www.asis.org/Conferences/AM04/posters/250.doc]

Li, Y. (2007). Work Tasks, Search Tasks, And Interactive Information Searching Behavior: An Exploration Of Their Relationships. Unpublished dissertation. SCILS, Rutgers University

Luu, T., Klemm, F., Podnar, I., Rajaman, M., Aberer, K. (2006). ALVIS Peers: A Scalable Full-text Peer-toPeer Retrieval Engine. Workshop on Information Retrieval in Peer-to-Peer Networks (P2PIR 2006), collocated with the AMC Fifteenth Conference on Information and Knowledge Management (CIKM 2006), Arlington, VA, USA, November 11, 2006

McEneaney, J. E. (2001). Graphic and numerical methods to assess navigation in hypertext. International Journal of Human Computer Studies, 55, 761-786.

McGraw, K. O., Williams, J. E., Tew, M. D. (1999). PsychExps: A Web-based Cognitive Psychology Laboratory. WebNet 1999: 1348-1349.

McGraw, K. O., & Tsai, W. S. (1993). A Computer Program for Conducting Mental Rotation Experiments. Teaching of Psychology, 20(4), 246-247.

Peterson, E. R., Deary, I. J., & Austin, E. J. (2005). A new measure of Verbal-Imagery Cognitive Style: VICS. Personality and Individual Differences, 38(6), 1269-1281.

Shepard, R.N. & Metzler, J. (1971). Mental Rotation of Three-Dimensional Objects. Science (171) 701-703.

Shih, P.-C., Mate, R., Sanchez, F., & Munoz, D. (2004). Quantifying user-navigation patterns: a methodology proposal. In Poster presented at the 28th International Congress of Psychology in Bejing Bejing 2004.

Stroop, J. R. (1935). Studies of interference in serial verbal reactions. Journal of Experimental Psychology, 18(6), 643-662.

Tauscher, L. & Greenberg, S. (1997). How people revisit web pages: Empirical findings and implications for the design of history systems. International Journal of Human Computer Studies, 47, 97-137.

Toms, E., MacKenzie, T., Jordan, C, O’Brien, H., Freund, L., Toze, S. Dawe, E., MacNutt A., (2007). How Task affects Information Search. Workshop Pre-Proceedings In Initiative for the Evaluation of XML Retrieval (INEX) 2007. N. Fuhr, N. Lalmas, A. Trotman Eds. http://inex.is.informatik.uni-duisburg.de/2007/inex07/pdf/2007-preproceedings.pdf [Accessed: January 19, 2008].

Vakkari, P. (1999). Task complexity, problem structure and information actions. Integrating studies on information seeking and retrieval. Information Processing and Management, 35, 819-837.


Downloads

Downloads per month over past year

Actions (login required)

View Item View Item
Contact us
Send email Sponsors
Sponsor: AIMS Sponsor: D&P Sponsor: UniNa CAB Get connected
Facebook Facebook Twitter Twitter Linkedin LinkedIn RSS RSS