Design and Evaluation of a Prototype User Interface Supporting Sharing of Search Knowledge in Information Retrieval

Zhang, Xiangmin and Li, Yuelin and Jewell, Sarah Design and Evaluation of a Prototype User Interface Supporting Sharing of Search Knowledge in Information Retrieval., 2005 . In 68th Annual Meeting of the American Society for Information Science and Technology (ASIST), Charlotte (US), 28 October - 2 November 2005. [Conference paper]

[img]
Preview
PDF
Zhang_Design.pdf

Download (3MB) | Preview

English abstract

This paper describes a prototype user interface system, CIRR tool, which allows searchers to share their relevance judgments, search queries, and search results by providing a system Task Console with a “Group Report” feature. The system was developed based on the assumption that knowledge sharing in information retrieval (IR) is helpful and important to improve search performance. A usability evaluation of this system was conducted. The test results show that in general the system is easy to learn and use. However, some usability problems are also observed. The paper discusses these issues and proposes future research directions.

Item type: Conference paper
Keywords: information relevancy ; user communication sharing ; user interaction
Subjects: B. Information use and sociology of information > BI. User interfaces, usability.
B. Information use and sociology of information > BD. Information society.
Depositing user: Norm Medeiros
Date deposited: 08 Feb 2006
Last modified: 02 Oct 2014 12:02
URI: http://hdl.handle.net/10760/7040

References

Allan, J. (2004). HARD track overview in TREC 2003 high accuracy retrieval from documents. Proceedings of The Twelfth Text Retrieval Conference, NIST, Gaithersburg, MD, Nov. 2003. Retrieved Jun. 22, 2004, from

http://trec.nist.gov/pubs/trec12/papers/HARD.OVERVIEW.pdf

Allen, B. (1991). Topic knowledge and online catalog search formulation. Library Quarterly, 61(2), 188-213.

Balfe, E. and Smyth, B. (2004). Query mining for community-based Web search. Proceedings of the IEEE/WIC/ACM International Conference on Web Intelligence (pp.594-598). IEEE/WIC/ACM 2004, Beijing, China.

Bhavnani, S. K. (2002). Domain-specific search strategies for the effective retrieval of healthcare and shopping information. Proceedings of CHI'02 (pp. 610-611). Minneapolis, MN.

Bhavnani, S. K., Bichakjian, C. K., Johnson, T. M., Little, R. J. , Peck, F. A., Schwartz, J. L., & Strecher, V. J. (2003). Strategy hubs: Next-generation domain portals with search procedures. Proceedings of CHI'03 (pp. 393-400). Ft. Lauderdale, FL.

Bruce, H., Fidel, R., Pejtersen, A.M., Dumais, S., Grudin, J., and & Poltrock, S. (2003). A comparison of the collaborative information retrieval behaviors of two design teams. The New Review of Information Behaviour Research, 4(1), 139 -153.

Cooper, W. S. (1988). Getting beyond Boole. Information Processing & Management, 24, 243-248.

Elkerton, J., & Williges, R. C. (1984). Information retrieval strategies in a file-search environment. Human Factors, 26(2), 171-184.

Fenichel. C. H. (1981). Online searching: Measures that discriminate among users with different types of experiences. Journal of the American Society for Information Science, 32, 23-32.

Frants, V. I., Shapiro, J., Taksa, I., & Voiskunskii, V. G. (1999). Boolean search: Current state and perspectives. Journal of the American Society for Information Science,50(1), 86-95.

Hirsh, S. G. (1997). How do children find information on different types of tasks? Children’s use of the Science Library Catalog. Library Trends, 45(4), 725-746.

Hsieh-Yee, I. (1993). Effects of search experience and subject knowledge on the search tactics of novice and experienced searchers. Journal of American Society for Information Science, 44(3), 161-174.

Hust, A., Klink, S., Junker, M., & Dengel, A. (2003). Towards collaborative information retrieval: Three approaches. In J. Franke, G. Nakhaeizadeh, and I. Renz (Eds.), Text Mining: Theoretical Aspects & Application, Springer Verlag (pp. 97-112). New York, NY.

Kantor, P. B., Boros, E., Melamed, B., Menkov, V., Shapira, B., & Neu, D. J. (2000). Capturing human intelligence in the net. Communications of the ACM, 43, 112-115.

Karamuftuoglu, M. (1998). Collaborative IR: Toward a social informatics view of IR interaction”, Journal of the American Society for Information Science, 49, 1070-1080.

Kiestra, M. D., Stokmans, M. J. W., & Kamphuis, J. (1994). End-users searching the online catalogue: the influence of domain and system knowledge on search patterns. The Electronic Library, 12(6), 335-343.

Linton, F. (2003). OWL: A system for the automated sharing of expertise. In M. Ackerman, V. Pipek and V. Wulf (Eds): Sharing expertise: Beyond knowledge management (pp.383-401). Cambridge, MA: The MIT Press.

Marchionini, G., Dwiggins, S., Katz, A., & Lin, X. (1993). Information seeking in full-text end-user-oriented search systems: The roles of domain and search expertise. Library and Information Science Research, 15(1), 35-69.

Marchionini, G., Lin, X., & Dwiggins, S. (1990). Effects of search and subject expertise on information seeking in a hypertext environment. Proceedings of the 53rd Annual Meeting of the ASIS (pp.129-142).

Maybury, M., D’Amore, R., & House, D. (2003). Automated discovery and mapping of expertise. In M. Ackerman, V. Pipek and V. Wulf (Eds). Sharing Expertise: Beyond Knowledge Management (pp.359-382). Cambridge, MA: The MIT Press.

Meadow, C. T., Wang, J., & Yuan (1995). A study of user performance and attitudes with information retrieval interfaces. Journal of the American Society for Information Science, 46(7), 490-505.

Montaner, M., Lopez, B, & Lluis De La, J. (2003). A taxonomy of recommender agents on the Internet. Artificial Intelligence Review, 19, 285-330.

Newell, S. C. (1997). User models and filtering agents for improved Internet IR. User Modeling and User-Adapted Interaction, 7, 223-237.

Penniman, W. D. (1981). Modeling and evaluation of online user behavior. Final report to the National Library of Medicine under extramural program grant no. NLM/EMP (1 R01 LM 03444-01). Dublin, OH: OCLC.

Resnick, P., & Varian, H. R. (1997). Recommender systems. Communications of ACM, 40, 56-58.

Romano, N. C., Roussinov, D.,,Nunamaker, J. F. ,& Chen, H. (1999). Collaborative information retrieval environment: Integration of information retrieval with group Support Systems, Proceedings of the Thirty-second Annual Hawaii International Conference on system sciences ( pp. 1-10)..

Swearingen, K. , & Sinha, R. (2001). Beyond algorithms: An HCI perspective on recommender systems. Proceedings of the SIGIR 2001 Workshop on Recommender Systems. Retrieved June 12, 2005, from

http://www.rashmisinha.com/articles/BeyondAlgorithms.html.

Tenopir, C. (2004) Spying on search strategies, Library Journal, 129, 29.

Tolle, J. E. (1983). Understanding patrons use of online catalogs: Transaction log analysis of the search method. In R. F. Vondran (Ed.), Proceedings of the 46th annual ASIS meeting (pp.167-171). White Plains, NY: Knowledge Industry.

Twidale, M. B., & Nichols, D. M. (1998). Designing interfaces to support collaboration in information retrieval. Interacting with Computers, 10, 177-93.

Twidale, M. B., Nichols, D. M., & Paice, C. D.(1997). Browsing is a collaborative process. Information Processing & Management, 33, 761-783.

Vakkari, P.,Pennanen, M. & Serola, S. (2002). Changes of search terms and tactics while writing a research proposal: a longitudinal case study. Information processing & management, 39, 445-463.

Wildemuth, B. (2004). The effects of domain knowledge on search tactic formulation. Journal of the American Society for Information Science and Technology, 55, 246-258.

Yimam-Seid, D., & Kobsa, A. (2003). Expert-finding systems for organizations: Problem and domain analysis and the DEMOR approach. In M. Ackerman, V. Pipek and V. Wulf (Eds): Sharing Expertise: Beyond Knowledge Management (pp.327-358).

Cambridge, MA: The MIT Press.

Zhang, X. (2002). Collaborative relevance judgment: A group consensus method for evaluating user search performance. Journal of the American Society for Information Science and Technology, 53, 220-235.

Zhang, X., &, Li, Y. (2005).. An exploratory study on knowledge sharing in information retrieval. Proceedings of the 38th Hawaii International Conference on Systems Science, CD/ROM, January 3-6, 2005, Big Island, Howaii.


Downloads

Downloads per month over past year

Actions (login required)

View Item View Item