Virtual reference service evaluation: Adherence to RUSA behavioral guidelines and IFLA digital reference guidelines

Shachaf, Pnina and Horowitz, Sarah M. (2007) Virtual reference service evaluation: Adherence to RUSA behavioral guidelines and IFLA digital reference guidelines.

Full text available as:
PDF - Requires Adobe Acrobat Reader or other PDF viewer.

Abstract

This study evaluates the level of adherence to professional guidelines by virtual (e-mail) reference services. These professional guidelines are set up as standards to assure service quality; however, studies of virtual reference effectiveness rarely utilize these standards to measure reference success. This study evaluates and compares the level of adherence to two sets of professional guidelines that have been published by the International Federation of Library Associations and Institutions (IFLA) and the American Library Association (ALA) Reference and User Services Association (RUSA). Analysis of 324 transactions from 54 libraries showed: 1) low levels of adherence to both sets of guidelines; 2) varied levels of adherence based on request types and user names on both sets of guidelines; 3) variation in institutional rank when different sets of guidelines were utilized; 4) no correlation between user satisfaction and adherence to either set of guidelines. The implications of this study for future research and practice lie not only in its provision of a systematic way to analyze transactions in light of the ideal professional standards, but also in providing an empirical benchmark for virtual reference services evaluation.

Keywords:	virtual reference, virtual reference services, professional guidelines, RUSA guidelines, IFLA guidelines
Subjects:	I. Information treatment for information services > IJ. Reference work.
ID Code:	12176
Deposited By:	Shachaf, Pnina
Deposited On:	03 December 2007
All fields:	Show all fields

Alford, B. L., & Sherrell, D. L. (1996). The role of affect in consumer satisfaction judgments of credence-based services. Journal of Business Research, 37, 71–84.

Arnold, J., & Kaske, N. (2005). Evaluating the quality of a chat service. Portal: Libraries and the Academy, 5(2), 177-193.

Bitner, M. J., Booms, B. H., & Tetreault, S. (1990). The service encounter: Diagnosing favorable and unfavorable incidents. Journal of Marketing, 54, 71–84.

Bobrowsky, T., Beck, L., & Grant, M. (2005). The chat reference interview: Practicalities and advice. Reference Librarian, 43(89/90), 179-191.

Bopp, R., & Smith, L. (2001). Reference and Information Services: An Introduction (3rd ed.). Englewood CO: Libraries Unlimited.

Bushallow-Wilbur, L., DeVinney, G., & Whitcomb, F. (1996). Electronic mail reference service: A study. Reference Quarterly, 35(3), 359-371. Retrieved March 9, 2007 from http://www.carnegiefoundation.org/classifications/

The Carnegie Foundation for the Advancement of Teaching. (2000). The Carnegie Classification of Institutions of Higher Education.

Carter, D. S., & Janes, J. (2003). Unobtrusive data analysis of digital reference questions and service at the Internet Public Library: An exploratory study. Library Trends, 49(2), 251-265.

Coffman, S. (2003). Going live: Starting and running a virtual reference service. Chicago, IL: American Library Association.

Coffman, S., & Arret, L. (2004). To chat or not to chat: Taking yet another look at virtual reference. The Searcher, 12(8), 49-56.

Croft, R., & Eichenlaud, N. (2006). E-mail reference in a distributed learning environment: Best practices, user satisfaction, and the reference services continuum. Journal of Library Administration, 45(1/2), 117-147.

Cummings, J., Cummings, L., & Frederiksen, L. (2007). User preferences in reference services: Virtual reference and academic libraries. Portal: Libraries and the Academy, 7(1), 81-96.

Churchill, G. A., & Surprenant, C. (1983). An investigation into the determinants of consumer satisfaction. Journal of Marketing Research, 19, 491–504.

Dewdney, P., & Ross, C. S. (1994). Flying a light aircraft: Reference service evaluation from a user’s viewpoint. Reference Quarterly, 34(2), 217-230.

Durrance, J. (1989). Reference success: Does the 55 percent rule tell the whole story? Library Journal, 114, 31-36.

Durrance, J. (1995). Factors that influence reference success: What makes questionnaires willing to return? The Reference Librarian, 49/50, 243-265.

Emery, J. (2005). Is our best good enough: Educating end-users about licensing terms. Journal of Library Administration, 42(3/4), 27-39.

Fagan, J. C., & Desai, C. M. (2003). Communication strategies for instant messaging and chat reference services. Reference Librarian, 38(79/80), 121-156.

Fernandez, J. (2004). Facing live reference. Online, 28(3), 37-40

Gatten, J. N., & Radcliff, C. J. (2001). Assessing reference behaviors with unobtrusive testing. In D.P. Wallace & C. Van Fleet, (Eds), Library evaluation: A casebook and can-do guide (pp.105-15). Englewood, CO; Libraries Unlimited.

Gers, R., & Seward, L.J. (1985). Improving reference service: Results of a state-wide survey. Library Journal, 110(18), 32-35.

Gilbert, L. M., Liu, M., Matoush, T., & Whitlatch, J. B. (2006). Digital reference and online instructional services in an integrated public/university library. The Reference Librarian, 46(95-96), 149-172.

Gross, M., & Saxton, M. L. (2002). Integrating the imposed query into the evaluation of reference service: A dichotomous analysis of user ratings. Library & Information Science Research, 24, 251-263.

Hernon, P., & Calvert, P. (2005). E-service quality in libraries: Exploring its features and dimensions. Library & Information Science Research, 27, 377-404.

Hernon, P., & McClure, C. R. (1986). Unobtrusive reference testing: The 55 percent rule. Library Journal, 111(7), 37-41.

International Federation of Library Associations (2005). IFLA digital reference guidelines. Retrieved January 5, 2006 from http://www.ifla.org/VII/s36/pubs/drg03.htm

Janes, J. (2002). Digital reference: Reference librarians' experiences and attitudes. Journal of the American Society for Information Science and Technology, 53(7), 549-566.

Kaske, N., & Arnold, J. (2002). An unobtrusive evaluation of online real time library reference services. Retrieved February 20, 2005 from http://www.lib.umd.edu/groups/digref/kaskearnoldunobtrusive.html

Katz, W. A. (2002). Introduction to Reference Work. Vol.II: Reference Services and Reference Processes (8th ed.). New York: McGraw-Hill.

King, V., Nichols, J., & Padilla, G. (2006). Moving back to campus: Creating a local virtual reference service. Internet Reference Services Quarterly, 11(3), 1-17.

Kwon, N. (2004). Assessing the virtual reference success using the revised RUSA guidelines for behavioral performance of reference and information service providers, Proceedings of the 6th Virtual Reference Desk Annual Conference. Cincinnati, OH, November 8, 2004. Retrieved May 15, 2006 from http://www.vrd2004.org/proceedings/kwon.htm

Kwon, N. (2006). User satisfaction with referrals at a collaborative virtual reference service. Information Research, 11(2). Retrieved April, 19, 2005 from http://informationr.net/ir/11-2/paper246.html

Kwon, N. (2007). Public library patrons' use of collaborative chat reference service: The effectiveness of question answering by question type. Library & Information Science Research, 29(1), 70-91

McClure, C., Lankes, R., D., Gross, M., & Choltco-Devlin, B. (2002). Statistics, measures and quality standards for assessing digital library services: Guidelines and Procedures. ERIC Clearinghouse. Retrieved December 22, 2005 from http://quartz.syr.edu/rdlankes/tiki-download_file.php?fileId=7

Pomerantz, J., Lou, L., & McClure, C. R. (2006). Peer review of chat reference transcripts: Approaches and strategies. Library & Information Science Research, 28 (1), 24-48.

Pomerantz, J., Nicholson, S., Belanger, Y., & Lankes, D. (2004). The current state of digital reference: Validation of a general digital reference model through a survey of digital reference services. Information Processing & Management, 40, 347-363.

Radford, M. L. (2006). Encountering virtual users: A qualitative investigation of interpersonal communication in chat reference. Journal of the American Association for Information Science and Technology, 57(8), 1046-1059.

Reference and User Services Association (2004a). Guidelines for behavioral performance of reference and information service providers. Retrieved January 5, 2006 from http://www.ala.org/ala/rusa/rusaprotools/referenceguide/guidelinesbehavioral.htm

Reference and User Services Association (2004b). Guidelines for implementing and maintaining virtual reference services. Retrieved September 20, 2005 from http://www.ala.org/ala/rusa/rusaprotools/referenceguide/virtrefguidelines.htm

Richardson, J. V. (2002). Reference is better than we thought. Library Journal, 127(15), 41-42.

Ronan, J., Reakes, P., & Cornwell, G. (2003). Evaluating online real-time reference in an academic library: Obstacles and recommendations. The Reference Librarian, 79/80, 225-240.

Saxton, M. L., & Richardson, J. V. (2002). Understanding reference transactions: Transforming an art into a science. New York: Academic Press.

Shachaf, P., & Horowitz, S. (2006). Are virtual reference services color blind? Library & Information Science Research, 28(4), 501-520.

Sloan, B. (1998). Electronic reference services: Some suggested guidelines. Reference and Users Services Quarterly, 38(1), 77-81.

Stacy-Bates, K. (2003). E-mail reference responses from academic ARL libraries: An unobtrusive study. Reference and User Services Quarterly, 43(1), 59-70.

Tunon, J., Barsun, R., & Ramiraz, L. L. (2004). Pests, welcomed guests, or tolerated outsiders: Attitudes of academic librarians toward distance students from unaffiliated institutions. Journal of Library Administration, 41(3/4), 485-505.

Ueltschy, L. C., Laroche, M., Tamilia, T. D., & Yannopoulosd, P. (2004). Cross-cultural invariance of measures of satisfaction and service quality. Journal of Business Research, 57(8), 901-912.

Walter, V. A., & Mediavilla, C. (2005). Teens are from Neptune, librarians are from Pluto: An analysis of online reference transactions. Library Trends, 54(2), 209-227.

Ward, D. (2003). Measuring the completeness of reference transactions in online chats; Results of an unobtrusive study. Reference and User Services Quarterly, 44(1), 46-58.

Ward, D. (2005). Why users choose chat?: A survey of behavior and motivations. Internet Reference Services Quarterly, 10(1), 29-46.

White, M. D. (2001). Digital reference services: Framework for analysis and evaluation. Library & Information Science Research, 23, 211-231.

Whitlatch, J. B. (1989). Unobtrusive studies and the quality of academic reference services. College & Research Libraries, 50(2), 181-194.

Whitlatch, J.B. (1990). Reference service effectiveness. Reference Quarterly, 30(2), 205-220

Whitlatch, J. B. (2001). Evaluating reference services in the electronic age. Library Trends, 50(2), 207-217.

Zhuo F., Love, M., Norwood, S., & Massia, K. (2006). Applying RUSA guidelines in the analysis of chat reference transcripts. College & Undergraduate Libraries, 13(1), 75-88

Archive Staff Only: edit this record