Usability evaluation of the South London and Maudsley NHS Trust Library web site

Ebenezer, Catherine Usability evaluation of the South London and Maudsley NHS Trust Library web site., 2002 MSc project thesis, University College, London. [Thesis]


Download (959kB) | Preview

English abstract

A usability evaluation was carried out of the recently-launched South London and Maudsley NHS Trust library web site using a variety of standard methodologies: content and design evaluation of selected comparable sites, focus groups, a questionnaire survey of library and web development staff, heuristic evaluation, observation testing, card sorting/cluster analysis, and label intuitiveness/category membership testing. All test participants were staff of or providers of services to the trust. Demographic information was recorded for each participant. Unsuccessful attempts were made to evaluate user feedback, and to compare usability test results with usage statistics. Test participants’ overall responses to the site were enthusiastic and favourable, indicating the scope and content of the site to be broadly appropriate to the user group. Numerous suggestions for new content areas were made by testers. Usability problems were discovered in two main areas: in the organisation of the site, and in the terminology used to refer to information services and sources. On the basis of test results, proposals for a revised menu structure, improved accessibility, and changes to the terminology used within the site are presented.

Item type: Thesis (UNSPECIFIED)
Keywords: web usability evaluation, library web site, health libraries, clinician information use
Subjects: L. Information technology and library technology
H. Information sources, supports, channels.
B. Information use and sociology of information
Depositing user: Ms Catherine Ebenezer
Date deposited: 20 Sep 2004
Last modified: 02 Oct 2014 11:59


Aitchison, John and Miller, Caroline (2001). Favourite web sites of UK GPs. At [27/07/01]

Alderman, Charlotte (2000). Net results. Nursing Standard 14(42) 27, 29-30

Anderson, Eric S (2001). How to manage the library web site. At [05/08/01]

Anthony, Danielle and Formidoni, Bryan. (2001). Deploying usability testing: simple steps to make sure visitors return to your site. Unix Insider, January 2001. At [05/02/01]

Anthony, Denis (1997). The value of computer networks in nursing. Professional Nurse 12(12) 865-568.

Anthony, Denis (1998). A qualitative analysis of computer networks in the British National Health Service. Nursing Standard 12(43). At [28/06/01]

Anthony, Denis (2000). The Internet “haves” and “have nots” in nursing. Presentation given at Healthcare Computing Conference, Harrogate, March 20-22 2000

Armstrong, C J et al. (2001). A study of the use of electronic information systems by higher education students in the UK. Program 35(3) 241-262.

Armstrong, C J et al. (2000). JISC Usage Surveys: Trends in Electronic Information Services: Strand A: A general survey of end users of all electronic information services:

Strand C: A general survey of electronic information services provision: final report - 1999/2000 cycle.

At [26/08/01]

Barak, A (1999). Psychological applications on the Internet: a discipline on the threshold of a new millennium. Applied and Preventive Psychology 8 231-246. At [28/06/01]

Bawden, David and Robinson, Kay (1997). Information behaviour in nursing specialities: a case study of midwifery. Journal of Information Science 23(6) 407-421

Benjes, Candice and Brown, Janis F (1998). How usable is our web site? Usability tasks. [18/06/01]

Bernstein, Mark (2000). Judging web sites: usability or criticism? At [03/02/01]

Bremer, Jennifer and Beresein, Eugene V (2000). Computers in psychiatry today. Academic Psychiatry 24(3) 168ff.

Campbell, Nicole et al. (1999). Discovering the user: a practical glance at usability testing. Electronic Library 17(5) 307-311

Campbell et al. (2001). Usability assessment methodologies. In Designing for the user: how to test for usability. At [03/02/01]

Cardwell, Catherine and Hunker, Stefanie Dennis (2000). Necessary steps in library web site revision: previewing and beta-testing. In IOLS 2000 proceedings: New York, May 17-18th, 2000. Medford: Information Today, 2000; pp. 23-33

CAST: Center for Applied Special Technology (2000). Bobby. At [08/01/01]

Chen, Hsinchun (1994). Collaborative systems: solving the vocabulary problem. Computer 27(5) 58-66

Christiansen, Tom (2000). Diversity compliance in Web design. At [[10/09/01]

Church, R D et al. (1999). Using the Internet for postgraduate medical education. Hospital Medicine 60(5) 370-371

Clairmont, Michelle et al. (1998). Testing for usability in the design of a new information gateway. Paper presented at Living the Future 2, Tucson, Arizona, April 1998. At [03/03/01]

Clyde, Laurel A (1996). The library as information provider: the home page. Electronic Library 14(6) 549-558

Clyde, Laurel A (2000). A strategic planning approach to Web site management. Electronic Library 18(2) 2000 97-108

Cohen, Laura B and Still, Julie M (1999). A comparison of research university and two-year college library web sites: content, functionality and form. College and Research Libraries 60(3) 275-289

Cottrell, Janet and Eisenberg, Michael B (1997). Web site design for information problem-solving: maximizing value for users. Computers in Libraries May 1997 17(5) 52-57

D’Angelo, John and Little, Sherry (1998). Successful web pages: what are they and do they exist? Information Technology and Libraries 18(4) 210-213

Davis, Francie C (2000). Successful web page design: neither accident nor frill. At [04/08/01]

Davis, Linda M (2000). Effect of systematic usability testing on web site development and facilitation. At [03/02/01]

Dean et al. (1998). Report of the ELAC user survey task force on the electronic library menus. At [10/08/01]

Dean et al. (1999). UW-Madison library web site redesign: old and new web site designs. At [10/08/01]

Degener, Jutta (nd). Dangerous words. At [07/07/01]

Dewey, Barbara I (1999). In search of services: findability of links on CIC university libraries’ web pages. Information Technology and Libraries 18(4) 210-213

Department of Health (1998). Information for Health: an information strategy for the modern NHS 1998-2005: a national strategy for local implementation. London: DoH, 1998. Available on the Web at [28/07/01]

Department of Health (2000). NHS identity guidelines: web sites. At [11/10/00]

Detlefsen, Ellen Gay (1998). The information behaviors of life and health scientists and health care providers: characteristics of the research literature. Bulletin of the Medical Library Association 86(3) 385-390

Dewey, Barbara I (1999). In search of services: analysing the findability of links on CIC university libraries’ web pages. Information Technology and Libraries 18(4) December 210-213

Diaz, Karen (1998). The role of the library web site: a step beyond deli sandwiches. Reference and User Services Quarterly 38(1) 41-43

Dickstein, R and Mills V (2000). Usability testing at the University of Arizona library: how to let the users in on the design. Information Technology and Libraries 19(3). At [09/06/01]

Diller, K et al. (1999). Usability testing web page. At [03/02/01]

Disability Discrimination Act 1995. Chapter 50. London: HMSO. At [24/08/01]

Dong, Jianming et al. (2000). A user input and analysis tool for information architecture. At [27/07/01]

Drezner, Jeffrey L (1998). A study of Internet use by physician treating HIV patients. Medscape HIV/AIDS 4(3). At[04/08/01]

Eskins, Richard (2000). Surfing the sludge: tips on good web page design. Free Pint issue 66. At [01/11/00]

Eysenbach, G and Diepgen, T L (1998). Towards quality management of medical information on the Internet: evaluation, labelling and filtering of information. BMJ 317 1496-1502

Fakhoury, Walid F H and Wright, Donna (2000). Communication and information needs of a random sample of community psychiatric nurses in the United Kingdom. Journal of Advanced Nursing 32(4) 871-880

Farkas, David K and Farkas, Jean B (2000). Guidelines for developing web navigation. Technical Communication 47(3) 341-358

Farmer, Jane et al. (1997). Improving access to information for nursing staff in remote areas: the potential of the Internet and other networked information resources: executive summary. At [25/08/01]

Farmer, Jane and Richardson, Amanda (1997). Information for trained nurses in remote areas: do electronically networked resources provide an answer? Health Libraries Review 14 97-103

Fleck, Evelyn and Levy, Sharon (2000). Internet support for nurses and midwives. Professional Nurse 14(4) 280-282

Fichter, Darlene (2000). Head start: usability testing up front. Online 25(1) 2000 79-81

Fourie, Ina (1999). Creating Web sites in a library and information service environment: some basic guidelines. Mousaion 17(2) 93-113.

Fowler, Susan (1998). Appendix B: usability tests. In GUI design handbook. New York: McGraw-Hill. At [06/02/01]

France, Robert K et al. (1998). Use and usability in a digital library search system. At [25/01/00]

Frederickson-Mele et al. (1998). Evaluating web site structure: a set of techniques. At [09/06/01]

Fuccella, Jeannette and Pizzolato, Jack (1998). Creating Web site designs based on user expectations and feedback. Internetworking 1:1. At [10/08/01]

Gaffney, Gerry (2000). Usability techniques: card sorting. at [2707/01]

Gawande, Atul and Bates, David W (2000). The use of information technology in improving medical performance: part II physician support tools. Medscape General Medicine February 14. At [04/08/01]

Glitz, Beryl (1997). The focus group technique in library research: an introduction. Bulletin of the Medical Library Association, 85:4 385-90

Graber, Mark A et al. (1999). Using the World Wide Web to answer clinical questions: how efficient are different methods of information retrieval? Journal of Family Practice 48(7) 520ff.

Guenther, Kim (1999). Customized data delivery through Web portals: a case study. Online 23(6) 51-56

Gullikson, Shelley et al. (1999). The impact of information architecture on academic web site usability. Electronic Library 17(5) 293-304

Halub, Lisa Parker (1999). The value of Web-based library services at Cedars-Sinai Health System. Bulletin of the Medical Library Association 87(3) 256-259

Harrison, Joy et al. (2001). The impact of access to the World Wide Web on evidence based practice (of nurses and professions allied to medicine). At [04/09/01]

Head, Alison J (1999). Web redemption and the promise of usability. Online 23(6) 21-32

Head, Alison J (2000). Demystifying intranet design: five guidelines for building usable sites. Online 24(4) 36-42

Hennig, Nicole et al. (2001a). MIT Libraries’ web advisory group web redesign February 1999-June 2001. At [10/08/01]

Hennig, Nicole (2001b). Card sorting usability tests of the MIT Libraries' web site: categories from the users' point of view. In Usability Assessment of Library-Related Web Sites: Methods and Case Studies: LITA Guide 7, edited by Nicole Campbell, Chicago: LITA; p. 88-99

Hersh, William R (1998). Applicability and quality of information for answering clinical questions on the Web. JAMA 280(15) 1307-1308

Hester, Nolan (1999). FrontPage for Windows 2000 visual quickstart guide. Berkeley, CA: Peachpit Press.

Hobson, Geoff (2000). HTML notes: Workshop 2.4 Horizontal lines, icons and other graphical images. At [24/08/01]

Holden G, Rosenberg G, and Meenaghan T (2000). Information for social work practice: observations regarding the role of the World Wide Web. Social Work in Health Care 32(1) 1-8

Houghton, David (2000). Building an academic library website: experiences at De Montfort University. Program 34(3) 269-269

Huang, Milton P and Alessi, Norman E (1996). The Internet and psychiatry. American Journal of Psychiatry 153(7) 861-869

Huang, Milton P and Alessi, Norman E (1999). Clinical computing: challenges of the World Wide Web. Psychiatric Services 50 483-491

IBM (2001). IBM ease of use guidelines: text. At [24/08/01]

Instone, Keith. Usable Web. At

Instone, Keith (1997a). Usability engineering for the Web. World Wide Web Journal 2(1). At [18/06/01]

Instone, Keith (1997b). Site usability heuristics for the Web. WebReview October 10th. At [09/08/01]

Instone, Keith (1997c). User test your web site. WebReview April 25th. At [09/08/01]

Instone, Keith (1997d). Site usability evaluation. WebReview October 10th. At [09/08/01]

Jadad, Alejandro and Gagliardi, Anna (1998). Rating health information on the Internet: navigating to knowledge or Babel? JAMA 279(8) 611-614

Jadad, Alejandro (1999). Promoting partnerships: challenges for the internet age. BMJ 319 761-764

Jadad, Alejandro et al. (2000). The Internet and evidence-based decision making: a needed synergy for efficient knowledge management in health care. Canadian Medical Association Journal 162(3) 362-365

de Jong, Menno and van der Geest, Thea (2000). Characterising web heuristics. Technical Communication 47(3) 311-326

Jordaan, Marieke and Jones, Richard (1999). Adoption of Internet technology by UK postgraduate medical centres. Health Libraries Review 16 166-173

Kaiser, Jean (2001). Criteria for web site evaluation. At [08/08/01]

Kalbach, James (2000). Designing for information foragers: a behavioural model for information seeking on the World Wide Web. Internetworking 3(3). At [14/08/01]

Kelly, Brian (2000b). Performance indicators for web sites. Exploit Interactive 5 January 2001. At [20/01/01]

Kelly, Brian (2000a) Software in use: externally-hosted web statistics services. Exploit Interactive, 5, April 2000. At [06/02/01]

Klein, Leo Robert (2000). Web design and sin. Library Journal Summer 2000. At http://www.libraryjourna/com/klein.asp [24/10/00]

Kramer, Thomas and Kennedy, Robert (1998). Useful websites for psychiatrists. Academic Psychiatry 22(2) 141f.

Lambeth, Southwark and Lewisham HA (2000). Full local implementation strategy (LIS). At [08/08/01]

Laszig, Parfen (2000). Psychoanalysis goes online—psychoanalytic resources on the Internet. Social Science Computer Review 18(2) 160-165

Lee, Alfred T (1998). Web usability: a brief review of the research. At [11/06/01]

Levi, Michael D and Conrad, Frederick G (1998). Usability testing of World Wide Web sites. At [03/02/01]

Lim, Russell F (1996). The Internet: applications for mental health clinicians in clinical settings, training and research. Psychiatric Services 47(6) 597-599

McCauley, Kym (2001). Information architecture: building to have clients, or having clients to build? LASIE 32(1) 7-18

McCready, Kate (1997). Designing and redesigning: Marquette libraries’ web site. Library Hi Tech 15(3/4) 83-89

McGillis, Louise and Toms, Elaine G (2001). Usability of the academic library web site: implications for design. College and Research Libraries 62 355-367

McKnight, M and Peet, M (2000). Health care providers' information seeking: recent research. Medical Reference Services Quarterly 19(2) 27-50

McMullen, Susan (2000). Usability testing and library web site redesign at Roger Williams University. At [03/02/01]

McMullen, Susan (2001). Usability testing in a library web site redesign project. Reference Services Review 29 (1): 7-22

McMurdo, George (1998). Evaluating Web information and design. Journal of Information Science 24(3) 192-204

Marmion, Dan (2001). Library web page design: are we doing it right? Information Technology and Libraries 20(1) 2-3

Marques, S (1999). Web site design for librarians. At [14/10/00]

Matylonek, John (1999). Cluster analysis in Web design: presentation given at the ASIS PNC Bridging the gap: innovations in information services conference, September 17-18. At[28/08/01]

Misic, Mark M and Johnson, Kelsey L (1999). Benchmarking: a tool for web site evaluation and improvement. Internet Research: Electronic Networking Applications and Policy 9(5) 383-392

Mitchell, W Bede et al. (2001). Testing the design of a library information gateway. Paper presented at the Association of College and Research Libraries 10th national conference, March 15-18, Denver, Colorado. At [09/08/01]

Monash (2001). Monash University ITS usability workshop. At [08/09/01]

Moffat, Malcolm O, Moffat, Katrina J, and Cano, Virginia (2001). General practitioners and the internet - a questionnaire survey of internet connectivity and use in Lothian. Health Bulletin (59)2. At [02/08/01]

Murray, George and Costanzo, Tania (1999). Usability and the Web: an overview. National Library of Canada Network Notes 61. At http://collection.nlc-bnc/00/201/301/netnotes/netnotes-h/notes61.htm [09/08/01]

NHS Executive Information Policy Unit (1999). Full LIS implementation guidance. At ttp:// [28/07/01]

NHS Executive Information Policy Unit (2001). Building the information core. London: NHSE, 2001

Naismith, Rachael and Stein, Joan (1989). Library jargon: student comprehension of technical language used by librarians. College and Research Libraries 50 543-552

Nicotera, Cynthia L (1999). Information access by design: electronic guidelines for librarians. Information Technology and Libraries 18(2) 104-108

Nielsen, Jakob (1994a). How to conduct a heuristic evaluation. At [09/08/01]

Nielsen, Jakob (1994b). Ten usability heuristics. At [09/08/01]

Nielsen, Jakob (1997). User interface design for the WWW. At [05/08/01]

Nielsen, Jakob. AlertBox. At

Nielsen, Jakob (2000a). Designing web usability. Indianapolis: New Riders Press.

Nielsen, Jakob (2000b). Why you only need to test with five users. At [09/06/01]

Nielsen, Jakob (2001a). Search: visible and simple. At [25/07/01]

Nielsen, Jakob (2001b). Usability metrics. At [11/06/01]

NIST (2001). Web metrics home page. At [14/08/01]

Obst, Oliver (1998). Use of Internet resources by German medical professionals. Bulletin of the Medical Library Association 86(4) 528-533

Orna, Liz (1992). Information design and information services: what information professionals should know about design, in order to deliver value-added information products. Aslib Proceedings 44(9) 305-308

Osorio, Nestor (2001). Web sites of science-engineering libraries: an analysis of content and design. Issues in Science and Technology Librarianship Winter 2001. At [04/03/01]

Palmer, Katherine (1999). Signposts to information for community mental health workers: a research project funded by the South and West Health Care Libraries Unit. Bournemouth: Bournemouth University Library and Information Services.

Pothen, Philip (2001). Is ICT worth the money? Library Association Record 103(9) 556-557

Prown, Sarah (1999). Detecting broke. At [03/02/01]

PSL (1998). Global survey points to increasing use of Internet by physicians. At [27/07/01]

Quintana, Yuri and Bardyn, Tania (1996). Evaluating health libraries on the World Wide Web: design guidelines and future development. Biblioteca Medica Canadiana 18(2) 61-64. Also at [11/06/01]

Ray, Kathleen and Day, Joan (1998). Student attitudes towards electronic information resources. Information Research 4(2). At [04/09/01]

Raymond, Eric S (2001). Welcome to the HTML hell page. At [07/07/01]

Rhodes, John (2001). Usability metrics. At [07/09/01]

Ribbons, Robert M (1998). Practical [Internet] applications in nurse education. Nurse Education Today 18 413-418

Robertson, James (2001). Information design using card sorting. At [10/08/01]

Roscoe, Trefor (1998). Two surveys of Internet use in primary care. Health Information on the Internet 3 2-3

Rozic-Hristovski, Anamarija et al. (1999). Developing a medical library website at the University of Ljubljana, Slovenia. Program 33(4) 313-325

Royal Society of Medicine (2000). Survey of RSM members’ internet use. At [28/06/01]

Schnell, Eric H (2001). Writing for the web: a primer for librarians. At [05/08/01]

Senior, C et al. (1997). Psychiatry and the WWW: some implications. Psychiatric Bulletin 71(775-778)

SitePoint. At [10/08/01]

Smart, Laura et al. (1999). Anatomy of a more usable design: UCSD libraries include audience perspective in web site development process. At [03/09/01]

Smith, R (1996). What clinical information do doctors need? BMJ 313 1062-1068

Snow, Rosamund (2001). Do doctors use the Internet? An RSM survey. Health Information on the Internet 19 10-11 At [28/07/01]

South Thames Libraries (1998). STELLA. [28/07/01]

Sowards, Steven W (1998). A typology for ready reference web sites in libraries. First Monday 3(5). At [31/08/01]

Spivey, Mark A (2000). The vocabulary of library home pages: an influence on diverse and remote end-users. Information Technology and Libraries 19(3)151-156

Spool, Jared M (1998). Web site usability: a designer’s guide. San Francisco: Morgan Kaufmann

Spool, Jared M (2001). The usability of usability. At [24/08/01]

StepTwo (2001). Information design using card sorting. At [31/07/01]

Stewart, Alan (1999). Creating your own medical Internet library. Canadian Medical Association Journal 161(9) 1155-1160

Stover, Mark and Zink, Steven D (1996). World Wide Web home page design: patterns and anomalies of higher education library home pages. Reference Services Review 24(3) 7-20

Stover, Mark (1997). The mission and role of the library web site. At [28/06/01]

Tannery, Nancy H (1998). Academic medical center libraries on the Web. Bulletin of the Medical Library Association 86(4) 541-543.

Tantam, Digby (2001). A guide to the internet for psychotherapists. Psychiatric Bulletin 25(1) 29-30

Tennant, Roy (1999). User interface design: some guiding principles. Library Journal October 15. At [16/10/00]

Thovtrup, Henrik and Nielsen, Jakob (1991). Assessing the usability of a user interface standard. At [24/08/01]

Tillett, L Scott (2000). “A 24-hour focus group”: sites dig into search queries to learn customer preferences. InternetWeek April 7th. At [08/08/01]

Tognazzini, Bruce (nd.). First principles. At [09/08/01]

University of Toronto (2001). A-Prompt project. At [10/09/01] (2001a). Research-based web design and usability guidelines. At [10/08/01] (2001b). Methods for designing usable web sites. At [14/08/01] At [10/08/01]

Valentine, Barbara (1993). Undergraduate research behaviour: using focus groups to generate theory. Journal of Academic Librarianship 19(5) 300-304

Veldof, Jerilyn et al. (1999a). Chauffeured by the user: usability in the digital library. Journal of Library Administration 26(3/4) 115-140

Veldof, Jerilyn (1999b). Build it right: user centered design for library tutorials and home pages: invited session for WILSWorld 1999 Conference in Madison, Wisconsin (June 7, 1999). At [3/3/01]

Veldof, Jerilyn. (2000). Building user-centered library web sites on a shoestring. Presentation given at WILS World, 2000 [PowerPoint presentation]. At [3/3/01]

Ward, Rod and Haines, Maresah (1998). Don’t get left behind—get online. Practice Nurse 16 164-166

Ward, Rod (2000). Nurses’ net needs. Health Informatics Journal 6 196-203

Web Developer’s Virtual Library. At [05/08/01]

Web Design Group. At [05/08/01] At [05/08/01] At [07/09/01]

Welch, Jeanie M (2000). Chaos or control freaks? Academic library web site evaluation and management. . IOLS 2000 proceedings: New York, May 17-18th, 2000. Medford: Information Today, 2000; pp. 167-181

Westberg, Edward E and Miller, Randolph A (1999). The basis for using the Internet to support the information needs of primary care. Journal of the American Medical Informatics Association 6(1) 6-25

Whalen, Jan (1996). A study of library web sites. At [31/08/01]

World Wide Web Consortium (W3C). At [05/08/01]

Wyatt, Jeremy C (1997). Commentary: measuring quality and impact of the world wide web. BMJ 314(7098)1879-1881. At [28/07/01]

Yeoman, Alison, et al. (2001). The value and impact of virtual outreach services: report of the VIVOS project Aberystwyth: DIL, University of Wales, Aberystwyth At [20/09/04]

Young, Vicki (1993). Focus on focus groups. College and Research Libraries News 54(7)1993 391-394


Downloads per month over past year

Actions (login required)

View Item View Item