To Pre-filter, or Not to Pre-filter, That Is the Query: A Multi-Campus Big Data Study

Cribbs, Heather L. and Gardner, Gabriel To Pre-filter, or Not to Pre-filter, That Is the Query: A Multi-Campus Big Data Study. Journal of Librarianship and Information Science, 2022. [Journal article (Unpaginated)]

[thumbnail of Cribbs_Gardner_2022_JoLIS_postprint.pdf]
Preview
 Text
Cribbs_Gardner_2022_JoLIS_postprint.pdf - Accepted version
Available under License Creative Commons Attribution.
Download (1MB) | Preview

English abstract

Library discovery platforms, which provide searchable user interfaces as their front-facing layer, aggregate tremendous amounts of metadata from multiple data streams describing a wide variety of print and electronic resources. Complicating the matter further, resources may differ in availability or delivery time depending not only on their media but also upon the source of the data stream describing them. How should libraries structure end users' options for searching discovery platforms in light of the many options available? This study used a nonexperimental design and quantitative methods to analyze users' revealed preferences for query type in twenty-four academic libraries in a data set containing metadata, sans queries, for over 64 million searches. Libraries studied were all located in California, used the same discovery layer software, and served similar user and faculty constituencies; however, the number of query types and pre-filtering options available differed between institutions. Results show that, when users were presented with the choice between search options, most conducted simple, more broad searches rather than complex and specific searches. When search options were highly constrained by the default choice architecture, but complex searches were possible, few users opted out of the default simple search. Implications for usability of discovery layers and the motivations of librarians in choice architecture are nontrivial and are discussed. The desires of librarians and "power user" faculty must be balanced with the fact that most users are novices and users of all abilities are largely habituated to commercial search products which emphasize post-search results filtering.

Item type: Journal article (Unpaginated)
Keywords: discovery, Primo, user search behavior, UX, academic libraries, consortia
Subjects: C. Users, literacy and reading. > CA. Use studies.
H. Information sources, supports, channels. > HQ. Web pages.
L. Information technology and library technology > LR. OPAC systems.
Depositing user: Gabriel Gardner
Date deposited: 03 Oct 2022 15:32
Last modified: 03 Oct 2022 15:32
URI: http://hdl.handle.net/10760/43595

References

Adams AL and Hanson M (2020) Primo on the Go: A Usability Study of the Primo Mobile Interface. Journal of Web Librarianship 14(1–2). Routledge: 1–27. DOI: 10.1080/19322909.2020.1784820.

Ahmed SMZ, McKnight C and Oppenheim C (2009) A review of research on human-computer interfaces for online information retrieval systems. The Electronic Library 27(1): 96–116. DOI: 10.1108/02640470910934623.

Al-Qallaf CL and Ridha A (2019) A Comprehensive Analysis of Academic Library Websites: Design, Navigation, Content, Services, and Web 2.0 Tools. International Information & Library Review 51(2): 93–106. DOI: 10.1080/10572317.2018.1467166.

Breeding M (2014) Web-Scale Discovery Services. American Libraries, 1 February.

https://americanlibrariesmagazine.org/2014/01/14/web-scale-discovery-services/

Chapman S, Fry A, Deschenes A, et al. (2016) Strategies to Improve the User Experience. Serials Review 42(1): 47–58. DOI: 10.1080/00987913.2016.1140614.

Dease N, Villaespesa E and MacDonald CM (2020) Working together: Using student-driven UX projects to improve library websites. College & Undergraduate Libraries 27(2–4): 397–419. DOI: 10.1080/10691316.2021.1888838.

Ex Libris (2016) Performing Basic Searches. Available at: https://knowledge.exlibrisgroup.com/Primo/Product_Documentation/Primo/End_User_Help__New_UI/010Performing_Basic_Searches (accessed 1 March 2022).

Ex Libris (2017) Blank Search Scope Type in Primo Analytics. Available at: https://knowledge.exlibrisgroup.com/Primo/Knowledge_Articles/Blank_Search_Scope_Type_in _Primo_Analytics (accessed 5 October 2021).

Ex Libris (2019) Primo Action Usage. Available at: https://knowledge.exlibrisgroup.com/Primo/Product_Documentation/Primo/Analytics/Primo_A nalytics_Subject_Areas/Primo_Action_Usage (accessed 5 October 2021).

Fidel R, Pejtersen AM, Cleal B, et al. (2004) A Multidimensional Approach to the Study of Human Information Interaction: A Case Study of Collaborative Information Retrieval. Journal of the American Society for Information Science and Technology 55(11): 939–953. DOI: 10.1002/asi.20041.

Fu Y, Lomas E and Inskip C (2021) Library log analysis and its implications for studying online information seeking behavior of cultural groups. The Journal of Academic Librarianship 47(5): 1–11. DOI: 10.1016/j.acalib.2021.102421.

Galbreath BL, Johnson C and Hvizdak E (2018) Primo New User Interface: Usability Testing and Local Customizations Implemented in Response. Information Technology & Libraries 37(2): 10–35. DOI: 10.6017/ital.v37i2.10191.

Gilmore T, Metko S and Gilbert C (2017) Sailing the Wide-Open Seas of Discovery: Assessing Students’ Use and Perceptions of Summon for Conducting Research. In: At the Helm: Leading Transformation: The Proceedings of the ACRL 2017 Conference, Baltimore, MD, 22 March 2017, pp. 544–557. Association of College and Research Libraries. Available at: http://www.ala.org/acrl/sites/ala.org.acrl/files/content/conferences/confsandpreconfs/2017/Sa ilingtheWide-OpenSeasofDiscovery.pdf (accessed 21 March 2017).

Greenberg R and Bar-Ilan J (2017) Library metrics – studying academic users’ information retrieval behavior: A case study of an Israeli university library. Journal of Librarianship and Information Science 49(4): 454–467. DOI: 10.1177/0961000616640031.

Guo J, Fan Y, Pang L, et al. (2020) A Deep Look into neural ranking models for information retrieval. Information Processing & Management 57(6): 1–20. DOI: 10.1016/j.ipm.2019.102067.

Gusenbauer M and Haddaway NR (2020) Which Academic Search Systems Are Suitable for Systematic Reviews or Meta-analyses? Evaluating Retrieval Qualities of Google Scholar, PubMed, and 26 Other Resources. Research Synthesis Methods 11(2): 181–217. DOI: 10.1002/jrsm.1378.

Hamlett A and Georgas H (2019) In the Wake of Discovery: Student Perceptions, Integration, and Instructional Design. Journal of Web Librarianship 13(3): 230–245. DOI: 10.1080/19322909.2019.1598919.

Hsieh-Yee I (1993) Effects of search experience and subject knowledge on the search tactics of novice and experienced searchers. Journal of the American Society for Information Science 44(3): 161– 174. DOI: 10.1002/(SICI)1097-4571(199304)44:3<161::AID-ASI5>3.0.CO;2-8.

Hsieh-Yee I (2001) Research on Web search behavior. Library & Information Science Research 23(2): 167–185. DOI: 10.1016/S0740-8188(01)00069-X.

Hu PJ-H, Ma P-C and Chau PYK (1999) Evaluation of user interface designs for information retrieval systems: a computer-based experiment. Discovery Support Systems 27(1–2): 125–143. DOI: 10.1016/S0167-9236(99)00040-8.

Huvilla I, Enwald H, Eriksson-Backa K, et al. (2022) Information behavior and practices research informing information systems design. The Journal of the Association for Information Science and Technology 73(7): 1043–1057. DOI: 10.1002/asi.24611.

Indiana University Center for Postsecondary Research (2018) Carnegie Classifications 2018 public data file. Indiana University Center for Postsecondary Research. Available at: http://carnegieclassifications.iu.edu/downloads/CCIHE2018-PublicDataFile.xlsx (accessed 22 January 2022).

Kelly D and Sugimoto CR (2013) A Systematic Review of Interactive Information Retrieval Evaluation Studies, 1967–2006. Journal of the American Society for Information Science and Technology 64(4): 745–770. DOI: 10.1002/asi.22799.

Kliewer G, Monroe-Gulick A, Gamble S, et al. (2016) Using Primo for undergraduate research: a usability study. Library Hi Tech 34(4): 566–584. DOI: 10.1108/LHT-05-2016-0052.

Li Y and Liu C (2019) Information Resource, Interface, and Tasks as User Interaction Components for Digital Library Evaluation. Information Processing & Management 56(3): 704–720. DOI: 10.1016/j.ipm.2018.10.012.

Lopatovska I and Arapakis I (2011) Theories, methods and current research on emotions in library and information science, information retrieval and human–computer interaction. Information Processing & Management 47(4): 575–592. DOI: 10.1016/j.ipm.2010.09.001.

Lowe MS, Maxson BK, Stone SM, et al. (2018) The Boolean is Dead, Long Live the Boolean! Natural Language versus Boolean Searching in Introductory Undergraduate Instruction. College & Research Libraries 79(4): 517–534. DOI: 10.5860/crl.79.4.517.

Lowe MS, Stone SM, Maxson BK, et al. (2020) Boolean redux: Performance of advanced versus simple boolean searches and implications for upper-level instruction. The Journal of Academic Librarianship 46(6): 102234. DOI: 10.1016/j.acalib.2020.102234.

Muglia C and Namei ES (2017) Academic Libraries, Filtering, and the “Tyranny of Choice”. In: At the Helm: Leading Transformation: The Proceedings of the ACRL 2017 Conference, Baltimore, MD, 22 March 2017, pp. 1–14. Association of College and Research Libraries. Available at: http://www.ala.org/acrl/sites/ala.org.acrl/files/content/conferences/confsandpreconfs/2017/A cademicLibrariesFilteringandtheTyrannyofChoice.pdf (accessed 28 March 2017).

Naghib F, Mirzabeigi M and Alborzi M (2020) The role of spatial intelligence in predicting web information searching behavior and performance of high school students. Library Hi Tech 39(1): 48–63. DOI: 10.1108/LHT-07-2019-0139.

Namei ES and Young CA (2015) Measuring Our Relevancy: Comparing Results in a Web-Scale Discovery Tool, Google & Google Scholar. In: Creating sustainable community: The Proceedings of the ACRL 2015 Conference, Portland, OR, 25 March 2015, pp. 522–535. Association of College and Research Libraries. Available at: http://www.ala.org/acrl/sites/ala.org.acrl/files/content/conferences/confsandpreconfs/2015/N amei_Young.pdf (accessed 28 March 2017).

Ndumbaro F (2018) Understanding user-system interactions: An analysis of OPAC users’ digital footprints. Information Development 34(3): 297–308. DOI: 10.1177/0266666917693885.

Pickard E and Desilets MR (2020) Accidental Information Literacy Instruction: The Work a Link Landing Page Can Do. Scholarship of Teaching and Learning, Innovative Pedagogy 2(1): 16–27. https://digitalcommons.humboldt.edu/sotl_ip/vol2/iss1/2/

Porat L and Zinger N (2018) Primo New User Interface—Not Just for Undergrads: A Usability Study. Journal of Library User Experience 1(9): 1–17. DOI: 10.3998/weave.12535642.0001.904.

Reidsma M (2019) Masked by Trust: Bias in Library Discovery. Sacramento, CA: Litwin Books.

Ruiz M, Harris C and Worden L (2022) Re: Curiously High Advanced Search Usage in Primo at CI. [Personal Communication].

Russell-Rose T, Chamberlain J and Azzopardi L (2018) Information retrieval in the workplace: A comparison of professional search practices. Information Processing & Management 54(6): 1042–1057. DOI: 10.1016/j.ipm.2018.07.003.

Sanchiz M, Chin J, Chevalier A, et al. (2017) Searching for information on the web: Impact of cognitive aging, prior domain knowledge and complexity of the search problems. Information Processing & Management 53(1): 281–294. DOI: 10.1016/j.ipm.2016.09.003.

Scarnò M (2012) User’s behaviour inside a digital library. In: Zaraté P (ed.) Integrated and Strategic Advancements in Decision Making Support Systems. Hershey, PA: IGI Global, pp. 138–146. DOI: 10.4018/978-1-4666-1746-9.ch011.

Swanson DR (1977) Information Retrieval as a Trial-And-Error Process. The Library Quarterly: Information, Community, Policy 47(2): 128–148. DOI: 10.1086/620653.

Tella A, Anyim O, Memudu SA, et al. (2017) Predictors of Information Retrieval Effectiveness among Library and Information Science Undergraduates in Kwara State Universities. Library Philosophy and Practice: 1–21. https://digitalcommons.unl.edu/libphilprac/1626/

Vargas Ochoa I (2020) Navigation Design and Library Terminology: Findings from a User-Centered Usability Study on a Library Website. Information Technology & Libraries 39(4): 1–15. DOI: 10.6017/ital.v39i4.12123.

Wells D (2016) Library Discovery Systems and their Users: a Case Study from Curtin University Library. Australian Academic & Research Libraries 47(2): 92–105. DOI: 10.1080/00048623.2016.1187249.

Xu F and Du JT (2018) Factors influencing users’ satisfaction and loyalty to digital libraries in Chinese universities. Computers in Human Behavior 83: 64–72. DOI: 10.1016/j.chb.2018.01.029.

Zavalina O and Vassilieva EV (2014) Understanding the Information Needs of Large-Scale Digital Library Users. Library Resources & Technical Services 58(2): 84–99. DOI: 10.5860/lrts.58n2.84.

Zhang T (2013) User-Centered Evaluation of a Discovery Layer System with Google Scholar. In: Marcus A (ed.) Design, User Experience, and Usability. Web, Mobile, and Product Design. Lecture Notes in Computer Science. Berlin, Heidelberg: Springer, pp. 313–322. DOI: 10.1007/978-3-642-392535_34.


Downloads

Downloads per month over past year

Actions (login required)

View Item View Item
Contact us
Send email Sponsors
Sponsor: AIMS Sponsor: D&P Sponsor: UniNa CAB Get connected
Facebook Facebook Twitter Twitter Linkedin LinkedIn RSS RSS