Evidence Based Practice Using Formative Assessment in Library Research Support

Wolstenholme, Jackie Evidence Based Practice Using Formative Assessment in Library Research Support. Evidence Based Library and Information Practice, 2015, vol. 10, n. 3, pp. 4-29. [Journal article (Paginated)]

[img] Text
Wolstenholme 2015 EBLIP.pdf - Accepted version

Download (864kB)

English abstract

Objective: The purpose of this study was to develop and review the effectiveness of a new evidence-based approach for teaching library research support. Methods: Formative assessment, through two variations of the One Minute Paper model, is used to poll the experiences of university researchers in library research support sessions. Prior to a session, Polling One Minute Papers (POMPs) assess what researchers know about topics that will be covered in the session. After a session, Reflective One Minute Papers (ROMPs) review whether university researchers achieved the intended learning outcomes of the session. POMPs were used for 16 sessions and ROMPs were used for a subset of 11 of these sessions. Examples of responses from the POMPs and ROMPs were presented to describe and analyse the effectiveness of this approach for library support of research. Results: OMP and ROMP responses were remarkably informative given their simplicity and the little effort required on the part of the instructing librarian or researchers. The completion rate of POMPs was 72.7%. They gave researchers the opportunity to self-assess their current level of knowledge or skills about the topic to be covered in the upcoming session. The librarian could then tailor the session content to this level of knowledge. POMP responses were shared as part of the session content, enabling researchers to benchmark themselves against their peers. Completion rate of ROMPs was 20.9%, with the level of reflection in the individual researchers' responses varying from shallow to insightful. Deeper responses stated how the researchers would use what they learned or pose new questions which emerged from their learning. Conclusion: Polling One Minute Papers (POMPs) and Reflective One Minute Papers (ROMPs) are an effective and efficient approach for guiding the learning of researchers and closing the feedback loop for librarians. These tools extend the opportunity for librarians to engage with researchers and, through tailoring of session content, assist to maximise the benefit of library research support sessions for both librarians and researchers. Sharing of POMP and ROMP responses can assist librarians to coordinate the teaching of the researchers that they support. At an institutional level, evidence in POMPs and ROMPs can be used to demonstrate the value that the library has contributed to improving awareness and performance of its researchers.

Item type: Journal article (Paginated)
Keywords: library research support, academic librarianship, researchers, teaching, formative assessment, One Minute Paper, Polling One Minute Paper, POMP, Reflective One Minute Paper, ROMP
Subjects: C. Users, literacy and reading. > CD. User training, promotion, activities, education.
C. Users, literacy and reading. > CE. Literacy.
Depositing user: Dr Jacqueline Wolstenholme
Date deposited: 10 Feb 2016 09:31
Last modified: 10 Feb 2016 09:31
URI: http://hdl.handle.net/10760/28747

References

Association of College and Research Libraries. (2010). The value of academic libraries: a comprehensive research review and report. Researched by Megan Oakleaf. Chicago: Association of College and Research Libraries. Retrieved from http://www.acrl.ala.org/value/page_id=21

Auckland, M. (2012). Re-skilling for research - An investigation into the role and skills of subject and liaison librarians required to effectively support the evolving information needs of researchers. Retrieved from http://www.rluk.ac.uk/files/RLUK%20Re-skilling.pdf

Australian Research Council. (2014). Excellence in Research for Australia (ERA). Retrieved from http://www.arc.gov.au/era/default.htm

Bartlett, M. G., & Morrow, K. A. (2001). Method for assessing course knowledge in a large classroom environment: an improved version of the minute paper. American Journal of Pharmaceutical Education, 65(3), 264-267.

Beall, J. (2014). Scholarly Open Access: critical analysis of scholarly open-access publishing. Retrieved from http://scholarlyoa.com/

Boud, D. (2000). Sustainable assessment: rethinking assessment for the learning society. Studies in Continuing Education, 22(2), 151-167. http://dx.doi.org/10.1080/713695728

Boud, D., & Lee, A. (2005). ‘Peer learning’ as pedagogic discourse for research education. Studies in Higher Education, 30(5), 501-516. http://dx.doi.org/10.1080/03075070500249138

Brodie, L. (2012). Problem-based learning. In L. Hunt & D. Chalmers (Eds.), University teaching in focus: A learning-centred approach. Hoboken: Taylor and Francis.

Chizmar, J. F., & Ostrosky, A. L. (1998). The one-minute paper: Some empirical findings. The Journal of Economic Education, 29(1), 3-10. http://dx.doi.org/10.1080/00220489809596436

Choinski, E., & Emmanuel, M. (2006). The one-minute paper and the one-hour class: Outcomes assessment for one-shot library instruction. Reference Services Review, 34(1), 148-155. http://dx.doi.org/10.1108/00907320610648824

Creaser, C., & Spezi, V. (2013). Improving perceptions of value to teaching and research staff: The next challenge for academic libraries. Journal of librarianship and information science, 46(3), 191-206. http://dx.doi.org/10.1177/0961000613477678

Crisp, G. (2009). Designing and using e-assessments. Milperra, NSW: Higher Education Research and Development Society of Australasia.

Department of Education. (2014). Higher Education Research Data Collection (HERDC). Retrieved from http://education.gov.au/higher-education-research-data-collection

Dillman, D. A., Smyth, J. D., & Christian, L. M. (2009). Internet, mail, and mixed-mode surveys: The tailored design method. New Jersey: Wiley.

Dobson, J. L. (2008). The use of formative online quizzes to enhance class preparation and scores on summative exams. Advances in Physiology Education, 32, 297-302. http://dx.doi.org/10.1152/advan.90162.2008

Draper, S. W. (2009). Catalytic assessment: understanding how MCQs and EVS can foster deep learning. British Journal of Educational Technology, 40(2), 285-293. http://dx.doi.org/10.1111/j.1467-8535.2008.00920.x

Drew, S., & Klopper, C. (2014). Evaluating faculty pedagogic practices to inform strategic academic professional development: A case of cases. Higher education, 67(3), 349-367. http://dx.doi.org/10.1007/s10734-013-9657-1

Drummond, G. (2007). Programme feedback: It only takes a minute! International Journal of Educational Management, 21(1), 29-36. http://dx.doi.org/10.1108/09513540710716803

Dunaway, M. K., & Orblych, M. T. (2011). Formative assessment: transforming information literacy instruction. Reference Services Review, 39(1), 24-41. http://dx.doi.org/10.1108/00907321111108097

Frances, M., Fletcher, J., & Harmer, S. (2011). Reshaping and rescoping university libraries to fit changing academic requirements. Paper presented at the 32nd IATUL Annual Conference: Libraries for An Open Environment: strategies, technologies and partnerships, Warsaw, Poland. Retrieved from http://www.bg.pw.edu.pl/iatul2011/proceedings/ft/Frances_M.pdf

Google. (2014). Create a survey using Google forms. Retrieved from http://support.google.com/drive/answer/87809?hl=en

Guest, G., MacQueen, K. M., & Namey, E. E. (2012). Applied thematic analysis. Los Angeles: SAGE Publications.

Haddow, G. (2012). Research support in a research assessment environment: The experience of 'new' universities. Library and information research, 36(113), 62-80.

Hoppenfeld, J. (2012). Keeping students engaged with web-based polling in the library instruction session. Library Hi Tech, 30(2), 235-252. http://dx.doi.org/10.1108/07378831211239933

Hughes, H., & Bruce, C. (2012). Informed learning in online environments: Supporting the higher education curriculum beyond Web 2.0. In P. P. Godwin & J. Parker (Eds.), Information literacy beyond library 2.0 (pp. 65-79). London: Facet.

James Cook University. (2014). Facts & figures 2014: Data snapshot. Retrieved from http://www.jcu.edu.au/about/public/groups/everyone/documents/annual_report/jcu_140345.pdf

James Cook University. (2015). About JCU: Strategic intent. Retrieved from http://www.jcu.edu.au/about/strategic-intent/

Kaufman, P. T. (2009). Carpe Diem: Transforming services in academic libraries. In IDEALS. Retrieved from http://www.ideals.illinois.edu/handle/2142/12032

Kennan, M. A., Cole, F., Willard, P., Wilson, C., & Marion, L. (2006). Changing workplace demands: What job ads tell us. Aslib proceedings: New information perspectives, 58(3), 179-196. http://dx.doi.org/10.1108/00012530610677228

Kennan, M. A., Corrall, S., & Afzal, W. (2014). "Making space" in practice and education: Research support services in academic libraries. Library Management, 35(8/9), 666-683. http://dx.doi.org/10.1108/LM-03-2014-0037

Knowles, M. S. (1975). Self-directed learning: a guide for learners and teachers. Englewood Cliffs, N.J.: Cambridge Adult Education.

Kolb, D. A. (1984). Experiential learning: experience as the source of learning and development. Upper Saddle River, NJ: Prentice-Hall.

Merriam, S. B. (2001). Andragogy and self-directed learning: Pillars of adult learning theory. New directions for adult and continuing education, 2001(89), 3-13. http://dx.doi.org/10.1002/ace.3

Oakleaf, M. (2009). The information literacy instruction assessment cycle: A guide for increasing student learning and improving librarian instructional skills. Journal of documentation, 65(4), 539-560. http://dx.doi.org/10.1108/00220410910970249

Oakleaf, M. (2014). A roadmap for assessing student learning using the new framework for information literacy for higher education. The Journal of Academic Librarianship, 40(5), 510-514. http://dx.doi.org/10.1016/j.acalib.2014.08.001

Parker, R. (2012). What the library did next: Strengthening our visibility in research support. Paper presented at eM-powering eFutures, the 16th Biennial VALA Conference and Exhibition, Melbourne, Victoria, Australia. Retrieved from http://hdl.handle.net/1959.3/214486

Parsons, A. (2010). Academic liaison librarianship: Curatorial pedagogy or pedagogical curation? Ariadne, 65, 1-11. Retrieved from http://www.ariadne.ac.uk/issue65/parsons/

Priem, J., Taraborelli, D., Groth, P., & Neylon, C. (2010). Altmetrics: A manifesto. Retrieved from http://altmetrics.org/manifesto/

REF2014. (2014). REF2014: Research Excellence Framework. Retrieved from http://www.ref.ac.uk/

Richards, L. (2015). Handling qualitative data: A practical guide (3rd ed.). Los Angeles: SAGE Publications.

Richardson, J., Nolan-Brown, T., Loria, P., & Bradbury, S. (2012). Library research support in Queensland: a survey. Australian Academic & Research Libraries, 43(4), 258-277. http://dx.doi.org/10.1080/00048623.2012.10722287

Sadler, D. R. (1989). Formative assessment and the design of instructional systems. Instructional Science, 18(2), 119-144. http://dx.doi.org/10.1007/BF00117714

Simons, N., & Richardson, J. (2013). New content in digital repositories: The changing research landscape. Oxford: Chandos.

Stead, D. R. (2005). A review of the one-minute paper. Active Learning in Higher Education, 6(2), 118-131. http://dx.doi.org/10.1177/1469787405054237

Swoger, B. J. M. (2011). Closing the assessment loop using pre- and post-assessment. Reference Services Review, 39(2), 244-259. http://dx.doi.org/10.1108/00907321111135475


Downloads

Downloads per month over past year

Actions (login required)

View Item View Item