Evaluation Insights to Key Processes of Digital Repositories

Koumoutsos, Konstantinos and Mitrelis, Aggelos and Tsakonas, Giannis Evaluation Insights to Key Processes of Digital Repositories., 2010 . In Libraries In the Digital Age 2010, Zadar (HR), 24-28 May 2010. [Conference paper]

[img]
Preview
PDF
FullText_LIDA-revised.pdf

Download (260kB) | Preview

English abstract

Digital repositories are considered essential information tools for scholarly communication. Their acceptability and extensive use by communities and institutions, as well as the users’ commitment in self-archiving, highlight the need for developing alternative channels of communication to expose scholarly productivity. Furthermore, the digital repositories community is interested into transforming them into viable, reliable and useful systems. This interest is primarily expressed by intense research activity, including - among the others - the evaluation and the usability of the technological solutions that support these services. On an institutional level, digital repositories are systems supported by physical organizations, such as libraries, which undertake many tasks in order to enable a variety of processes associated with these systems, such as submission, editing and access. In this paper, we present a multifaceted evaluation initiative that aimed at the redesign of University of Patras’ institutional repository, namely ‘Nemertes’. ‘Nemertes’ is operating on a DSpace installation and the ‘Theses and Dissertations’ collection was placed at the center of evaluation as the most important collection accommodated in the service. Emphasis was given to key processes held inside the repository by conducting surveys and interviews with typical classes of users. In order to collect data from these sources three different studies were held. First the quality of Submission process inside the physical and the digital space was evaluated through a questionnaire survey, which was addressed to people who had earlier submitted in the ‘Theses and Dissertation’ collection. Secondly, the information retrieval processes and the interface were evaluated by Human-Computer Interaction savvy students using the usability heuristics principles. Finally, the Editing processes and the quality of the delivery of services were assessed through interviews with the librarians that support the service. The findings of these studies point to areas that the system can be improved and help to eliminate the barriers that prohibit the service to be upgraded and host new collections. The areas identified concern both the way of delivering the service and the operation of the system. While the contextual parameters make the generalization of the findings about the service more ambiguous, the findings concerning the system performance and the interface intuitiveness validate the results of previous studies, such as the case of terminology, the affordances and the effectiveness of search interfaces. It is anticipated that the findings of the study can be further exploited by organizations with similar repository services and technological infrastructures.

Item type: Conference paper
Keywords: Digital repositories, evaluation, submission process, editing process, information retrieval
Subjects: H. Information sources, supports, channels. > HS. Repositories.
C. Users, literacy and reading. > CA. Use studies.
Depositing user: Giannis Tsakonas
Date deposited: 24 May 2010
Last modified: 02 Oct 2014 12:16
URI: http://hdl.handle.net/10760/14513

References

- Atkinson, L. (2006). The rejection of D-Space: Selecting theses database software at the University of Calgary Archive. In 9th International Symposium on Electronic Theses and Dissertations, Quebec City, Canada. Available from https://dspace.ucalgary.ca/handle/1880/43513, retrieved 04.01.10.

- ARL (2006). Institutional Repositories. Washington, D.C.: ARL.

- Boock, M. (2005). Improving DSpace@OSU with a usability study of the ET/D submission process. Ariadne, (45). Available from http://www.ariadne.ac.uk/issue45/boock/, retrieved 05.01.10.

- Caccialupi, R., Calvi, L., Cassella, M., & Conte, G. (2009) Usability evaluation of a multimedia archive: B@bele. In Proceedings of the 13th European Conference on Digital Libraries, LNCS 5714, (370-376). Berlin; Heidelberg: Springer-Verlag.

- Davis, P.M. & Connolly, M.J.L. (2007). Institutional repositories: evaluating the reasons for non-use of Cornell University's installation of DSpace. D-Lib Magazine 13(3/4). Available from http://www.dlib.org/dlib/march07/davis/03davis.html, retrieved 07.12.09.

- Ebenezer, C. (2003). Usability evaluation of an NHS library website. Health Information & Libraries Journal, 20(3), 134-142.

- Kim, J. (2005). Finding documents in a digital institutional repository: DSpace and Eprints. Proceedings of the American Society for Information Science and Technology, 42(1). Available at http://dx.doi.org/10.1002/meet.1450420173, retrieved 24.11.09.

- Markey, K., Rieh, S.Y., St. Jean, B., Kim, J., & Yakel, E. (2007). Census of Institutional Repositories in the United States: MIRACLE project research findings. Washington, D.C.: CLIR.

- Marchionini, G. (2000). Evaluating digital libraries: A longitudinal and multifaceted view. Library Trends, 49(2), 4-33.

- Nielsen, J. (2005). Ten usability heuristics. Available from http://www.useit.com/papers/heuristic/heuristic_list.html, retrieved 05.01.10.

- Peng, L.K., Ramaiah, C.K., & Foo, S. (2004). Heuristic-based user interface evaluation at Nanyang Technological University in Singapore. Program, 38(1), 42-59.

- Van Der Graaf, M. (2008). The European Repository landscape 2008: Inventory of digital repositories for research output in the EU. Amsterdam. Available from http://dare.uva.nl/document/150724, retrieved 11.01.10.


Downloads

Downloads per month over past year

Actions (login required)

View Item View Item