Expertise overlap between an expert panel and research groups in global journal maps

Rahman, A. I. M. Jakaria, Guns, Raf , Rousseau, Ronald and Engels, Tim C. E. Expertise overlap between an expert panel and research groups in global journal maps., 2015 . In 15th International Conference on Scientometrics and Informetrics - ISSI, Istanbul (Turkey), 29 June - 4 July 2015. [Conference paper]

[thumbnail of Rahman, Guns, Rousseau, Engles 2015_Expertise overlap between an expert panel and research groups in global journals maps.pdf] Text
Rahman, Guns, Rousseau, Engles 2015_Expertise overlap between an expert panel and research groups in global journals maps.pdf - Published version

Download (20MB)

English abstract

There are no available methods to measure overlap in expertise between a panel of experts and evaluated research groups in discipline-specific research evaluation. This paper explores a bibliometric approach to determining the overlap of expertise, using the 2009 and 2011 research evaluations of ten Pharmaceutical Sciences and nine Biology research groups of the University of Antwerp. We study this overlap at the journal level. Specifically, journal overlay maps are applied to visualize to what extent the research groups and panel members publish in the same journals. Pharmaceutical Sciences panel members published more diversely than the corresponding research groups, whereas, the Biology research groups published more diversely than the panel. Numbers of publications in the same journals vary over a large scale. A different range of coverage was found for different research groups; there is also a significant difference between maximum and minimum coverage based on discipline. Future research will focus on similarity testing, and a comparison with other disciplines.

Item type: Conference paper
Keywords: Research assessment; Research evaluation; Expert panel; Research group; Barycenter; Overlay map; Matching research expertise; Journal level Overlay map
Subjects: B. Information use and sociology of information
B. Information use and sociology of information > BB. Bibliometric methods
Depositing user: A. I. M. Jakaria Rahman
Date deposited: 15 Jul 2015 12:12
Last modified: 15 Jul 2015 12:12
URI: http://hdl.handle.net/10760/25424

References

Bornmann, L., Mutz, R., Marx, W., Schier, H., & Daniel, H.-D. (2011). A multilevel modelling approach to investigating the predictive validity of editorial decisions: do the editors of a high profile journal select manuscripts that are highly cited after publication? Journal of the Royal Statistical Society: Series A (Statistics in Society), 174(4), 857–879.

Butler, L., & McAllister, I. (2011). Evaluating University research performance using metrics. European Political Science, 10(1), 44–58.

Engels, T. C. E., Goos, P., Dexters, N., & Spruyt, E. H. J. (2013). Group size, h-index, and efficiency in publishing in top journals explain expert panel assessments of research group quality and productivity. Research Evaluation, 22(4), 224–236.

Lawrenz, F., Thao, M., & Johnson, K. (2012). Expert panel reviews of research centers: The site visit process. Evaluation and Program Planning, 35(3), 390–397.

Leydesdorff, L., & Rafols, I. (2012). Interactive overlays: A new method for generating global journal maps from web-of-science data. Journal of Informetrics, 6(2), 318–332.

Nedeva, M., Georghiou, L., Loveridge, D., & Cameron, H. (1996). The use of co-nomination to identify expert participants for Technology Foresight. R&D Management, 26(2), 155–168.

Rahman, A. I. M. J., Guns, R., Rousseau, R., & Engels, T. C. E. (2014). Assessment of expertise overlap between an expert panel and research groups. In Ed Noyons (Ed.), Context Counts: Pathways to Master Big and Little Data. Proceedings of the Science and Technology Indicators Conference 2014 Leiden (pp. 295–301). Leiden: Universiteit Leiden.

Rons, N., De Bruyn, A., & Cornelis, J. (2008). Research evaluation per discipline: a peer-review method and its outcomes. Research Evaluation, 17(1), 45–57.

Tseng, Y.-H., & Tsay, M.-Y. (2013). Journal clustering of library and information science for subfield delineation using the bibliometric analysis toolkit: CATAR. Scientometrics, 95(2), 503–528.

Van Eck, N. J., & Waltman, L. (2010). Software survey: VOSviewer, a computer program for bibliometric mapping. Scientometrics, 84(2), 523–538.


Downloads

Downloads per month over past year

Actions (login required)

View Item View Item