Citation metrics and strategic mutations of scientific research: narratives and evidence

Guerra, Luca Citation metrics and strategic mutations of scientific research: narratives and evidence., 2023 [Preprint]

[img]
Preview
 Text
Citation metrics and strategic mutations of the scientific research.pdf
Download (994kB) | Preview

English abstract

Following the diffusion of the management model promoted by the New Public Management also within universities, sectors until then endowed with particular protection, such as the academic one, were progressively subjected to new controls and constraints, which gradually took the form of quantitative surveys, with a growing role of citation metrics. These evaluation processes have given rise to various important critical positions at an international level. If it is true that, according to Goodhart's law, "when a measure becomes an objective it ceases to be a good measure”, it is even more significant to note that when a measure becomes an objective, what is measured ceases to be what it was before. The quantitative measurement of academic performance has in fact triggered forms of gaming such as to alter the very game of scientific research, its purposes and the forms of its sharing. In the article we will carry out a comparison between the forms of mutation and the narratives that accompany them to see to what extent we are legitimate today to talk about the transformation of scientific research into strategic scientific research.

Item type: Preprint
Keywords: scholarly communication; gaming metrics; ricerca scientifica; scientific reserach; metriche citazionali; bibliometria; bibliometrics; dora; leida; leiden, research assesment; valutazione della ricerca; retraction
Subjects: B. Information use and sociology of information > BD. Information society.
B. Information use and sociology of information > BG. Information dissemination and diffusion.
Depositing user: Phd Luca Guerra
Date deposited: 22 Mar 2023 23:16
Last modified: 22 Mar 2023 23:16
URI: http://hdl.handle.net/10760/44192

References

Biagioli, Marco. 2016. “Watch out for cheats in citation game”. Nature 535: 201 https://doi.org/10.1038/535201a.

Biagioli, Mario e Lippman, Alexandra (cura), ed. 2020. Gaming the metrics: misconduct and manipulation in academic research. Cambridge: The Mit press.

https://mitpress.mit.edu/9780262537933/gaming-the-metrics

Brezis, Elise S., e Aliaksandr Birukou. 2020. “Arbitrariness in the Peer Review Process”. Scientometrics, 2123: 393–411. https://doi.org/10.1007/s11192-020-03348-1;

Cari-Ann, Hayer (et al.). 2013. "Pressures to publish: catalysts for the loss of scientific writing integrity?". Papers in Natural Resources 689. Doi: 10.1080/03632415.2013.813845

https://digitalcommons.unl.edu/natrespapers/689

De Bellis, Nicola. 2014. Introduzione alla bibliometria. Roma: AIB.

Dondio, Pierpaolo (et al.) 2019. “The ‘Invisible hand’ of peer review: the implications of author-referee networks on peer review in a scholarly journal”. Journal of Informetrics 13: 708–716. https://doi.org/10.1016/J.JOI.2019.03.018.

Edwards, Mark A. e Roy Siddhartha. 2017. “Science is broken. Perverse incentives and the misuse of quantitative metrics have undermined the integrity of scientific research“. Aeon.

https://aeon.co/essays/science-is-a-public-good-in-peril-heres-how-to-fix-it

Fanelli, Daniele. 2020. “Pressures to publish: what effects do we see? In Gaming the metrics: misconduct and manipulation in academic research, a cura di Biagioli, Mario e Lippman, Alexandra, 111-122. Cambridge: The Mit press. Doi: https://doi.org/10.7551/mitpress/11087.003.0011

Fanelli, Daniele (et al.) 2022. “Do individual and institutional predictors of

misconduct vary by country? Results of a matched-control analysis of problematic image duplications”. PLoS One 17 (3) e0255334. https://doi.org/10.1371/journal.pone.0255334

Fang C., Ferric e Casadevall, Arturo. 2011. “Retracted science and the retraction index”. Infective Immunology 79 (10): 3855-9. Doi: 10.1128/IAI.05661-11

Figà-Talamanca, Alessandro. 2000 “L’impact factor nella valutazione della ricerca” [Bozza dell'intervento, Bologna 27 giugno 2000].

http://siba.unipv.it/biblioteche/info/SISSCOWEB_A_Fig_Talamanca_L%27impact_factor_nella_valutazione_della_ricerca_SISSCOWEB.htm

Garfield, Eugene. 1998. “The impact factor and using it correctly”. De Unfallchirurg, 48 (2): 424.

http://garfield.library.upenn.edu/papers/derunfallchirurg_v101%286%29p413y1998english.html

Gaudino, Mario (et al.). 2021. “Trends and characteristics of retracted articles in the biomedical literature, 1971 to 2020”. JAMA international medicine 181 (8): 1118-1121

Doi: 10.1001/jamainternmed.2021.1807

Lacetera, Nicola e Zirulia, Lorenzo. 2011. “The economics of scientific misconduct”. The Journal of Law, Economics, and Organization. 27: 568–603. https://doi.org/10.1093/jleo/ewp031

Martinson, Brian C. (et al.). 2005. “Scientists behaving badly”. Nature. 435: 737-738

Moher, David, et al. (2020). “The Hong Kong Principles for assessing researchers: fostering research integrity”. PLoS Biology 18 (7). https://doi.org/10.1371/journal.pbio.3000737.

Naujokaitytė, Goda. 2021. “Number of scientists worldwide reaches 8.8M, as global research spending grows faster than the economy” in Science business

https://sciencebusiness.net/news/number-scientists-worldwide-reaches-88m-global-research-spending-grows-faster-economy

Oranski, Ivan. 2022. “Retractions are increasing, but not enough”. Nature 608: 9. https://doi.org/10.1038/d41586-022-02071-6

Pantziarka, Pan e Meheus, Lydie. 2019. “Journal retractions in oncology: a bibliometric study”. Future oncology 15 (31): 3597-3608. https://doi.org/10.2217/fon-2019-0233

Power, Michael. 1997. The Audit Society. Oxford: Oxford University Press

Smith, Richard. 2006. “Peer review: a flawed process at the heart of science and Journals”. Journal of the Royal society of medicine, l99: 178-182.

Tijdink, Joeri K (et al.). 2013. “Publication pressure and burn out among Dutch medical professors: a nationwide survey”. PLoS One 8 (9):e7338. Doi: 10.1371/journal.pone.0073381.

Turbanti, Simona. 2018. Strumenti di misurazione della ricerca. Milano: Editrice Bibliografica.

Wilsdon, James et al., ed. 2015. The metric tide: report of the Independent review of the role of

metrics in research assessment and management. Thousand Oaks: SAGE publications.

doi: 10.13140/RG.2.1.4929.1363. https://sk.sagepub.com/books/the-metric-tide

Wouters, Paul. 2020. “The mismeasurement of quality and impact”. In Gaming the metrics: misconduct and manipulation in academic research, a cura di Mario Biagioli e Alexandra Lippman, 66-75. Cambridge, The Mit press. https://doi.org/10.7551/mitpress/11087.003.0006


Downloads

Downloads per month over past year

Actions (login required)

View Item View Item
Contact us
Send email Sponsors
Sponsor: AIMS Sponsor: D&P Sponsor: UniNa CAB Get connected
Facebook Facebook Twitter Twitter Linkedin LinkedIn RSS RSS