Journal Scholar: una alternativa internacional, gratuita y de libre acceso para medir el impacto de las revistas de Arte, Humanidades y Ciencias Sociales

Delgado-Lopez-Cozar, Emilio, Orduña-Malea, Enrique, Marcos Cartagena, Diego, Contreras-Jiménez, Evaristo and Ruiz-Pérez, Rafael Journal Scholar: una alternativa internacional, gratuita y de libre acceso para medir el impacto de las revistas de Arte, Humanidades y Ciencias Sociales. EC3 Working Papers, 2012, n. 5. (Unpublished) [Journal article (Unpaginated)]

[thumbnail of journal-scholar.pdf]
Preview
 Text
journal-scholar.pdf - Published version
Download (780kB) | Preview
Alternative locations: http://hdl.handle.net/10481/20375

English abstract

The EC3 Research Group of the University of Granada presents a prototype of the JOURNAL SCHOLAR, a bibliometric index which intends to measure the performance of scientific journals in the fields of Arts, Humanities and Social Sciences by counting publications and citations through Google Scholar. The indicators used are the H-index and the G-index. Journals are ranked in quartiles and the citation windows ranges from 5 to 10 years for international or regional rankings. Data was retrieved on 10-15 July, 2011. We computed the H-index and the G-index of 462 journals. We conclude comparing the coverage and results offered by SCOPUS and WoS. JOURNAL SCHOLAR quadraples the coverage and reduces English-language biases. As it identifies more citations, the H-indexes are higher (an average of 44% higher than in SCOPUS and 77% than Web of Science) allowing to discriminate better the journals' positioning in the ranking. In order to show this tool's functionalities we present the results for Information and Library Science, offering a ranking of de 462 journals edited in 59 countries. We conclude that it is feasible and viable to generate bibliometric tools using Google Scholar. Despite its lack of control (selecting sources and normalizing data) we obtain reasonable results as valid and reliable as those from SCOPUS and WoS. And with a lesser cost than with the traditional bibliometric tools - considering the great cost of these tools elaborated by Thomson Reuters and Elsevier-.

Spanish abstract

El grupo EC3 (Evaluación de la Ciencia y de la Comunicación Científica) de la Universidad de Granada presenta el prototipo de lo que será JOURNAL SCHOLAR, un índice bibliométrico que pretende medir el rendimiento de las revistas científicas de Arte, Humanidades y Ciencias Sociales a partir del recuento de sus publicaciones y de las citas bibliográficas que estas han recibido a través de Google Scholar. Como indicadores bibliométricos se emplearán los índices H y G. Las revistas se ordenarán en cuartiles y se presentarán por períodos de 5 o 10 años bien en rankings internacionales o por regiones. Las búsquedas bibliográficas en Google Scholar se efectuaron entre el 10 y el 15 de julio de 2011. Se calcula los índices H y G de 462 revistas. Se concluye comparando la cobertura y los resultados con los ofrecidos por SCOPUS y WOS. JOURNAL SCHOLAR cuadruplica la cobertura, reduce el sesgo anglosajón. Al identificar muchas más citas, JOURNAL SHCOLAR proporciona índices h muy elevados (un promedio de un 44% superior a SCOPUS y un 77% a Web of Science) con lo que permite discriminar mejor las posiciones de las revistas en el ranking. Para ilustrar las prestaciones del producto se presentan los resultados de la disciplina Information and Library Science, que ofrece un ranking en el que se calcula el impacto de 462 revistas editadas en 59 países. En conclusión, se demuestra que es factible y viable generar productos bibliométricos con Google Scholar. A pesar de su carácter incontrolado (ni selección de fuentes ni normalización de datos) obtiene resultados tan solventes, fiables y válidos como los índices de SCOPUS y WOS. Y todo a ello a menores costes que las herramientas de evaluación tradicionales –aspecto trascendental dadas las millonarias sumas que cuestan los productos elaborados por Thomson Reuters y Elsevier-.

Item type: Journal article (Unpaginated)
Keywords: Google Scholar Metrics, Google Scholar, Scopus, Web of Science, Scientific, Journals, Citation analysis, Bibliometrics, H Index, G Index, Evaluation, Ranking; Revistas, Citas, indicadores bibliométricos, Índice H, Índice G, Evaluación
Subjects: B. Information use and sociology of information
B. Information use and sociology of information > BA. Use and impact of information.
B. Information use and sociology of information > BB. Bibliometric methods
L. Information technology and library technology > LS. Search engines.
Depositing user: Enrique Orduna-Malea
Date deposited: 30 Mar 2013 06:42
Last modified: 02 Oct 2014 12:25
URI: http://hdl.handle.net/10760/18906

References

Aguillo, I. . (2011). Google Scholar, no es oro todo lo que reluce. Anuario ThinkEPI 2011, 5: 211-215.

Aguillo, I. F. (2012). Is Google Scholar useful for bibliometrics? A webometric analysis. Scientometrics, 91(2): 343-351.

Amara, N. & Landry, R. . (2012). Counting citations in the field of business and management: why use Google Scholar rather than the Web of Science. Scientometrics, 1-29.

Anders, M. E., & Evans, D. P. (2010). Comparison of PubMed and google scholar literature searches. Respiratory Care, 55(5): 578-583.

Arlitsch, K. , & OBrien, P. S. . (2012). Invisible Institutional Repositories: Addressing the Low Indexing Ratios of IRs in Google Scholar. Library Hi Tech, 30(1): 4.

Bakkalbasi, N.; Bauer, K.; Glover, J. y Wang, L. (2006). “Three Options for Citation Tracking: Google Scholar, Scopus and Web of Science”. Biomedical Digital Library. 3.

Bar-Ilan, J. (2010). Citations to the "introduction to informetrics" indexed by WOS, scopus and google scholar. Scientometrics, 82(3): 495-506.

Bauer, K. y Bakkalbasi, N. (2005). “An examination of citation counts in a new scholarly communication environment”. D-Lib Magazine. 11, 9.

Beel, J., & Gipp, B. (2009). Google scholar's ranking algorithm: An introductory overview. Proceedings of Issi 2009 - 12th International Conference of the International Society for Scientometrics and Informetrics, 1(1): 230-241.

Beel, J., & Gipp, B. (2009). Google scholar's ranking algorithm: The impact of articles' age (an empirical study). In Flory A., Collard M. (Eds.), Google scholar's ranking algorithm: The impact of citation counts (an empirical study)

Beel, J., Gipp, B., & Wilde, E. (2010). Academic search engine optimization (ASEO) optimizing scholarly literature for google scholar & co. Journal of Scholarly Publishing, 41(2), 176-190.

Bornmann, L., Marx, W., Schier, H., Rahm, E., Thor, A., & Daniel, H. (2009). Convergent validity of bibliometric google scholar data in the field of chemistry-citation counts for papers that were accepted by angewandte chemie international edition or rejected but published elsewhere, using google scholar, science citation index, scopus, and chemical abstracts. Journal of Informetrics, 3(1): 27-35.

Bosman, J., I.v. Mourik, M. Rasch, E. Sieverts & H. Verhoeff (2006) Scopus reviewed and compared : The coverage and functionality of the citation database Scopus, including comparisons with Web of Science and Google Scholar. Utrecht, Utrecht University Library. 63p.

Cabezas-Clavijo, Á. & Torres-Salinas, D. (2012). “Google Scholar Citations y la emergencia de nuevos actores en la evaluación de la investigación”. Anuario ThinkEPI, 6.

Cabezas Clavijo, Á.; Delgado López-Cózar, E. (2012a). Scholar Metrics: the impact of journals according to Google, just an amusement or a valid scientific tool? EC3 Working Papers 1, Accesible en: http://eprints.rclis.org/handle/10760/16836

Cabezas-Clavijo, Á. & Delgado López-Cózar, E. (2012b). Las revistas españolas de Ciencias Sociales y Jurídicas en Google Scholar Metrics, ¿están todas las que son? EC3 Working Papers, 2, Accesible en: http://eprints.rclis.org/handle/10760/16892

Cabezas-Clavijo, Álvaro; Delgado López-Cózar, Emilio (2012c). ¿Es posible usar Google Scholar para evaluar las revistas científicas nacionales en los ámbitos de Ciencias Sociales y Jurídicas? El caso de las revistas españolas. EC3 Working Papers 3, 23 de abril 2012. Accesible en http://hdl.handle.net/10760/16888

Chen, X. (2010). Google scholar's dramatic coverage improvement five years after debut. Serials Review, 36(4), 221-226.

Delgado López-Cózar, E. (2008). Qué es y cómo utilizar Google Scholar. V Foro sobre evaluación de la calidad de la educación superior y de

la investigación. Fundación Española de Ciencia y Tecnología (FECYT) / Universidad del País Vasco. San Sebastián, 2-5 septiembre 2008. ISBN 978-84-691-3972-1. Accesible en http://ec3.ugr.es/publicaciones/Delgado_Lopez-Cozar,_EQue_

es_y_como_utilizar_Google_Scholar.pdf

Delgado López-Cózar, E. (2009a). Google Scholar: ¿Herramienta de evaluación científica? En: II Seminario sobre evaluación y comunicación de la ciencia. Granada, 2 de abril, 2009.Universidad de Granada. Accesible en: http://hdl.handle.net/10760/14088

Delgado López-Cózar, E. (2009b). Qué es y cómo utilizar Google Scholar. VI Foro sobre evaluación de la calidad de la educación superior y de la investigación. Fundación Española de Ciencia y Tecnología (FECYT) / Universidad de Vigo. Vigo, 8-11 septiembre 2009.

Delgado López-Cózar, E. (2012). Los repositorios en Google Scholar Metrics o qué hace un tipo documental como tú en un lugar como ese. EC3 Working Papers 4: 3 de mayo de 2012. Accesible en http://digibug.ugr.es/handle/10481/20236

Delgado López-Cózar, E.; Marcos Cartagena, D.; Cabezas Clavijo, A.; Jiménez Contreras, E.; Ruiz Pérez, R. (2012). Índice H de las revistas españolas de Ciencias Jurídicas según Google Scholar (2001-2010). Accesible en http://hdl.handle.net/10481/20234

Delgado López-Cózar, E.; Marcos Cartagena, D.; Cabezas Clavijo, A.; Jiménez Contreras, E.; Ruiz Pérez, R. (2012). Índice H de las revistas españolas de Ciencias Sociales según Google Scholar (2001-2010). Accesible en: http://hdl.handle.net/10481/20235

Etxebarria, G., & Gomez-Uranga, M. (2010). Use of scopus and google scholar to measure social sciences production in four major spanish universities. Scientometrics, 82(2): 333-349.

Franceschet, M. (2010). A comparison of bibliometric indicators for computer science scholars and journals on web of science and google scholar. Scientometrics, 83(1): 243-258.

Garcia-Perez, M. A. (2010). Accuracy and completeness of publication and citation records in the web of science, PsycINFO, and google scholar: A case study for the computation of h indices in psychology. Journal of the American Society for Information Science and Technology, 61(10): 2070-2085.

Hartman, Karen y Mullen, Laura Bowering (2008). ”Google Scholar and Academic Libraries: an Update”. New Library World. 109(5-6): 211-222

Harzing, A., & van der Wal, R. (2009). A google scholar h-index for journals: An alternative metric to measure journal impact in economics and business. Journal of the American Society for Information Science and Technology, 60(1): 41-46.

Harzing, A.W. (2013) A preliminary test of Google Scholar as a source for citation data: A longitudinal study of Nobel Prize winners, Scientometrics (en prensa).

Harzing, Anne-Wil k. y Van Der Wal, Ron. (2008). “Google Scholar as a New Source for Citation Analysis”. Ethics in Science and Environmental Politics. Vol. 8, 1, 61-73.

Hodge, D. , & Lacasse, J. . (2011). Ranking disciplinary journals with the google scholar h-index: a new tool for constructing cases for tenure, promotion, and other professional decisions. Journal of Social Work Education, 47(3): 579-596.

Howland, J. L., Wright, T. C., Boughan, R. A., & Roberts, B. C. (2009). How scholarly is google scholar? A comparison to library databases. College & Research Libraries, 70(3): 227-234.

Jacobs, J. A. (2009). WHERE CREDIT IS DUE assessing the visibility of articles published in gender & society with google scholar. Gender & Society, 23(6): 817-832.

Jacso, P. (2005a). “As We May Search - Comparison of Major Features of the Web of Science, Scopus, and Google Scholar Citation-Based and Citation-Enhanced Databases”. Current Science. 89(9): 1537-1547.

Jacso, P. (2005b). Google Scholar: the Pros and the Cons. Online Information Review. 29(2): 208-214.

Jacso, P. (2008a). Google Scholar Revisited”. Online Information Review. 32(1): 102-114.

Jacso, P. (2008b). The Pros and Cons of Computing the H-Index Using Google Scholar. Online Information Review. 32(3): 437-452.

Jacso, P. (2009a). Calculating the h-index and other bibliometric and scientometric indicators from google scholar with the publish or perish software. Online Information Review, 33(6): 1189-1200.

Jacso, P. (2009b). Google scholar's ghost authors. Library Journal, 134(18): 26-27.

Jacso, P. (2010). Metadata mega mess in google scholar. Online Information Review, 34(1): 175-191.

Jacsó, P. . (2011). Google Scholar duped and deduped – the aura of “robometrics. Online Information Review, 35(1): 154-160.

Jacsó, P. . (2012). Google Scholar Author Citation Tracker: is it too little, too late? Online Information Review, 36(1): 126-141.

Jamali, H. R., & Asadi, S. (2010). Google and the scholar: The role of google in scientists' informationseeking behaviour. Online Information Review, 34(2): 282-294.

Jones, E. (2010). Google books as a general research collection. Library Resources & Technical Services, 54(2): 77-89.

Kirkwood Jr., H. P. , & Kirkwood, M. C. . (2011). Researching the life sciences: BIOSIS Previews and Google Scholar. Online Medford NJ United States, 35(3): 24-28.

Kirkwood, H. P. J. , & Kirkwood, M. C. . (2011). EconLit and Google Scholar Go Head-to-Head. Online Exploring Technology Resources for Information Professionals, 35(2): 38-41.

Kousha K, Thelwall M. (2009). Google Book Search: Citation Analysis for Social Science and the Humanities. Journal of the American Society For Information Science, 60 (8): 1537-1549.

Kousha, K., Thelwall, M. (2007). Google Scholar Citations and Google Web/Url Citations: a Multi-Discipline Exploratory Analysis” Journal of the American Society for Information Science and Technology. 58(7): 1055-1065.

Kousha, K., Thelwall, M. (2008). Sources of Google Scholar Citations Outside the Science Citation Index: a Comparison Between Four Science Disciplines. Scientometrics. 74(2): 273-294.

Kulkarni, A. V., Aziz, B., Shams, I., & Busse, J. W. (2009). Comparisons of citations in web of science, scopus, and google scholar for articles published in general medical journals. JAMA-Journal of the American Medical Association, 302(10): 1092-1096.

Law, R., Ye, Q., Chen, W., & Leung, R. (2009). Research note an analysis of the most influential articles published in tourism journals from 2000 to 2007: A google scholar approach. Journal of Travel & Tourism Marketing, 26(7): 735-746.

Lewandowski, D. (2010). Google scholar as a tool for discovering journal articles in library and information science. Online Information Review, 34(2): 250-262.

Lokman, I Meho y Kiduk, Yang (2006). ”Multi-Faceted Approach to Citation-Based Quality Assessment for Knowledge Management”. En: World Library and Information Congress: 72nd IFLA General Conference and Council [Comunicación en línea]. [Fecha de consulta: 12/01/09]. http://www.ifla.org/IV/ifla72/index.htm

Lokman, I Meho y Yang, K. (2007). Impact of data sources on citation counts and rankings of LIS faculty: Web of Science vs Scopus and Google Scholar. Journal of the American Society for Information Science and Technology, 58(13): 2105-2125.

Ma, R., Dai, Q., Ni, C., & Li, X. (2009). An author co-citation analysis of information science in china with chinese google scholar search engine, 2004-2006. Scientometrics, 81(1): 33-46.

Martell, C. (2009). A citation analysis of college & research libraries comparing yahoo, google, google scholar, and ISI web of knowledge with implications for promotion and tenure. College & Research Libraries, 70(5): 460-472.

Mayr, Philipp y Walter Anne. (2007). “An Exploratory Study of Google Scholar”. Online Information Review. 31(6): 814-830.

Mikki, S. (2010). Comparing google scholar and ISI web of science for earth sciences. Scientometrics, 82(2): 321-331.

Mingers, J., & Lipitakis, E. A. E. C. G. (2010). Counting the citations: A comparison of web of science and google scholar in the field of business and management. Scientometrics, 85(2): 613-625.

Moussa, S., & Touzani, M. (2010). Ranking marketing journals using the google scholar-based hg-index. Journal of Informetrics, 4(1): 107-117.

Neuhaus, Chris, Neuhaus, Ellen, Asher, Alan y Wrede, Clint. (2006). The Depht and Breadth of Google Scholar: An Empirical Study. Libraries and the Academy. 6(2): 127-141.

Noruzi, A. (2005). “Google Scholar: the New Generation of Citation Indexes”. Libri. 55(4): 170-180.

Nourbakhsh, E., Nugent, R., Wang, H., Cihan, C., & Nugent, K. (2010). Comparison of medical literature searches using either pubmed central or google scholar. Journal of Investigative Medicine, 58(2):437.

Onyancha, O. B. (2009). A citation analysis of sub-saharan african library and information science journals using google scholar. African Journal of Library Archives and Information Science, 19(2): 101-116.

Orduña-Malea, E., Serrano-Cobos, J., & Lloret-Romero, N. (2009). Las universidades públicas españolas en Google Scholar: presencia y evolución de su publicación académica web. El Profesional de la Informacion, 18(5): 493-500.

Robinson, M L., & Wusteman, J. (2007). Putting Google Scholar to the Test: a Preliminary Study. Program. 41: 71-80.

Sanni, S. A. , & Zainab, A. N. . (2011). Evaluating the influence of a medical journal using Google Scholar. Learned Publishing, 24(2): 145-154.

Schroeder, Robert (2007). “Pointing Users Toward Citation Searching: Using Google Scholar and Web of Science”. Libraries and the Academy. 7(2): 243–248.

Sember, M., Utrobicic, A., & Petrak, J. (2010). Croatian medical journal citation score in web of science, scopus, and google scholar. Croatian Medical Journal, 51(2): 99-103.

Shultz, Mary. (2007). Comparing Test Searches in Pubmed and Google Scholar. Journal of the Medical Library Association. 95(4): 442-445.

Torres-Salinas, D., Ruiz-Pérez, R. & Delgado-López-Cózar, E. (2009). Google Scholar como herramienta para la evaluación científica. El profesional de la Información, 18(5): 501-510. http://ec3.ugr.es/publicaciones/d700h04j123154rr.pdf

Van Aalst, J. (2010). Using google scholar to estimate the impact of journal articles in education. Educational Researcher, 39(5): 387-400.

Walters, W. H. (2009). Google scholar search performance: Comparative recall and precision. Portal-Libraries and the Academy, 9(1): 5-24.

Walters, W. H. . (2011). Comparative Recall and Precision of Simple and Expert Searches in Google Scholar and Eight Other Databases. Portal Libraries and the Academy, 11(4): 971-1006.

Wouters, P., & Costas, R. (2012). Users , narcissism and control – tracking the impact of scholarly publications in the 21st century. Utrecht: SURF Foundation.


Downloads

Downloads per month over past year

Actions (login required)

View Item View Item
Contact us
Send email Sponsors
Sponsor: AIMS Sponsor: D&P Sponsor: UniNa CAB Get connected
Facebook Facebook Twitter Twitter Linkedin LinkedIn RSS RSS