Google Scholar Citations and Google Web/URL Citations: A Multi-Discipline Exploratory Analysis

Kousha, Kayvan and Thelwall, Mike Google Scholar Citations and Google Web/URL Citations: A Multi-Discipline Exploratory Analysis., 2006 . In International Workshop on Webometrics, Informetrics and Scientometrics & Seventh COLLNET Meeting, Nancy (France), May 10 - 12, 2006. (Unpublished) [Conference paper]

[img]
Preview
 PDF
google.pdf
Download (194kB) | Preview

English abstract

In this paper we introduce a new data gathering method “Web/URL Citation” and use it and Google Scholar as a basis to compare traditional and Web-based citation patterns across multiple disciplines. For this, we built a sample of 1,650 articles from 108 Open Access (OA) journals published in 2001 in four science and four social science disciplines. We recorded the number of citations to the sample articles using several methods based upon the ISI Web of Science, Google Scholar and the Google search engine (Web/URL citations). For each discipline, we found significant correlations between ISI citations and both Google Scholar and Google Web/URL citations; with similar results when using total or average citations, and when comparing within and across (most) journals. We also investigated disciplinary differences. Google Scholar citations were more numerous than ISI citations in our four social science disciplines as well as in computer science, suggesting that Google Scholar is a more comprehensive tool for citation tracking in the social sciences and perhaps also in fast-moving fields where conference papers are highly valued and published online. The results for Web/URL citations suggested that counting a maximum of one hit per site produces a better measure for assessing the impact of OA journals or articles, because replicated web citations are very common within individual sites. The results can be considered as additional evidence that there is some commonality between traditional and Web-extracted citations.

Item type: Conference paper
Keywords: google scholar, web citations, URL citations
Subjects: B. Information use and sociology of information > BB. Bibliometric methods
B. Information use and sociology of information
Depositing user: Heather G Morrison
Date deposited: 05 Jun 2006
Last modified: 02 Oct 2014 12:03
URI: http://hdl.handle.net/10760/7641

References

1. J. Fry, The cultural shaping of ICTs within academic fields: Corpus-based linguistics as a case study. Literary and Linguistic Computing, 19(3), 303-319, 2004.

2. R. Kling and G. McKim, Scholarly communication and the continuum of electronic publishing. Journal of American Society for Information Science, 50(10), 890-906, 1999.

3. T. C. Almind and P. Ingwersen, Informetric analyses on the World Wide Web: Methodological approaches to “Webometrics”. Journal of Documentation, 53(4), 404-426, 1997.

4. C. Borgman and J. Furner, Scholarly communication and bibliometrics. Annual Review of Information Science and Technology, 36, Medford, NJ: Information Today Inc., pp. 3-72, 2002.

5. P. Ingwersen, The calculation of Web Impact Factors. Journal of Documentation, 54(2), 236-243, 1998.

6. R. Rousseau, Sitations: An exploratory study. Cybermetrics, 1(1), 1997, Retrieved November 14, 2001, from http://www.cindoc.csic.es/cybermetrics/articles/v2i1p2.html/

7. S. Harter and C. Ford, Web-based analysis of E-journal impact: Approaches, problems, and issues, Journal of the American Society for Information Science, 51(13), 1159-76, 2000.

8. A.G. Smith, A tale of two Web spaces: Comparing sites using Web impact factors. Journal of Documentation, 55(5), 577-592, 1999.

9. L. Vaughan and K. Hysen, Relationship between links to journal Web sites and Impact Factors. Aslib Proceedings: New Information Perspectives, 54(6), 356-361, 2002.

10. L. Vaughan and M. Thelwall, Scholarly use of the Web: What are the key inducers of links to journal Web sites? Journal of the American Society for Information Science and Technology, 54(1), 29-38, 2003.

11. K. Kousha and M. Thelwall, Motivations for URL citations to open access library and information science articles. Scientometrics, to appear, 2006.

12. L. Vaughan, and D. Shaw, Bibliographic and Web citations: What is the difference? Journal of the American Society for Information Science and Technology, 54(4), 1313-1324, 2003.

13. L. Vaughan, and D. Shaw, Web citation data for impact assessment: A comparison of four science disciplines. Journal of the American Society for Information Science and Technology, 56(10):1075–1087, 2005.

14. S. Harnad, Scholarly Skywriting and the Prepublication Continuum of Scientific Inquiry. Psychological Science 1: 342 – 343, 1990, Retrieved November, 12, 2004, from http://www.cogsci.soton.ac.uk/~harnad/Papers/Harnad/harnad90.skywriting.html/

15. S. Harnad, Post-Gutenberg Galaxy: The Fourth Revolution in the Means of Production of Knowledge. Public-Access Computer Systems Review, 2 (1): 39 – 53, 1991, Retrieved November 12, 2004 from http://www.cogsci.soton.ac.uk/~harnad/Papers/Harnad/harnad91.postgutenberg.html/

16. S. Harnad, The impact of electronic journals on scholarly communication: A citation analysis. The Public-Access Computer Systems Review, 7, 1996, Retrieved November 13, 2001, from http://info.lib.uh.edu/pr/v7/n5/hart7n5.html/

17. S. Harnad, The Future of Scholarly Skywriting, in i in the Sky: Visions of the information future, 1999, Retrieved November, 12, 2004, from http://cogprints.org/1698/00/harnad99.aslib.html/

18. K. Antelman, Do Open-Access Articles Have a Greater Research Impact? College & Research Libraries, 65(5): 372-382, 2004.

19. S. Harnad, T. Brody, F. Vallieres, L. Carr, S. Hitchcock, Y. Gingras, C. Oppenheim, H. Stamerjohanns, and E. Hilf, The access/impact problem and the green and gold roads to open access. Serials Review 30, 2004, Retrieved November, 12, 2004, from http://www.nature.com/nature/focus/accessdebate/21.html/

20. S. Lawrence, Free online availability substantially increases a paper's impact. Nature, 411, 521, 2001, Retrieved November 13, 2001, from http://www.nature.com/nature/debates/e-access/Articles/lawrence.html/

21. M.J. Kurtz, Restrictive access policies cut readership of electronic research journal articles by a factor of two, Harvard-Smithsonian Centre for Astrophysics, Cambridge, MA, 2004, Retrieved November 13, 2001, from http://opcit.eprints.org/feb19oa/kurtz.pdf/

22. E.-J. Shin, Do Impact Factors change with a change of medium? A comparison of Impact Factors when publication is by paper and through parallel publishing. Journal of Information Science, 29(6), 527 – 533, 2003.

23. T. Brody, H. Stamerjohanns, F. Vallières, S. Harnad, Y. Gingras, and C. Oppenheim, The effect of open access on citation impact, 2004. Retrieved November 13, 2001, from http://www.ecs.soton.ac.uk/~harnad/Temp/OA-TAadvantage.pdf/

24. ISI press release essay on the impact of open access journals: A citation study from Thomson ISI. Retrieved November 13, 2004, from http://www.isinet.com/oaj/

25. A.A. Goodrum, K.W. McCain, S. Lawrence, and C.L. Giles, Scholarly publishing in the Internet age: a citation analysis of computer science literature. Information Processing & Management, 37(5), 661-676, 2001.

26. D. Zhao and E. Logan, Citation analysis using scientific publications on the Web as data source: A case study in the XML research area. Scientometrics, 54(3), 449-472, 2002.

27. K. Bauer and N. Bakkalbasi, An Examination of Citation Counts in a New Scholarly Communication Environment. D-Lib Magazine, 11(9), 2005, Retrieved December 23, 2005, from http://www.dlib.org/dlib/september05/bauer/09bauer.html /

28. S. Brin and L. Page, The anatomy of a large scale hypertextual Web search engine. Computer Networks and ISDN Systems, 30(1-7), 107-117, 1998.

29. H., F. Moed, Citation analysis in research evaluation. New York: Springer, 2005.

30. M. Thelwall, L. Vaughan, and L. Björneborn, Webometrics. Annual Review of Information Science and Technology, 39, Medford, NJ: Information Today Inc. 81-135, 2005.

31. M. Thelwall, Interpreting social science link analysis research: A theoretical framework. Journal of the American Society for Information Science and Technology. 57(1), 60-68, 2006.

32. A.G. Smith, Web links as analogues of citations. Information Research, 9(4), 2004, Retrieved March 20, 2005, from http://informationr.net/ir/9-4/paper188.html

33. L. Björneborn and P. Ingwersen, Perspectives of Webometrics. Scientometrics, 50(1), 65-82, 2001.

34. L. Egghe, New informetric aspects of the Internet: some reflections - many problems. Journal of Information Science, 26(5), 329-335, 2000.

35. W. Glänzel, On some on some principle differences between citations and sitation links. A methodological and mathematical approach. Nerdi lecture delivered at NIWI, KNAW, Amsterdam, on 13 February, 2003. Updated version of a paper presented at the 6th Nordic Workshop on Bibliometrics, Stockholm, October 4-5, 2001.

36. H.J. Kim, Motivations for hyperlinking in scholarly electronic articles: A qualitative study. Journal of the American Society for Information Science, 51(10), 887-899, 2000.

37. S.D. Herring, Use of electronic resources in scholarly electronic journals: A citation analysis. College and Research Libraries, 63(4), 334-340, 2002.

38. D. Stuart, Personal communication, 2006.

39. About Google Scholar, Retrieved December 12, 2005, from http://scholar.google.com/scholar/about.html/

40. P. Jacso, Google Scholar Beta. Péter's Digital Reference Shelf, 2004, Retrieved Jan 10, 2006, from http://snipurl.com/dwco/

41. P. Jacso, Google Scholar: the pros and the cons. Online Information Review, 29 (2), 208-214, 2005.

42. G. R. Notess, Scholarly Web Searching: Google Scholar and Scirus. Online, 29(4), 2005.

43. R. Kling, and E. Callahan, Electronic journals, the internet, and scholarly publishing. Annual Review of Information Science and Technology, 37, 127-177, 2003.

44. J. Bar-Ilan, The use of Web search engines in information science research. Annual Review of Information Science and Technology, 38, 231-288, 2004.

45. L. Vaughan, New measurements for search engine evaluation proposed and tested. Information Processing & Management, 40(4), 677-691, 2004.

46. S. Lawrence, and C. L. Giles, Accessibility of information on the web. Nature, 400, 107-109, 1999.

47. J. Bar-Ilan, Search engine results over time - a case study on search engine stability. Cybermetrics 2/3, 1999, Retrieved January 26, 2006, from http://www.cindoc.csic.es/cybermetrics/articles/v2i1p1.html

48. W. Mettrop and P. Nieuwenhuysen, Internet search engines - fluctuations in document accessibility. Journal of Documentation, 57(5), 623-651, 2001.

49. P. Mayr and F. Tosques, Google Web APIs: An instrument for webometric analyses? 2005, Retrieved January 20, 2006, from http://www.ib.hu-berlin.de/%7Emayr/arbeiten/ISSI2005_Mayr_Toques.pdf

50. J. Fry, and S. Talja, The cultural shaping of scholarly communication: Explaining e-journal use within and across academic fields. In ASIST 2004: Proceedings of the 67th ASIST Annual Meeting (Vol. 41, pp. 20-30): Medford, NJ.: Information Today.

51. R. Whitley, The intellectual and social organization of the sciences (2 ed.). Oxford: Oxford University Press, 2000.


Downloads

Downloads per month over past year

Actions (login required)

View Item View Item
Contact us
Send email Sponsors
Sponsor: AIMS Sponsor: D&P Sponsor: UniNa CAB Get connected
Facebook Facebook Twitter Twitter Linkedin LinkedIn RSS RSS