Evaluation of Brazilian emerging ejournals in Science and technology : a proposed methodology based on analysis of links to ejournal's site

Marcondes, Carlos Henrique and Mendonça, Marília Alvarenga Rocha Evaluation of Brazilian emerging ejournals in Science and technology : a proposed methodology based on analysis of links to ejournal's site., 2004 . In 8th ICCC International Conference of Electronic Publishing, Brasilia (Brazil), 23-26 June 2004. [Conference paper]

Preview

PDF ELPUB-2004-Marcondes-Evaluation_of_Brazilian_emerging_ejournals.pdf Download (93kB) | Preview

English abstract

This paper reports the results of a research project, sponsored by CNPq – the Brazilian Council for the Development of Science an Technology -, which develop an evaluation methodology for the emerging Brazilian ejournals in Science and. In Information Science, citation is a traditional measure of prestige for a scientific journal. Brazilian ejournals are a recent reality in Brazilian Web scenario. One of the main barriers to increase their use by Brazilian academic community is the lack of systematic evaluation, like that provided by ISI’s impact factor. The proposed methodology were based on the quantitative and qualitative analysis of the links to the site of the ejournal, obtained by submitting its URL to Google search engine. The methodology considers not only the number of links directed to a site, but also the existence of qualitative links, those of “authorities” sites in an specific knowledge area, and those of non-Brazilian institutions. “Authorities”, in Brazilian scientific scenario, are considered sites of institutions like specialized or academic libraries, sites of scientific or professional associations and sites of important post graduation programs in a specific area; non-Brazilian sites were also considered qualitative links, because they indicate the reach of an ejournal. These different kinds of links were weighted and used to calculate a grade to an ejournal site, as an indicator of its relevance in a knowledge area. The methodology was first tested and fine tuned in Information Science area and then applied to Brazilian ejournals of several knowledge areas.. This paper reports the results and discusses future developments such as how the methodology could be automated and made available through a web site, having as input URLs of the ejournal site and URLs of community agreed “authorities” sites in a given area. This proposal, in the scope of Brazilian public policies concerning scientific and technological information, could constitute in an cooperative evaluation web resource to the Brazilian scientific community, in addition to other resources like the SciELO gateway (http://www.scielo.br) and the CAPES scientific journals gateway (http://www.periodicos.capes.gov.br).

Portuguese abstract

This paper reports the results of a research project, sponsored by CNPq – the Brazilian Council for the Development of Science an Technology -, which develop an evaluation methodology for the emerging Brazilian ejournals in Science and. In Information Science, citation is a traditional measure of prestige for a scientific journal. Brazilian ejournals are a recent reality in Brazilian Web scenario. One of the main barriers to increase their use by Brazilian academic community is the lack of systematic evaluation, like that provided by ISI’s impact factor. The proposed methodology were based on the quantitative and qualitative analysis of the links to the site of the ejournal, obtained by submitting its URL to Google search engine. The methodology considers not only the number of links directed to a site, but also the existence of qualitative links, those of “authorities” sites in an specific knowledge area, and those of non-Brazilian institutions. “Authorities”, in Brazilian scientific scenario, are considered sites of institutions like specialized or academic libraries, sites of scientific or professional associations and sites of important post graduation programs in a specific area; non-Brazilian sites were also considered qualitative links, because they indicate the reach of an ejournal. These different kinds of links were weighted and used to calculate a grade to an ejournal site, as an indicator of its relevance in a knowledge area. The methodology was first tested and fine tuned in Information Science area and then applied to Brazilian ejournals of several knowledge areas.. This paper reports the results and discusses future developments such as how the methodology could be automated and made available through a web site, having as input URLs of the ejournal site and URLs of community agreed “authorities” sites in a given area. This proposal, in the scope of Brazilian public policies concerning scientific and technological information, could constitute in an cooperative evaluation web resource to the Brazilian scientific community, in addition to other resources like the SciELO gateway (http://www.scielo.br) and the CAPES scientific journals gateway (http://www.periodicos.capes.gov.br).

Item type:	Conference paper
Keywords:	scientific communication, electronic publishing, electronic journals, evaluation, Brazil
Subjects:	I. Information treatment for information services > II. Filtering.
Depositing user:	Carlos Marcondes
Date deposited:	07 May 2006
Last modified:	02 Oct 2014 12:03
URI:	http://hdl.handle.net/10760/7521

References

DAY, Michael. The scholarly journal in transition and the PubMed Central proposal. Ariadne, v. 21, sept.1999. URL: <http://www..ariadne.ac.uk/issue21/pubmed/>.

MEADOWS, Arthur Jack. A comunicação científica. Brasília : Briquet de Lemos, 1999.

LAWRENCE, Steve. Free online availability substantially increases a paper’s impact. Nature Web debates. URL: <http://www.nature.com/nature/debates/e-access/Articles/lawrence.html>

ODLYSKO, Andrew. The economic of electronic journals. Journal of Electronic Publishing, v.4, n.1, Sept. 1998. URL: <http://www.press.umich.edu/jep/04-01/odlyzko.html>.

KLEINBERG, Jon M.; LAWRENCE, Steve. The structure of the Web. Science, v.294, Nov. 2001, p.1849-1850 .

HENZINGER, Monika. Link analysis in information retrieval. 2000 IEEE. URL: <http://research.microsoft.com/research/db/debull/A0sept/henzinge.ps>

KLEINBERG, Jon M. Authoritative Sources in a hyperlinked environment. Proceedings of the ninth annual ACM-SIAM symposium on Discrete algorithms,1998 , San Francisco, California, United States. New York : ACM press, 1998. p. 668 – 677. URL: <http://doi.acm.org/10.1145/314613.315045>.

GARFIELD, Eugene. The Impact Factor. Current Contents, June, 1994. URL <http://www.isinet.com/isi/hot/essays/journalcitationreports/7.html>.

MARCONDES, Carlos H.; SAYÃO, Luis F.; MAIA, Cláudio M.; DANTAS, Marco A. R. Estado da arte dos periódicos acadêmicos eletrônicos. In: ENCONTRO NACIONAL DE PESQUISA EM CIÊNCIA DA INFORMAÇÃO, 5, 2003, Belo Horizonte. Belo Horizonte : UFRG, 2003. CD-ROM.

PACKER, Abel Laerte. SciELO - a Model for Cooperative Electronic Publishing in Developing Countries. D-Lib Magazine [online]. 2000, vol. 6, no. 10. URL: <http://www.dlib.org/dlib/october00/10inbrief.html#PACKER>. ISSN 1082-9873.

PACKER, Abel Laerte. The SciELO Model for electronic publishing and measuring of usage and impact of Latin American and Caribbean scientific journals. In ICSU-UNESCO International Conference: Electronic Publishing in Science, 2 [online]. Paris, 2001, pp. 19-23. URL: <http://www.unesco.org/science/publication/electronic_publishing_2001/proceedings_sess3.shtml#s3_packer>.

TESTA, Janes. The ISI database: the journal selection process. 1997. URL: <http://www.isinet.com/essays/selectionofmaterialforcoverage/199701.html>

HYLDEGAARD, Jette; SEIDEN, Piet. My e-journal – exploring the usefulness of personalized access to scholarly articles and services. Information Research, v. 9, n. 3, April, 2004. URL: <http://information.net/ir/9-3/paper181.html>.

Downloads

Actions (login required)

View Item