|Antelman, Kristin and Bakkalbasi, Nisa and Goodman, David and Hajjem, Chawki and Harnad, Stevan (2005) Evaluation of Algorithm Performance on Identifying OA. [Technical Report] (Unpublished)
Full text available as:
![[img]](http://eprints.rclis.org/style/images/fileicons/application_pdf.png)
| PDF - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader 177Kb Language: English |
Abstract(s)
This is a signal-detection analysis of the accuracy of a robot in detecting open access (OA) articles (by checking by hand how many of the articles the robot tagged OA were really OA, and vice versa). We found that the robot significantly overcodes for OA. In our Biology sample, 40% of identified OA was in fact OA. In our Sociology sample, only 18% of identified OA was in fact OA. Missed OA was lower: 12% in Biology and 14% in Sociology. The sources of the error are impossible to determine from the present data, since the algorithm did not capture URL's for documents identified as OA. In conclusion, the robot is not yet performing at a desirable level, and future work may be needed to determine the causes, and improve the algorithm.
| Item Type: | Technical Report |
|---|---|
| Keywords: | Open Access, "Open Access Advantage" |
| Subjects: | B. Information use and sociology of information. > BE. Information economics. |
| Full Metadata: | Show all fields |
| ID Code: | 5326 |
| Deposited By: | Goodman, David |
| Deposited On: | 05 Jan 2006 |
| Last Modified: | 19 Nov 2008 10:00 |
| Statistics: | View statistics for this eprint |
Commentary/Response Threads
- Antelman, Kristin and Bakkalbasi, Nisa and Goodman, David and Hajjem, Chawki and Harnad, Stevan Evaluation of Algorithm Performance on Identifying OA. (deposited 05 Jan 2006) [Currently Displayed]
Archive Staff Only: edit this record