Cogprints

The Open Research Web: A Preview of the Optimal and the Inevitable

Shadbolt, Nigel and Brody, Tim and Carr, Les and Harnad, Stevan (2006) The Open Research Web: A Preview of the Optimal and the Inevitable. [Book Chapter] (In Press)

Full text available as:

[img] HTML
78Kb
[img]
Preview
PDF
1464Kb
[img] Other
7Mb

Abstract

The multiple online research impact metrics we are developing will allow the rich new database , the Research Web, to be navigated, analyzed, mined and evaluated in powerful new ways that were not even conceivable in the paper era – nor even in the online era, until the database and the tools became openly accessible for online use by all: by researchers, research institutions, research funders, teachers, students, and even by the general public that funds the research and for whose benefit it is being conducted: Which research is being used most? By whom? Which research is growing most quickly? In what direction? under whose influence? Which research is showing immediate short-term usefulness, which shows delayed, longer term usefulness, and which has sustained long-lasting impact? Which research and researchers are the most authoritative? Whose research is most using this authoritative research, and whose research is the authoritative research using? Which are the best pointers (“hubs”) to the authoritative research? Is there any way to predict what research will have later citation impact (based on its earlier download impact), so junior researchers can be given resources before their work has had a chance to make itself felt through citations? Can research trends and directions be predicted from the online database? Can text content be used to find and compare related research, for influence, overlap, direction? Can a layman, unfamiliar with the specialized content of a field, be guided to the most relevant and important work? These are just a sample of the new online-age questions that the Open Research Web will begin to answer.

Item Type:Book Chapter
Additional Information:Adams, J. (2005) Early citation counts correlate with accumulated impact. Scientometrics, 63 (3): 567-581 Ajiferuke, I. , & Wolfram, D. (2004). Modeling the characteristics of web page outlinks. Scientometrics, 59(1), 43-62. Alani, H., Nicholas, G., Glaser, H., Harris, S. and Shadbolt, N. (2005) Monitoring Research Collaborations Using Semantic Web Technologies. 2nd European Semantic Web Conference (ESWC). Antelman, K. (2004) Do Open-Access Articles Have a Greater Research Impact? College and Research Libraries, 65(5):372-382 Baudoin, L. , Haeffner-Cavaillon, N. , Pinhas, N. , Mouchet, S. and Kordon, C. (2004) Bibliometric indicators: realities, myth and prospective Med Sci (Paris), 20 (10):909-15 Bauer, K. and Bakkalbasi, N. (2005) An Examination of Citation Counts in a New Scholarly Communication Environment D-Lib Magazine, 11(9) Bauer, K. and Bakkalbasi, N. (2005) An Examination of Citation Counts in a New Scholarly Communication Environment D-Lib Magazine, 11(9), September 2005. Berners-Lee, T, Hendler, J. and Lassila, O. (2001) The Semantic Web, Scientific American 284 (5): 34-43. http://www.scientificamerican.com/article.cfm?articleID=00048144-10D2-1C70-84A9809EC588EF21&catID=2 Belew, R. (2005) Scientific impact quantity and quality: Analysis of two sources of bibliographic data Arxiv. org, cs. IR/0504036 Berners-Lee, T., De Roure, D., Harnad, S. and Shadbolt, N. (2005) Journal publishing and author self-archiving: Peaceful Co-Existence and Fruitful Collaboration. Open Letter to Research Councils UK. Bollen, J. and Luce, R. (2002) Evaluation of Digital Library Impact and User Communities by Analysis of Usage Patterns D-Lib Magazine, Vol. 8, No. 6 Bollen, J. , Van de Sompel, H. , Smith, J. and Luce, R. (2005) Toward alternative metrics of journal impact: A comparison of download and citation data. Information Processing and Management, 41(6): 1419-1440, Bollen, J. , Vemulapalli, S. S. , Xu, W. and Luce, R. (2003) Usage Analysis for the Identification of Research Trends in Digital Libraries D-Lib Magazine, Vol. 9, No. 5. Borgman, C. L. and Furner, J. (2002) Scholarly Communication and Bibliometrics , Annual Review of Information Science and Technology, Vol. 36, edited by B. Cronin, 2002 Brody, T. (2003) Citebase Search: Autonomous Citation Database for e-print Archives, sinn03 Conference on Worldwide Coherent Workforce, Satisfied Users - New Services For Scientific Information, Oldenburg, Germany, September 2003 Brody, T. (2004) Citation Analysis in the Open Access World Interactive Media International Brody, T. , Harnad, S. and Carr, L. (2005) Earlier Web Usage Statistics as Predictors of Later Citation Impact. Journal of the American Association for Information Science and Technology (JASIST, in press). Brody, T. , Kampa, S. , Harnad, S. , Carr, L. and Hitchcock, S. (2003) Digitometric Services for Open Archives Environments. In Proceedings of European Conference on Digital Libraries 2003, pages pp. 207-220, Trondheim, Norway. Brookes, B. C. (1980/1981). The foundations of information science. Journal of Information Science 2 (1980) pp. 125-133, 209-221, 269-173; 3 (1981) pp. 3-12. Carr, L. and Harnad, S. (2005) Keystroke Economy: A Study of the Time and Effort Involved in Self-Archiving Carr, L. , Hitchcock, S. , Hall, W. and Harnad, S. (2000) A usage based analysis of CoRR. ACM SIGDOC Journal of Computer Documentation 24(2):pp. 54-59. Carr, L. , Hitchcock, S. , Hall, W. and Harnad, S. (2001) Enhancing OAI Metadata for Eprint Services: two proposals. In Proceedings of Experimental OAI-based Digital Library Systems Workshop 5, pages pp. 54-59, Darmstadt. Cockerill, M. J. (2004) Delayed impact: ISI's citation tracking choices are keeping scientists in the dark BMC Bioinformatics 2004, 5:93 Darmoni, S. J. et al. (2002)Reading factor: a new bibliometric criterion for managing digital libraries, Journal of the Medical Library Association, Vol. 90, No. 3, July 2002 De Roure, D., Jennings, N. R. and Shadbolt, N. R. (2005) The Semantic Grid: Past, Present and Future. Procedings of the IEEE 93(3) pp. 669-681 Diamond, Jr. , A. M. (1986) What is a Citation Worth? J. Hum. Resour. , 21:200-15, 1986 Donohue JM, Fox JB (2000) A multi-method evaluation of journals in the decision and management sciences by US academics. Omega-International Journal of Mangement Science 28 (1): 17-36 Garfield, E. (1955) Citation Indexes for Science: A New Dimension in Documentation through Association of Ideas. Science, Vol:122, No:3159, p. 108-111 Garfield, E. (1973) Citation Frequency as a Measure of Research Activity and Performance, in Essays of an Information Scientist, 1: 406-408, 1962-73, Current Contents, 5 Garfield, E. (1988) Can Researchers Bank on Citation Analysis? Current Comments, No. 44, October 31, 1988 Garfield, E. (1998) The use of journal impact factors and citation analysis in the evaluation of science, 41st Annual Meeting of the Council of Biology Editors, Salt Lake City, UT, May 4, 1998 Garfield, E. (1999) Journal impact factor: a brief review CMAJ, 161 (8), October 19, 1999 Hajjem, C., Gingras, Y., Brody, T., Carr, L. & Harnad, S. (2005) Across Disciplines, Open Access Increases Citation Impact. (manuscript in preparation). Hajjem, C. (2005) Analyse de la variation de pourcentages d'articles en accès libre en fonction de taux de citations http://www.crsc.uqam.ca/lab/chawki/ch.htm Harnad, S. (1990) Scholarly Skywriting and the Prepublication Continuum of Scientific Inquiry Psychological Science 1: 342 - 343 (reprinted in Current Contents 45: 9-13, November 11 1991). Harnad, S. (1991) Post-Gutenberg Galaxy: The Fourth Revolution in the Means of Production of Knowledge. Public-Access Computer Systems Review 2 (1): 39 ? 53 Harnad, S. (1995) The Subversive Proposal. In: Ann Okerson & James O'Donnell (Eds.) Scholarly Journals at the Crossroads; A Subversive Proposal for Electronic Publishing. Washington, DC., Association of Research Libraries, June 1995. Harnad, Stevan (1998) For Whom the Gate Tolls? Free the Online-Only Refereed Literature. American Scientist Forum Harnad, S. (2001) Research Access, Impact and Assessment, Times Higher Education Supplement, 1487: p. 16. , 2001 Harnad, S. (2003) Enhance UK research impact and assessment by making the RAE webmetric Author eprint, in Times Higher Education Supplement, 6 June 2003, p. 16 Harnad, S. (2003) Maximizing university research impact through self-archiving Jekyll. com, No. 7, December 2003 Harnad, S. (2004) The Green Road to Open Access: A Leveraged Transition American Scientist Open Access Forum, January 07, 2004 Harnad, S. (2005) Maximising the Return on UK's Public Investment in Research (submitted) Harnad, S. (2005a) Canada is not Maximizing the Return on its Research Investment. Research Money, November 2005. Harnad, S. (2005b) Fast-Forward on the Green Road to Open Access: The Case Against Mixing Up Green and Gold. Ariadne 42. Harnad, S. and Brody, T. (2004a) Comparing the Impact of Open Access (OA) vs. Non-OA Articles in the Same Journals. D-Lib Magazine, Vol. 10 No. 6 Harnad, S. and Brody, T. (2004) Prior evidence that downloads predict citations. British Medical Journal online. Harnad, S. and Carr, L. (2000) Integrating, Navigating and Analyzing Eprint Archives Through Open Citation Linking (the OpCit Project). Current Science 79(5):pp. 629-638. Harnad, S. , Brody, T. , Vallieres, F. , Carr, L. , Hitchcock, S. , Gingras, Y. , Oppenheim, C. , Stamerjohanns, H. and Hilf, E. (2004) The Access/Impact Problem and the Green and Gold Roads to Open Access. Serials Review, Vol. 30, No. 4, 310-314 Harnad, S. , Carr, L. and Brody, T. (2001) How and Why to Free All Refereed Research from Access- and Impact-Barriers, Now How and Why To Free All Refereed Research. High Energy Physics Library Webzine 4. Harnad, S. , Carr, L. , Brody, T. and Oppenheim, C. (2003) Mandated online RAE CVs linked to university eprint archives: Enhancing UK research impact and assessment Ariadne, issue 35, April 2003 Hitchcock, S. , Brody, T. , Gutteridge, C. , Carr, L. and Harnad, S. (2003b) The Impact of OAI-based Search on Access to Research Journal Papers, Serials, Vol. 16, No. 3, November 2003, 255-260 Hitchcock, S. , Brody, T. , Gutteridge, C. , Carr, L. , Hall, W. , Harnad, S. , Bergmark, D. and Lagoze, C. (2002) Open Citation Linking: The Way Forward. D-Lib Magazine 8(10). Hitchcock, S. , Carr, L. , Jiao, Z. , Bergmark, D. , Hall, W. , Lagoze, C. and Harnad, S. (2000) Developing services for open eprint archives: globalisation, integration and the impact of links. In Proceedings of the 5th ACM Conference on Digital Libraries, San Antonio, Texas, June 2000. , pages pp. 143-151. Hitchcock, S. , Woukeu, A. , Brody, T. , Carr, L. , Hall, W. and Harnad, S. (2003) Evaluating Citebase, an open access Web-based citation-ranked search and impact discovery service. Technical Report ECSTR-IAM03-005, School of Electronics and Computer Science, University of Southampton Holmes, A. and Oppenheim, C. (2001) Use of citation analysis to predict the outcome of the 2001 Research Assessment Exercise for Unit of Assessment (UoA) 61: Library and Information Management Information Research, Vol. 6, No. 2, January 2001 Jacsó, P. (2004) The Future of Citation Indexing - Interview with Dr. Eugene Garfield. Jacsó, P. (2005) Google Scholar (Redux), Thomson Gale, June 2005 Kurtz, M. J. (2004) Restrictive access policies cut readership of electronic research journal articles by a factor of two Presented at National Policies on Open Access (OA) Provision for University Research Output: an International meeting, Southampton, 19 February 2004 Jewell, M. O., Lawrence, K. F., Tuffield, M. M., Prugel-Bennett, A., Millard, D. E., Nixon, M. S., schraefel, m. c. and Shadbolt, N. R. (2005) OntoMedia: An Ontology for the Representation of Heterogeneous Media. In Proceedings of Multimedia Information Retrieval Workshop (in press), Brazil. Kurtz, M. J. , Eichhorn, G. , Accomazzi, A. , Grant, C. , Demleitner, M. , Murray, S. S. , Martimbeau, N. and Elwell, B. (2003) The NASA Astrophysics Data System: Sociology, Bibliometrics, and Impact, Journal of the American Society for Information Science and Technology Kurtz, M. J. , Eichhorn, G. , Accomazzi, A. , Grant, C. S. , Demleitner, M. , Murray, S. S. (2004) The Effect of Use and Access on Citations, Information Processing and Management, 41 (6): 1395-1402 Kurtz, M. J. , Eichhorn, G. , Accomazzi, A. , Grant, C. S. , Demleitner, M. , Murray, S. S. , Martimbeau, N. and Elwell, B. (2003a) The Bibliometric Properties of Article Readership Information, Journal of the American Society for Information Science and Technology, 56 (2): 111-128, Kurtz, M. J. , Eichhorn, G. , Accomazzi, A. , Grant, C. S. , Thompson, D. M. , Bohlen, E. H. and Murray, S. S. (2002) The NASA Astrophysics Data System: Obsolescence of Reads and Cites. Library and Information Services in Astronomy IV, edited by B. Corbin, E. Bryson, and M. Wolf Kurtz, M. J. , Eichhorn, G. , Accomazzi, A. , Grant, C. S. , Demleitner, M. and Murray, S. S. (2004a) Worldwide Use and Impact of the Nasa Astrophysics Data System Digital Library, Journal of the American Society for Information Science and Technology, Vol. 56, No. 1, 36-45 LaGuardia, C. (2005) Scopus vs. Web of Science, Library Journal, 130(1); 40, 42, January 15, 2005 Landauer, T. K., Foltz, P. W., & Laham, D. (1998). Introduction to Latent Semantic Analysis. Discourse Processes, 25, 259-284. Lawrence, S. (2001) Free online availability substantially increases a paper's impact Nature, 31 May 2001 Lawrence, S. , Giles, C. L. , Bollacker, K. (1999), Digital Libraries and Autonomous Citation Indexing, IEEE Computer, Vol. 32, No. 6, 67-71, 1999 Lee KP, Schotland M, Bacchetti P, Bero LA (2002) Association of journal quality indicators with methodological quality of clinical research articles. Journal of the American Medical Association (JAMA) 287 (21): 2805-2808 Liu, X. , Brody, T. , Harnad, S. , Carr, L. , Maly, K. , Zubair, M. and Nelson, M. L. (2002) A Scalable Architecture for Harvest-Based Digital Libraries - The ODU/Southampton Experiments. McRae-Spencer, D. M. & Shadbolt, N.R. (2006) Semiometrics: Producing a Compositional View of Influence. (preprint) McVeigh, M. E. (2004) Open Access Journals in the ISI Citation Databases: Analysis of Impact Factors and Citation Patterns Thomson Scientific Millard, D. E. , Bailey, C. P. , Brody, T. D. , Dupplaw, D. P. , Hall, W. , Harris, S. W. , Page, K. R. , Power, G. and Weal, M. J. (2003) Hyperdoc: An Adaptive Narrative System for Dynamic Multimedia Presentations. Technical Report ECSTR-IAM02-006, Electronics and Computer Science, University of Southampton. Moed, H. F. (2005a) Citation Analysis in Research Evaluation. NY Springer. Moed, H. F. (2005b) Statistical Relationships Between Downloads and Citations at the Level of Individual Documents Within a Single Journal, Journal of the American Society for Information Science and Technology, 56(10): 1088-1097 Odlyzko, A. M. (1995) Tragic loss or good riddance? The impending demise of traditional scholarly journals, Intern. J. Human-Computer Studies 42 (1995), pp. 71-122 Odlyzko, A. M. (2002) The rapid evolution of scholarly communication Learned Publishing, 15(1), 7-19 Page, L., Brin, S., Motwani, R., Winograd, T. (1999)The PageRank Citation Ranking: Bringing Order to the Web. http://dbpubs.stanford.edu:8090/pub/1999-66 Perneger, T. V. (2004) Relation between online "hit counts" and subsequent citations: prospective study of research papers in the British Medical Journal. British Medical Journal 329:546-547 Pringle, J. (2004) Do Open Access Journals have Impact? Nature Web Focus: access to the literature Ray J, Berkwits M, Davidoff F (2000) The fate of manuscripts rejected by a general medical journal. American Journal of Medicine 109 (2): 131-135. Schwarz, G. (2004) Demographic and Citation Trends in Astrophysical Journal Papers and Preprints Bulletin of the American Astronomical Society, accepted Seglen, P. O. (1997) Why the impact factor of journals should not be used for evaluating research, British Medical Journal, 314:497 Shin E. J. (2003) Do Impact Factors change with a change of medium? A comparison of Impact Factors when publication is by paper and through parallel publishing. Journal of Information Science, 29 (6): 527-533, 2003 Smith, A. and Eysenck, M. (2002) The correlation between RAE ratings and citation counts in psychology Technical Report, Psychology, Royal Holloway College, University of London, June 2002 Spink, A. , Wolfram, D. & Jansen, B. J. & Saracevic, T. (2001). Searching the web: The public and their queries. Journal of the American Society for Information Science and Technology. 52(3), 226-234. Sponsler, E. & Van de Velde E. F. (2001) Eprints.org Software: A Review. Sparc E-News, August-September 2001. Suber, P. (2003) Removing the Barriers to Research: An Introduction to Open Access for Librarians, College & Research Libraries News, 64, February, 92-94, 113 Swan, A., Needham, P., Probets, S., Muir, A., Oppenheim, C., O?Brien, A., Hardy, R. and Rowland, F. (2005) Delivery, Management and Access Model for E-prints and Open Access Journals within Further and Higher Education. Technical Report, JISC, HEFCE. Swan, A., Needham, P., Probets, S., Muir, A., Oppenheim, C., O?Brien, A., Hardy, R., Rowland, F. and Brown, S. (2005) Developing a model for e-prints and open access journal content in UK further and higher education. Learned Publishing 18(1):pp. 25-40. Swan, A. and Brown, S. (2004) Authors and open access publishing. Learned Publishing 17(3):pp. 219-224. Tenopir, Carol and Donald W. King. Towards Electronic Journals: Realities for Scientists, Librarians and Publishers. 2000. Washington, D. C. SLA Publishing. Testa, J. and McVeigh, M. E. (2004) The Impact of Open Access Journals: A Citation Study from Thomson ISI UK Office of Science and Technology (2006) Science and innovation investment framework 2004-2014: next steps http://www.hm-treasury.gov.uk/media/1E1/5E/bud06_science_332.pdf Vaughan, L. and Shaw, D. (2004) Can Web Citations be a Measure of Impact? An Investigation of Journals in the Life Sciences. Proceedings of the 67th ASIS&T Annual Meeting, Vol. 41 pp. 516-526 Walter, G. , Bloch, S. , Hunt, G. and Fisher, K. (2003) Counting on citations: a flawed way to measure quality MJA, 2003, 178 (6): 280-281 Wolfram, D. (2003). Applied informetrics for information retrieval research. Westport, CT: Libraries Unlimited. Wouters, P. (1999) The Citation Culture PhD Thesis, University of Amsterdam Wren, J. D. (2005) Open access and openly accessible: a study of scientific publications shared via the internet. British Medical Journal, 330:1128, Yamazaki S (1995) Refereeing System of 29 Life-Science Journals Preferred by Japanese Scientists Scientometrics 33 (1): 123-129 Youngen, G. (1998) Citation Patterns Of The Physics Preprint Literature With Special Emphasis On The Preprints Available Electronically ACRL/STS 6/29/97 Youngen, G. K. (1998) Citation Patterns to Electronic Preprints in the Astronomy and Astrophysics Literature Library and Information Services in Astronomy III, ASP Conference Series, Vol. 153, 1998 Zhao, D. (2005) Challenges of scholarly publications on the Web to the evaluation of science -- A comparison of author visibility on the Web and in print journals, Information Processing and Management, 41:6, 1403-1418
Keywords:open access, research impact, citation analysis, scientometrics, semantic web, webmetrics, mentrics, research assessment, RAE
Subjects:Computer Science > Statistical Models
ID Code:4841
Deposited By: Harnad, Stevan
Deposited On:16 Apr 2006
Last Modified:11 Mar 2011 08:56

Metadata

Repository Staff Only: item control page