Abstract
Summary: Participatory medicine flourishes where there is an unimpeded flow of information. Open and freely available access to medical research improves outcomes and empowers e-patients. Traditionally, research papers undergo peer review before publication. Two trends, open access and social media, are changing the peer review process. E-patients must be aware that traditional peer review applies different criteria and methods than review through social media outlets. Although still developing, these review processes may affect the evaluation of research quality.
Keywords: Open access, social media, peer review, participatory medicine, e-patients.
Citation: Pickard KT. Impact of open access and social media on scientific research. J Participat Med. 2012 Jul 18; 4:e15.
Published: July 18, 2012.
Competing Interests: The author has declared that no competing interests exist.
About Open Access
Today, the work product of most scientific research is the peer-reviewed research article. Each year, over 2.5 million articles are published in over 24,000 peer-review journals.[1] Access to these research papers is closed to many potential readers because they cannot afford access; open access seeks to make this research freely available. According to the Budapest Open Access Initiative, open access achieves its goal of “free and unrestricted online availability” through two central tenets: (1) depositing refereed journal articles in open online archives (called self-archiving), and (2) creating new journals that will not invoke copyright to restrict access to the material they publish.[2] Today, open access journals often employ Creative Commons licenses to ensure unrestricted access.[3][4] Although over 5,000 open access journals are available today, only 10% of published research in biology and medicine is open access.[5]
In open access journals, authors typically pay to publish their research. In non-open access journals, journal subscription fees typically fund access and publication. Open access leaders such as BioMed Central, Frontiers, and PLoS charge an average of $2,500 to publish peer-reviewed open access articles. In 2012, a new open access journal, eLife, will be waiving submission fees during an initial period.[6]
E-Patients and Open Access
In 2008, Congress passed the Consolidated Appropriations Act, which directed the National Institutes of Health to create a public access policy for NIH funded research.[7] The result, PubMed Central, is a free full-text archive with over 2.4 million biomedicine and life science articles.[8] It is a valuable and free resource for e-patients, whose stories highlight the importance of public access to scientific literature.[9][10]
Open Access Methods
Most journals allow scientists to post published papers on their own websites. A website that combines social networking and open access, ResearchGate, allows scientists to self-archive their research papers. This practice is beneficial to ResearchGate, which has indexed over 10 million open access articles to date. Especially popular with scientists working in medicine and biology, the site has approximately 1.7 million users.[11][12]
Another publishing route is through preprint sites based on the arXiv model pioneered over 20 years ago. Information is disseminated rapidly, but papers submitted are not subject to traditional peer review.[13] A preprint site for biology and medicine, F1000 Research, is expected in 2012. Other commercial tools and sites such as EndNote, Zotero, and Mendeley are automating research workflow. Mendeley, with over 34 million research papers, also incorporates an academic social network.[14] PaperCritic, which works in tandem with Mendeley, allows scientists to review each other’s work, but adoption may be limited until the number of reviewers increases to a point where other researchers find it valuable to participate. Wikis and blogs are also being used to enhance collaborative research.[15]
Open Access and Social Media
Over fifty years ago, Eugene Garfield, a founder in the field of bibliometrics, introduced the concept of the citation index.[16] His ideas have blossomed into a host of “impact factors” that measure the degree of a journal’s influence by counting the number of times its articles are cited. Since academic advancement is tied to publication, most researchers submit articles to high impact journals, even though acceptance rates can be in the single digits.[17]
Although open access articles may be accessed more frequently, traditional impact factors measure citations rather than readership.[18] Using impact factor measurements from sources such as Journal Citation Reports, scientific journals with the highest impact factors are not open access.[19] In certain fields such as biology, however, open access journals rate highly.[20] When open access is combined with social media, the influence of research articles shifts from publications to individual researchers. For example, in a recent controversial paper illustrating the influence of social media, future research citations were correlated with the number of times the article was discussed on Twitter, especially within the first three days after publication.[21] Subsequent criticism from bloggers triggered a correction to the paper, showing post-publication benefits from social media.[22][23] The use of blogging to challenge the results of a microbiology paper published in Science produced similar effects.[24]
Peer Review Alternatives
A formidable challenge to the current process is the movement to reimagine the peer review model. A growing number of individual scientists has argued for improving peer review.[25][26][27][28] Critics argue that the peer review process is slow, stifles innovation, and lacks transparency (most reviewers remain anonymous). With social networks, alternatives to peer review are emerging. The most commonly employed model is based on comment crowdsourcing, similar to how buyers rate products and sellers on Amazon or eBay. Anonymous peer review is replaced with public reviews that can include the reviewer’s reputation (as determined by peers) to weight the review score. Weighting an author’s reputation can be achieved with concepts such as the author’s scholar factor, h-index, or other “altmetrics.[29][30][31]” For example, Google Scholar Metrics uses the h-index concept to allow researchers to gauge the influence of recently published articles.[32] As open publishing platforms such as F1000 Research, PeerJ, and the Journal of Participatory Medicine emerge, alternatives to traditional peer review may gain acceptance.[33][34][35] These platforms employ concepts such as invited moderation, post-publication comment, post-publication measures of quality and impact, and community-based review.[36][37] If opinion formation shifts through the influence of social media on research, academics may have to worry about “get visible or vanish” instead of “publish or perish.[38]” Indeed, developing a comprehensive online presence increases the likelihood that research published in open access journals will be found, read, and cited by other journalists, e-patients, and scientists.
Conclusion
How social media will influence the peer review process is an ongoing debate. The crucial step for the research community is to adopt a model that incorporates the validation and critical review of results. E-patients must be aware that traditional peer review applies different criteria and methods from review through social media outlets. Although developing rapidly, these review processes may affect the evaluation of research quality. In a world where increasingly more people are actively participating to improve their health, often collectively, open access methods will be required to disseminate research results. Social networks will undoubtedly play a growing role.
References
- @ccess working group. Open Knowledge Foundation. Available at: http://access.okfn.org/. Accessed July 3, 2012.↩
- Budapest Open Access Initiative. Open Society Institute website. Available at: http://www.soros.org/openaccess/read. Accessed July 3, 2012. ↩
- Creative Commons. Available at: http://creativecommons.org/. Accessed July 3, 2012. ↩
- Brown PO, Eisen MB, Varmus HE. Why PLoS Became a Publisher. PLoS Biol. 2003;1(1): e36. Available at: http://www.plosbiology.org/article/info%3Adoi%2F10.1371%2Fjournal.pbio.0000036. Accessed July 3, 2012. ↩
- Björk B-C, Welling P, Laakso M, Majlender P, Hedlund T, Guðnason G. Open Access to the Scientific Journal Literature: Situation 2009. PLoS ONE. 2010;5(6):e11273. Available at: http://www.plosone.org/article/info%3Adoi%2F10.1371%2Fjournal.pone.0011273. Accessed July 3, 2012. ↩
- eLife. Available at: http://www.elifesciences.org/. Accessed July 3, 2012. ↩
- Public Access Homepage. National Institutes of Health. Available at: http://publicaccess.nih.gov/. Accessed July 3, 2012. ↩
- PubMedCentral. Available at: http://www.ncbi.nlm.nih.gov/pmc/. Accessed July 3, 2012. ↩
- Patients – Who Needs Access? You Need Access! Whoneedsaccess.org. Available at: http://whoneedsaccess.org/category/patients/. Accessed July 3, 2012. ↩
- e-Patients. e-Patients.net. Available at: http://e-patients.net/. Accessed July 3, 2012. ↩
- Social networking for scientists: Professor Facebook. The Economist. February 11, 2012. Available at: http://www.economist.com/node/21547218. Accessed July 3, 2012. ↩
- ResearchGate. Available at: http://www.researchgate.net. Accessed July 3, 2012. ↩
- arXiv help – The arXiv endorsement system. arXiv.org. Available at: http://arxiv.org/help/endorsement. Accessed July 3, 2012. ↩
- Mendeley. Available at: http://www.mendeley.com/. Accessed July 3, 2012. ↩
- Waldrop MM. Science 2.0 – Is Open Access Science the Future? Sci Am. 2008;298(5):68-73. Available at: http://www.scientificamerican.com/article.cfm?id=science-2-point-0. Accessed July 3, 2012. ↩
- Cronin B, Atkins HB. The Web of Knowledge: A Festschrift in honor of Eugene Garfield. ASIS&T Monograph Series. September 2000. Available at: http://www.garfield.library.upenn.edu/webofknowledge.html. Accessed July 3, 2012. ↩
- Science/AAAS FAQ. Science Magazine [website]. Available at: http://www.sciencemag.org/site/feature/contribinfo/faq/index.xhtml#pct_faq. Accessed July 3, 2012. ↩
- Davis PM. Open access, readership, citations: a randomized controlled trial of scientific journal publishing. FASEB J. 2011; 25:1-6. Available at: doi:10.1096/fj.11-183988. Accessed July 3, 2012. ↩
- Top Ten Most-Cited Journals (All Fields) 1999-2006. Sciencewatch.com. Available at: http://sciencewatch.com/dr/sci/09/aug2-09_2/. Accessed July 3, 2012. ↩
- Shaw P. Open Access, Impact Factors and Scientific Publishing. Galter Health Sciences Library News [blog post]. Available at: http://www.galter.northwestern.edu/news/index.cfm/2010/10/1/Open-Access-Impact-Factors-and-Scientific-Publishing. Accessed July 3, 2012. ↩
- Eysenbach G. Can Tweets Predict Citations? Metrics of Social Impact Based on Twitter and Correlation with Traditional Metrics of Scientific Impact. J Med Internet Res. 2011;13(4):e123. Available at: http://www.jmir.org/2011/4/e123/. Accessed July 3, 2012. ↩
- Correction: Can Tweets Predict Citations? Metrics of Social Impact Based on Twitter and Correlation with Traditional Metrics of Scientific Impact. J Med Internet Res. 2012;14(1):e7. Available at: http://www.jmir.org/2012/1/e7/. Accessed July 3, 2012. ↩
- Davis P. Tweets, and Our Obsession with Alt Metrics. The scholarly kitchen [blog post] Available at: http://scholarlykitchen.sspnet.org/2012/01/04/tweets-and-our-obsession-with-alt-metrics/. Accessed July 3, 2012. ↩
- Redfield R. Arsenic-associated bacteria (NASA’s claims). RRResearch [blog post] Available at: http://rrresearch.fieldofscience.com/2010/12/arsenic-associated-bacteria-nasas.html. Accessed July 3, 2012. ↩
- Eisen M. Peer review is f***ed up – let’s fix it. It is NOT junk [blog post] Available at: http://www.michaeleisen.org/blog/?p=694. Accessed July 3, 2012. ↩
- Nielsen M. Reinventing Discovery. Michael Nielsen [blog post] Available at: http://michaelnielsen.org/blog/reinventing-discovery/. Accessed July 3, 2012. ↩
- Pickrell J. Why publish science in peer-reviewed journals? Genomes Unzipped [blog post] Available at: http://www.genomesunzipped.org/2011/07/why-publish-science-in-peer-reviewed-journals.php. Accessed July 3, 2012. ↩
- Smith R. Classical peer review: an empty gun. Breast Cancer Research. 2010, 12(Suppl 4):S13. Available at: http://breast-cancer-research.com/content/12/S4/S13. Accessed July 3, 2012. ↩
- Bourne PE, Fink JL. I Am Not a Scientist, I Am a Number. PLoS Comput Biol. 2008;4(12):e1000247. Available at: http://www.ploscompbiol.org/article/info:doi/10.1371/journal.pcbi.1000247. Accessed July 3, 2012. ↩
- Meho L. The rise and rise of citation analysis. Physics World. January 2007. Available at: http://www.slis.indiana.edu/media/paper/PWJan07meho.pdf. Accessed July 3, 2012. ↩
- http://altmetrics.org. Accessed July 3, 2012.↩
- Google Scholar Metrics for Scholars. Google Scholar Blog [blog post] Available at: http://googlescholar.blogspot.com/2012/04/google-scholar-metrics-for-publications.html. Accessed July 3, 2012. ↩
- F1000 Research. Available at: http://f1000research.com. Accessed July 3, 2012.↩
- PeerJ. Available at: http://peerj.com. Accessed July 3, 2012.↩
- Journal of Participatory Medicine. Available at: https://participatorymedicine.org/journal. Accessed July 3, 2012. ↩
- Peer Review. UK Parliament Website. Available at: http://www.publications.parliament.uk/pa/cm201011/cmselect/cmsctech/writev/856/m41.htm. Accessed July 3, 2012. ↩
- Shashok K. Who’s a peer? Improving peer review by including additional sources of expertise. J Participat Med. 2010 Dec 8; 2:e15. Available at: https://participatorymedicine.org/journal/opinion/commentary/2010/12/08/1278/. Accessed July 3, 2012. ↩
- Enzor C. Get Visible or Vanish: Digital Publishing for Science Professionals. ScienceOnline2012. Available at: http://www.youtube.com/watch?v=fs4mZrxl7gg. Accessed July 3, 2012. ↩
Acknowledgements
The author would like to acknowledge Kimberly Pickard, Melanie Swan, and the JoPM reviewers for their assistance and insightful suggestions.
Copyright: © 2012 K. Thomas Pickard. Published here under license by The Journal of Participatory Medicine. Copyright for this article is retained by the author, with first publication rights granted to the Journal of Participatory Medicine. All journal content, except where otherwise noted, is licensed under a Creative Commons Attribution 3.0 License. By virtue of their appearance in this open-access journal, articles are free to use, with proper attribution, in educational and other non-commercial settings.
Dear Thomas,
Thanks for this. I am also a big believer in OA, and have recently seen a consequence of the closed access system that I thought I’d share briefly. Through our work with ALS Untangled (http://www.alsuntangled.com/) we have been investigating some claims that ALS is not a “real” disease. The authors of this theory draw upon a number of pieces of recent scientific literature, but as they were lay-people rather than academics, they could only access the OA papers. This was a shame as their knowledge rested upon only the abstracts of closed papers (which don’t always tell the whole picture) or the relatively small number of available OA papers which skewed their perspective. It’s unclear whether they’d still believe what they believe with better access to the literature but it seems that closed access is probably an extenuating factor to poor understanding of many important issues in science.
With regards to peer review, I can tell you as a frequent peer reviewer that much depends on the relationship between editor and reviewer, and in their feelings towards that journal. After all, the “anonymous” bit is between author and reviewer, not between editor and reviewer. If you’re hoping to get something published in a top-tier journal, it certainly won’t hurt if the editor can see that you’ve been a frequency and diligent peer reviewer – an invisible quid pro quo that while certainly not “greasing the skids”, probably doesn’t hurt at all in at least being considered rather than rejected out of hand for a paper that’s marginal. Some journals such as Journal of Medical Internet Research (JMIR.org) allow authors to rate their peer reviewers, and for the section editor to do so also. This allows for good reviewers to be used again and poor reviewers to be avoided. They also have a system of open peer review on their website, and you can see at the end of each paper who the reviewers were, e.g. http://www.jmir.org/2012/3/e90/). That certainly encourages me to be more civil and constructive, of course I always am 😉
One final point that I’ve made before is that I believe much of the argument about OA is restricted to stones flung by trebuchet in between the ivory towers. What’s important are the people outside the walls, i.e. patients, caregivers, students, the public: http://blogs.plos.org/speakingofmedicine/2012/06/14/open-access-is-not-for-scientists-its-for-patients/
Best wishes
Paul
Paul,
Thank you for your comments and feedback about the article.
Regarding peer review, I recently learned about the use of “Topic Pages” in Wikipedia as suggested by Prof Philip Bourne’s computational biology team at UCSD: http://dx.doi.org/10.1371/journal.pcbi.1002446
Although the topic of “circular permutation in proteins” may be a bit obscure, the associated Wikipedia topic page (http://en.wikipedia.org/w/index.php?title=Circular_permutation_in_proteins) incorporates open peer review on the “Talk” tab, providing a high level of transparency during the review process.
The importance of access to scientific literature is tremendously important to patients, as you point out. But even if all articles were open access, the selective review of published research on a given topic (like ALS) can lead to erroneous conclusions. The use of transparent review models will become increasingly important, especially as the medical research community slowly adopts preprint publication models, similar to how most physics research is currently published.
Kind regards,
— Thomas