Advanced

A prospective study on an innovative online forum for peer reviewing of surgical science

Almquist, Martin LU ; Von Allmen, Regula S.; Carradice, Dan; Oosterling, Steven J.; McFarlane, Kirsty and Wijnhoven, Bas (2017) In PLoS ONE 12(6).
Abstract

Background Peer review is important to the scientific process. However, the present system has been criticised and accused of bias, lack of transparency, failure to detect significant breakthrough and error. At the British Journal of Surgery (BJS), after surveying authors' and reviewers' opinions on peer review, we piloted an open online forum with the aim of improving the peer review process. Methods In December 2014, a web-based survey assessing attitudes towards open online review was sent to reviewers with a BJS account in Scholar One. From April to June 2015, authors were invited to allow their manuscripts to undergo online peer review in addition to the standard peer review process. The quality of each review was evaluated by... (More)

Background Peer review is important to the scientific process. However, the present system has been criticised and accused of bias, lack of transparency, failure to detect significant breakthrough and error. At the British Journal of Surgery (BJS), after surveying authors' and reviewers' opinions on peer review, we piloted an open online forum with the aim of improving the peer review process. Methods In December 2014, a web-based survey assessing attitudes towards open online review was sent to reviewers with a BJS account in Scholar One. From April to June 2015, authors were invited to allow their manuscripts to undergo online peer review in addition to the standard peer review process. The quality of each review was evaluated by editors and editorial assistants using a validated instrument based on a Likert scale. Results The survey was sent to 6635 reviewers. In all, 1454 (21.9%) responded. Support for online peer review was strong, with only 10% stating that they would not subject their manuscripts to online peer review. The most prevalent concern was about intellectual property, being highlighted in 118 of 284 comments (41.5%). Out of 265 eligible manuscripts, 110 were included in the online peer review trial. Around 7000 potential reviewers were invited to review each manuscript. In all, 44 of 110 manuscripts (40%) received 100 reviews from 59 reviewers, alongside 115 conventional reviews. The quality of the open forum reviews was lower than for conventional reviews (2.13 (± 0.75) versus 2.84 (± 0.71), P<0.001). Conclusion Open online peer review is feasible in this setting, but it attracts few reviews, of lower quality than conventional peer reviews.

(Less)
Please use this url to cite or link to this publication:
author
organization
publishing date
type
Contribution to journal
publication status
published
subject
in
PLoS ONE
volume
12
issue
6
publisher
Public Library of Science
external identifiers
  • scopus:85021651825
  • wos:000404608300014
ISSN
1932-6203
DOI
10.1371/journal.pone.0179031
language
English
LU publication?
yes
id
c4e2a2c9-7a8b-43f6-bbb0-1b1dce7fc980
date added to LUP
2017-08-17 15:20:06
date last changed
2017-09-18 11:41:54
@article{c4e2a2c9-7a8b-43f6-bbb0-1b1dce7fc980,
  abstract     = {<p>Background Peer review is important to the scientific process. However, the present system has been criticised and accused of bias, lack of transparency, failure to detect significant breakthrough and error. At the British Journal of Surgery (BJS), after surveying authors' and reviewers' opinions on peer review, we piloted an open online forum with the aim of improving the peer review process. Methods In December 2014, a web-based survey assessing attitudes towards open online review was sent to reviewers with a BJS account in Scholar One. From April to June 2015, authors were invited to allow their manuscripts to undergo online peer review in addition to the standard peer review process. The quality of each review was evaluated by editors and editorial assistants using a validated instrument based on a Likert scale. Results The survey was sent to 6635 reviewers. In all, 1454 (21.9%) responded. Support for online peer review was strong, with only 10% stating that they would not subject their manuscripts to online peer review. The most prevalent concern was about intellectual property, being highlighted in 118 of 284 comments (41.5%). Out of 265 eligible manuscripts, 110 were included in the online peer review trial. Around 7000 potential reviewers were invited to review each manuscript. In all, 44 of 110 manuscripts (40%) received 100 reviews from 59 reviewers, alongside 115 conventional reviews. The quality of the open forum reviews was lower than for conventional reviews (2.13 (± 0.75) versus 2.84 (± 0.71), P&lt;0.001). Conclusion Open online peer review is feasible in this setting, but it attracts few reviews, of lower quality than conventional peer reviews.</p>},
  articleno    = {e0179031},
  author       = {Almquist, Martin and Von Allmen, Regula S. and Carradice, Dan and Oosterling, Steven J. and McFarlane, Kirsty and Wijnhoven, Bas},
  issn         = {1932-6203},
  language     = {eng},
  number       = {6},
  publisher    = {Public Library of Science},
  series       = {PLoS ONE},
  title        = {A prospective study on an innovative online forum for peer reviewing of surgical science},
  url          = {http://dx.doi.org/10.1371/journal.pone.0179031},
  volume       = {12},
  year         = {2017},
}