[JoPP-Public] Improving peer review for JoPP

[Mathieu ONeil]

Hi all

Openness undoubtedly has great virtues, but in the case of academic publishing it can also generate some bad side-effects.

For this issue of JoPP five papers were sent out for review. Three of the papers will be published with reviews and signals. Two other papers were not great. Reviewers worked long and hard to address shortcomings and make suggestions. 

One author decided that it would not be possible to make these adjustments though much time kept being added. 

The other agreed to make changes but then used the time excuse as well as sickness. 

There is nothing preventing either author from now submitting their much-improved papers to another journal...

In my view, we should try to address this obvious waste of reviewer (and editorial) work/energy. 


One way of addressing this would be to say something like: 

-the critical reviews (which would have been published alongside the articles) might explain why they did not want to be published by us; 

-in order to prevent people from pulling out after they have been reviewed we need to improve the quality of their reviews;

-this means we need to send out better papers for review;

-in turn this means we need to weed out less-than-great papers before they are sent out for review.

Since we now have an editorial team of six people the danger of one editor arbitrarily and unfairly deciding that articles are not ready to be sent out for review is lessened. But at the same time this is moving away from the initial spirit of the project (publish everything with signals).


(This reminds me that Nate suggested to me a while back that a summary of signals need to feature much more prominently alongside research papers to make sure readers realise what we think about the quality of published papers...)


So it seems clear that something needs to be done (I have already removed the reference to "list / community" feedback on the peer review section of the site as that never happened). The question is to what extent this is formalised...?

cheers

Mathieu





--
**
-------------- next part --------------
An HTML attachment was scrubbed...
URL: https://lists.ourproject.org/pipermail/jopp-public/attachments/20120326/1e17e59f/attachment.htm