From Nature news.
Calcagno, in contrast, found that 3–6 years after publication, papers published on their second try are more highly cited on average than first-time papers in the same journal — regardless of whether the resubmissions moved to journals with higher or lower impact.
Calcagno and colleagues think that this reflects the influence of peer review: the input from referees and editors makes papers better, even if they get rejected at first.
Based on my experience with economics journals as an editor and author I highly doubt that. Authors pay very close attention to referees’ demands when they are asked to resubmit to the same journal because of course those same referees are going to decide on the next round. On the other hand authors pretty much ignore the advice of referees who have proven their incompetence by rejecting their paper.
Instead my hypothesis is that authors with good papers start at the top journals and expect a rejection or two (on average) before the paper finally lands somewhere reasonably good. Authors of bad papers submit them to bad journals and have them accepted right away. Drew Fudenberg suggested something similar.
9 comments
Comments feed for this article
October 23, 2012 at 7:35 pm
Tony
Interesting hypothesis.
Related, but much too idiosyncratic to be driving the result, I came across this research incentive program while browsing the JOE ads (http://www.weber.edu/WSUImages/SBE/GSBE%20Research%20Incentive%20Program%207-1-09.pdf).
By my understanding of the research incentive policy, the research-incentive-pay maximizing economist will submit a really low quality paper (maybe early on in the development of the paper) with the hope that it would be rejected (because he can collect the submission bounty of $2000 up to two times for each paper). On the second try, it would be optimal to improve it to get it into a journal, perhaps generating more citations. If the journal/author messes up and the paper is accepted on the first try, it is just a bad paper that shouldn’t be cited –> hence, generating the pattern of purported improvement.
As I said, this policy is probably too idiosyncratic to drive the general finding, but it is still interesting.
October 24, 2012 at 2:28 am
Links for 10-24-2012 | The Penn Ave Post
[…] at 3:45 on October 24, 2012 by Mark Thoma The Myth of the Exploding Safety Net – CBPP Rejection Improves Your Papers? – Cheap Talk Governments Aren’t Like Businesses – Jodi Beggs […]
October 24, 2012 at 7:00 pm
brian
Or another channel: with roughly twice as many total referees for the once-rejected papers, there are more people in your field who know your paper very well, and hence are more likely to cite it.
October 25, 2012 at 6:31 am
Quelques liens | Rationalité Limitée
[…] 5) L’un de vos papiers vient d’être rejeté ? C’est plutôt bon signe ! (pas si sûr en fait) […]
October 26, 2012 at 9:09 am
Friday links: is it better for your paper to get rejected before being published, and more | Dynamic Ecology
[…] revision leads to better, and thus more highly cited, papers, maybe–but Cheap Talk argues maybe not. No word on whether rejected, resubmitted papers also are more likely to win the Mercer Award. (HT […]
October 26, 2012 at 9:20 am
Why You Should Reject the “Rejection Improves Impact” Meme « I wish you'd made me angry earlier
[…] Cheap Talk – Rejection Improves Your Papers? […]
October 26, 2012 at 9:23 am
caseybergman
Before speculating over the potential causes for this effect, I would encourage readers to evaluate the magnitude of the effect in question. My analysis of the motivation behind the propogation of this meme can be found here: http://caseybergman.wordpress.com/2012/10/25/why-you-should-reject-the-rejection-improves-impact-meme/
October 27, 2012 at 3:28 am
Links for 10-24-2012 | FavStocks
[…] Rejection Improves Your Papers? – Cheap Talk […]
October 29, 2012 at 3:45 pm
Links 10/29/12 | Mike the Mad Biologist
[…] much can you really trust splashy study findings? Rejection Improves Your Papers? Top 5 scariest species…from, er, DNA? We regret to inform you that your paper has not been […]