Peer-review can be an incredibly frustrating process. A big part of the frustration comes from the generally low quality of reviews often gets. By ‘low quality’ I dot mean ‘negative,’ but rather unsubstantial and not useful. With that in mind I offer the three types of peer reviews you should dread getting and desperately try to avoid giving:
1. The Out-of-Hand Review
Here the reviewer simply rejects your submission in its entirety but offers no argument or evidence for why he or she has done so beyond a barely more polite version of “This sucks.” The problem here is not that the reviewer thinks the manuscript sucks, many of them do. The problem is that simply saying “this sucks,” without any further explanation does not help the writer get any better or understand the weaknesses of their research. Nor does it give the writer any specific points to counter-argue which is hugely problematic because peer review is, after all, a negotiation.
Reviewers who think a manuscript is beyond-the-pale in its low quality are still obligated, perhaps more than those who just give negative reviews, to justify their views; and if they’re not going to do so, then they should simply not do the review. The exception to this rule is if the manuscript is so replete with spelling, grammatical, and formatting errors that it is unreadable. In that case, it’s perfectly legitimate to reject out-of-hand for its unreadable state.
2. The “I don’t know this area but will pretend I do anyway” review
Nobody can know all the research literature, be expert in every field, etc. Yet it seems that in every manuscript I’ve ever submitted I’ve had at least one reviewer who did not know the research area in the manuscript but charged right ahead and pretended like he did anyway. The ‘I don’t know’ review is a huge drag for the author because it requires authors to spend significant time refuting criticism that are invalid or inapplicable.
It’s perfectly reasonable to admit, as a reviewer, that you do not have expertise in a particular area and so will defer comment to the other reviewers. Better yet, rather than simply defer, go do a brief survey of the literature and familiarize yourself with the material. And if that’s not an option, simply qualifying your criticisms with “This area is not my area of expertise but…” It will go a long way towards helping the author and keeping the dialogue collegial.
3. The Bobby McFerrin
Bobby McFerrin had a huge hit in the 1980′s called Don’t Worry, Be Happy. The song was awful, the video was worse, and getting a Bobby McFerrin (BM) review is only slightly better than getting an ‘out-of-hand’ in that at least it’s positive. Reviewers who give a BM review are completely uncritical. Everything is great! This is revolutionary work! Give the author the Nobel already! Just as negative reviews with no substance are not useful to authors, neither are positive reviews with no substance. No paper is perfect and even the best can always be improved.
4. The Fashion Police
No, I’m not talking about Joan Rivers and crew calling some starlet a ‘fashole’ for wearing last year’s outfit. The fashion police reviewers rarely critique the substance of a manuscript intead choosing to spend their time obsessing about minutiae like word choice, document structure, and other copy-editing concerns. It doesn’t help, particularly when there are more substantial concerns to be addressed.