February 22, 2012

Writing a referee report

As an edi­tor, I like to see ref­eree reports com­pris­ing three sections:

A gen­eral sum­mary of the paper and the con­tri­bu­tion it makes. You need to high­light here what is new and inter­est­ing about the paper, as well as give a sum­mary in a few sentences.
The major prob­lems that need address­ing. This is prob­a­bly the most impor­tant sec­tion of your report where you explain the main prob­lems. The edi­tor will read this very care­fully when decid­ing whether to accept, reject or invite a revi­sion, so you need to make sure that any prob­lems are clearly explained here. If you think the paper should be rejected, then you have to make a good case in this sec­ond sec­tion. On the other hand, if you think it is a great paper that deserves pub­li­ca­tion, please explain what is so good about it.
Minor things such as typos or points of clar­i­fi­ca­tion. These are often less impor­tant issues, but need cor­rect­ing before publication.

Some ref­eree reports com­bine sec­tions 2 and 3 and that makes it much harder to fig­ure out what is impor­tant and what are minor com­ments. If the paper is def­i­nitely not worth pub­lish­ing, and you have explained some very seri­ous flaws in sec­tion 2, then it is accept­able not to doc­u­ment the more minor issues. In this case, you should explain to the edi­tor that you have cho­sen not to com­ment on more minor issues as you didn’t think it worthwhile.

Don’t include a rec­om­men­da­tion about whether to pub­lish or not in the report, but add it in your cov­er­ing note to the edi­tor. This is best as the edi­tor will make a deci­sion based on the com­ments from all the ref­er­ees and they may pro­vide con­flict­ing rec­om­men­da­tions. Also, it is awk­ward if all the ref­er­ees rec­om­mend one thing and the edi­tor decides dif­fer­ently. This doesn’t hap­pen very often, but I have some­times made a deci­sion that is con­trary to the advice of all ref­er­ees.
©