Not all reviews are equal. Some reviews are so good, they help the author(s) to advance their work and the editor to make an informed and timely publishing decision. These kinds of reviews help deliver breakthrough, verified research to the world faster.
There are two ways for a review to be rated "excellent":
- Ratings by Publons editors
- Ratings by journal editors
Excellence ratings by editors
Publons editors may rate a review as "excellent" if they believe it passes a certain threshold of quality.
The reason for these ratings is twofold: to recognise the efforts of a reviewer and to highlight content of a high quality on the Publons platform. Due to this second reason, all Publons-rated excellent reviews are published and a majority are post-publication. Unlike journal editor excellence ratings there is no score associated with Publons-rated excellent reviews.
Excellence ratings by journal editors
Journal editors are able to rate reviews if they are adding a record of the manuscript they handled via the form on Publons. Scores submitted through the peer-review submission systems of integrated journals can also be imported to Publons on an ad-hoc basis. If you would like to bulk import review scoring information to Publons, please get in touch.
The quality of reviews are rated on a four-point scale, across four dimensions, as shown in the form below:
The review assignment was completed within the time limits established by the editor.
The review was easily read and interpreted by the editor and authors.
Comments were constructive, relevant, and realistic.
The review all aspects of the paper including methodology, figures, interpretation and presentation of results, ethics, relevance, etc.
A review is deemed 'Excellent' if it receives a score of 9 or more out of a possible 12.
Poor = 0 point Below Average = 1 points Average = 2 points Exceptional = 3 points
Impact of excellent reviews
Reviewers who have a review rated excellent will have a badge indicating this displayed on their profile. If their excellent review is signed and published that badge will also be displayed in their profile's peer review list, the review's detail page, and alongside the review on the publication detail page.
How to get feedback on my reviews?
You can request an editor to provide you with feedback on the review progress page of the review in question.
Find the review on your Review Records page and then click on your review's 'progress' column to get to the Review Progression Page.
Simply enter your editor's name and email address and then hit 'invite' to send the request for feedback.
Then the editors can rate the quality of your reviews on a four-point scale, across four dimensions.
Excellent reviews receive a gold star on the reviewer's profile and are an indicator of where reviewers have gone above and beyond.
The only information made public is where a review is deemed "Excellent".
NOTE: Scored reviews which do not meet the requirements for excellence will not be indicated on your profile or any other public part of the site.
Exact scores are completely confidential. Written feedback is privileged between the editor and reviewer.