randomize order of evaluations for reviewers
Some of our reviewers have said that they evaluate differently at the beginning of their review process than the end of the review process, despite every effort to be consistent. One of them suggested that a way to mitigate reviewer "fatigue" or "learned bias" could be to randomize the order in which applications are listed in the dashboard of each reviewer on a grant review committee. What one person reviews first might be the next reviewer's 10th or 50th application to review in that process.
3
votes
Tanya Andreasen
shared this idea
