Peer review is the evaluation of work by one or more people of similar competence to the producers of the work. Peer review methods are employed to maintain standards of quality, improve performance, and provide credibility. Peer review can be categorized by the type of activity and by the field or profession in which the activity occurs.
Peer Reviews for Projects:
- Evaluate assumptions
- Review your calculations and Provide alternatives
- Consider your approach and Examine project based on acceptance criteria
- In Peer review other project managers serve as reviewers
- Peer reviews may involve document reviews such as Project Management plan, Risk Register, issue log, … etc.
- Peer reviews may be conducted at the request of the project manager.
- Peer reviews are not only for projects that are in trouble but for all projects.
Preparation
Peer Review Leadership
- » Choose a peer review leader for the project and a review steering committee if more partici-pation andoversight is warranted. (Note: The peer review leader is the person responsible for planning andimplementing the peer review.)
Name of peer review leader: Alternate peer review leader:
- » Plan to establish a role for, and recruit, a review chairperson (Note: The chairperson assists in theselection of members of the review panel, helps define evaluation criteria and questions, and helpsprovide independent oversight of the process.)
Scope, Purpose and Evaluation Criteria
- Identify the purpose of the peer review and the information needed from the review (e.g. what budgetor other decisions will be made based on the outcome of the review).
- Prepare draft evaluation criteria and review questions (criteria and questions to be finalized oncereview chairperson is chosen).
- Define the scope of the peer review, including determination regarding which sub-programs andprojects of the program will be reviewed.Program components to be peer reviewed:
- Establish timeline for review
- Define the data collection and analysis processes
- Identify audience to be present – public vs. closed review
Costs and Preliminary Logistics
- Identify resources available for the peer review
- Determine the review date and work deadlines.
- Develop a detailed budget for the review.
- Draft the agenda for the review considering constraints of potential peer reviewers, logistics, deci-sion and work deadlines.
- Set up a formal peer review record or file. (see Separate Peer Review Record Checklist below)
- Reserve venue and meeting space.
- Have a data collection and analysis plan – a process for collecting information for reviewers and from reviewers.
Pre-Review Activities
- Selection of Reviewers
- Name of Chairperson
- Logistics, Evaluation Tools, Preparation Materials
Conduct of the Review
On-Site Instructions
- Repeat review guidelines to reviewers and answer any questions.
Facilitation of Review
- Discuss with review chairperson the need to monitor interactions among participants to be certain all perspectives are heard, and effectively manage time.
- Have someone facilitate logistics of session(s) so the chairperson can concentrate on the technical aspects of the review.
- Distribute and collect on-site the completed questionnaire for evaluating the peer review process.
Analysis and Summarization of Evaluation Data
- Obtain written comments and/or forms from all peer reviewers before they leave.
- Obtain clarification or additional information from the peer reviewers if necessary.
- Summarize and consolidate reviewer ratings and comments. Develop evaluation guidelines and tools
Post-Review
- Provide draft report to review chairperson and reviewers to check for accuracy and completeness.
- Provide Review Report to program manager for response.
- Consult with appropriate experts/ staff/ managers on the review findings within two weeks of re-ceiving the reviewers’ report to identify program responses and actions where warranted.
- Complete the Program Manager’s response to review findings (or Steering Committee’s response, if applicable) and issue direction to Principal Investigators.
- Add the program response to complete the Final Review Report.
- Distribute the Final Review Report to the program, EERE senior management, and to Principal Inves-tigators.
- Track and document progress and impact of program actions.
- Formally thank reviewers for their efforts.
- Analyze and summarize the completed evaluation questionnaires of the peer review process.
- Complete logistics, such as organizing all documentation of the peer review for the record.
