REA Toolkit
How to do an REA
Writing a protocol
There are two broad approaches to doing reviews, those that clearly set out how they will be conducted from the beginning and follow this in a linear fashion to the end of the project (a priori), or those that develop in an iterative way during the course of the review. Both approaches can be applied to REAs.
A priori reviews
A priori reviews use a protocol at the beginning of the project to set out how each stage of the project will be addressed. These stages are set out in the protocol and then followed in a logical sequence.
Key features of a priori reviews
- Tend to be quicker than iterative reviews because they do not involve making changes to and/or redoing certain stages of the review.
- The process for answering the review question is clearly stated and allows other researchers and research users to suggest improvements to the methods at the beginning of the project.
- Reviewers are less likely to be influenced by, for example, their knowledge of study authors or by study findings if the review's methods are defined explicitly at the start of the review.
- A priori reviews are less suited to broad questions or unclear conceptual framework because there is less scope for revisiting the questions and its assumptions once the review is underway.
The fact that a priori reviews tend to be faster than iterative reviews makes them attractive for use in REAs. However, REAs may need to make adjustments and refinements at different stages of the project in order to ensure they are still meeting users needs. Regular communication between all those involved is, therefore, vital to ensure the original approach is still valid.
Iterative reviews
An iterative review may have a general plan for how it will be carried out, but the detail is only worked out as the REA is being done. Particular stages may be repeated and developed as the review proceeds.
Key features of iterative reviews
- Able to repeat some stages of review (e.g. synthesis of findings) to explore different approaches to the evidence.
- Better at dealing with broad questions or reviews where the conceptual framework is unclear than a priori reviews because the questions and its assumptions can be revisited once the review is underway.
- Stages are less well defined and therefore may need to be repeated or developed. It is inadvisable in an REA to allow the process to be too iterative because this will limit the control that you have over how long it will take. On the other hand, users (e.g. policy officials) are given more of chance to ensure that each stage is still meeting their needs as the REA progresses.
- A protocol is still important but this will be adapted as the review progresses.
Therefore, iterative reviews are particularly useful in checking and refining the different stages of an REA to ensure it is delivering what is wanted. However, as they tend to be slower than a priori reviews, they so should be carried out by an experienced team who can balance the need to repeat or develop stages against the need to ensure the REA is delivered on time.
How to do an REA index