This project, funded under the NCRM Methodological Research Projects funding call, brings together an international collaboration that aims to develop a methodology for rating the certainty in the estimates of effect of complex interventions.
It is now standard practice for policy makers to draw on systematic reviews as the superior source of evidence to inform decision-making regarding effective interventions. Social interventions, commonly applied within the disciplines of international development, psychology, education, social work and welfare, criminology and public health, are frequently conceptualised as complex. This means they might involve a number of interacting components, multiple outcomes, levels of target (such as communities and entire populations) and diverse delivery formats. In addition, they might be more amenable to contextual factors and intervention implementation issues. For the research synthesis endeavours to be effective in guiding policy and practice, they must utilise adequate methodology that reflects the unique features of these interventions.
The most prominent system to guide evidence-informed decision-making has been developed by the Grading of Recommendations Assessment, Development and Evaluation Working Group (GRADE) in clinical medicine.
- The GRADE approach provides a systematic and transparent process of rating the "best-available evidence" to inform recommendations for practice.
- Having been endorsed by more than 80 organisations worldwide, including the Cochrane Collaboration and the World Health Organisation (WHO), the applicability of the GRADE approach outside of clinical practice has been questioned, in part because of differences of the evidence base in biomedical and social practice domains.
-
Many researchers argue that GRADE does not adequately address the range of methods available for assessing the effectiveness of social interventions, such as different quasi-experimental study designs. In many cases this results in downgrading the quality of the “best evidence possible” for these interventions.
This project aims to:
-
Advance and disseminate the GRADE guidance for complex social interventions.
- With the coordination of a Steering Committee of leading experts in the field, the project team will first organise an international online panel involving multidisciplinary expertise to identify aspects that need to be modified in the GRADE approach for complex interventions.
-
Following the online expert panel, a consensus meeting will be hosted with a select group of participants to build consensus for the new GRADE guidance.
-
Throughout all the phases of the project, the project team will closely collaborate with the GRADE Working Group to assure the project output follows the rigorous procedures followed by the group.
