Broadening the Range of Designs and Methods for Impact Evaluations

This report brings together the findings and conclusions of a study on Impact Evaluation (IE) commissioned by Department for International Development (DFID). It comprises an executive summary and 7 chapters:

  • Introducing the study
  • Defining impact evaluation
  • Choosing designs and methods
  • Evaluation questions and evaluation designs
  • Programme attributes and designs
  • Quality assurance
  • Conclusions and next steps

Each of the main chapters has a main message box at the beginning that highlights the key points in that chapter. The final chapter draws together 10 study conclusions and briefly outlines some proposed follow ups to the study.

Investment in Impact Evaluation (IE) has focused on a narrow range of mainly experimental and statistical methods and designs. DFID has found, however, that these are only applicable to a small proportion of its programmes. This report presents the findings of a study that considered existing IE practice, reviewed methodological literatures and assessed how state-of-the art evaluation designs and methods might be applied to contemporary development programmes.

The report notes that most development interventions 'work' as part of a causal package in combination with other factors. It finds that some of the most potentially useful approaches to causal inference are not generally known or applied in the evaluation of international development and aid. A broader range of IE designs and methods – including theory based, case-based and participatory approaches – could, if suitably developed and applied, extend IE to programmes and contexts where it is currently difficult.

Source: GSDRC

Document type
  • Report
Language

English

Publication Year

2012

Author(s)/Editor(s)
Elliot Stern (Team Leader), Nicoletta Stame, John Mayne, Kim Forss, Rick Davies, Barbara Befani
Geographical focus
  • International; Other
Scientifc field / Thematic focus
  • Cross-thematic/Interdisciplinary

Entry created by Danaja Lorencic on November 5, 2012
Modified on November 5, 2012