Equity-focused evaluations

This website is a resource center for evaluators to access selected material on how to design and manage Equity-focused evaluations. In each section you will find a text presenting and explaining the content, and additional technical resources for in-depth consultation.

 

In addition, a series of webinars on equity-focused evaluations give you the opportunity to interact live with world-level evaluators. You can also download, free of charge, the book “How to design and manage Equity-focused evaluations”.

 

This website is a dynamic one. Your comments on how to improve it are welcome. Please direct them to Marco Segone, UNICEF Evaluation Office, at Contact Us.

 

PART I   EQUITY AND EQUITY-FOCUSED EVALUATION

Section 1.  What is equity and why does it matter?
  • 1.1 The challenge of achieving equitable development results for children
  • 1.2 What is equity?
  • 1.3 Why does equity matter?
  • 1.4 Why equity is so urgent now?
  • 1.5 A typology of vulnerability

Section 2. Defining Equity-focused evaluations
  • 2.1 What is an Equity-focused evaluation?
  • 2.2 Why are Equity-focused evaluations needed?
  • 2.3 Purposes of Equity-focused evaluations
  • 2.4 Empowering worst-off groups, including children, through Equity-focused evaluation processes
PART II  MANAGING EQUITY-FOCUSED EVALUATIONS

Section 3.  Preparing for the evaluations
  • 3.1 Determining the evaluability of equity dimension of the intervention
  • 3.2 Identifying key evaluation stakeholders, including worst-off groups
  • 3.3 Identifying intended use by intended users
  • 3.4 Identifying potential challenges in promoting and implementing Equity-focused evaluations  
Section 4.  Preparing the evaluation Terms of Reference
  • 4.1 Defining the scope and purpose of the evaluation
  • 4.2 Framing the evaluation questions
  • 4.3 Selecting the evaluation team
  • 4.4 Key questions that policy and project level equity-focused evaluation must address
  • 4.5 OECD-DAC evaluation criteria
  • 4.6 Understanding the evaluation purpose and context
Section 5. Designing the evaluation
  • 5.1  Selecting the appropriate evaluation framework
  A. Theory-based Equity-focused evaluation
 
  • Theories of change and theories of action
  • Basic components of a program theory model
  • Refinements to the basic logic model
  B. The bottleneck analysis framework
 
  • Use of services by worst-off groups
  • Supply side factors
  • Demand side factors
  • Contextual factors
  • 5.2  Selecting the appropriate evaluation design
  A. Mixed methods designs
 
  • Types of mixed method designs
  • Triangulation: a powerful tool for assessing validity and for deepening understanding
  B. Attribution, contribution and the importance of the counterfactual
  C. Equity-focused evaluation at the policy level
 
  • Systems approach to evaluation
  • Unpacking complex policies
  • Pipeline designs
  • Policy gap analysis
  • Using other countries or sectors as the comparison group
  • Concept mapping
  • Portfolio analysis
  D. Equity-focused evaluations at the project and program levels
 
  • Conventional quantitative impact evaluation designs
  • Estimating project impacts using non-experimental designs (NEDs)
  • Potentially strong non-experimental designs
  E. Feasibility analysis
  • 5.3 Collecting and analyzing data
 
  • Collecting data and analyzing contextual factors
  • Collecting and analyzing qualitative information to understand Knowledge, Attitude and Practices
  • Collecting and analyzing information on the quality of services delivered and satisfaction of citizens
  Citizen report cards
  Carrying out cost-effectiveness studies to compare costs and results of alternative intervention
 
  • Cost-effectiveness analysis
  • Public expenditure tracking (PETS) studies
  • Public expenditure Benefit Incidence Analysis (BIA)

Section 6.  Utilizing the evaluation
  • 6.1 Preparing the evaluation report and alternative forms of reporting
  • 6.2 Disseminating the evaluation and preparing a Management Response

Section 7.  Conducting Equity-focused evaluations under real-world constraints
  • 7.1  Understanding the evaluation scenario
  • 7.2  Reconstructing the programme theory when it’s not existing or very weak
  • 7.3  Conducting credible Equity-focused evaluation when working under budget and time constraints
  • 7.4  Reconstructing baseline data when the evaluation is not commissioned until late in the implementation cycle
  • 7.5 Conducting Equity-focused evaluation in countries where government is not supportive of an equity focus

Section 8. Case study illustrating the evaluation of a complex program: Evaluation of World Bank support for gender and development 2002-08