Handbook on Impact Evaluation : Quantitative Methods and Practices

This book reviews quantitative methods and models of impact evaluation. The formal literature on impact evaluation methods and practices is large, with a few useful overviews. Yet there is a need to put the theory into practice in a hands-on fashio...

Full description

Bibliographic Details
Main Authors: Khandker, Shahidur R., Koolwal, Gayatri B., Samad, Hussain A.
Format: Publication
Language:English
Published: World Bank 2012
Subjects:
Online Access:http://www-wds.worldbank.org/external/default/main?menuPK=64187510&pagePK=64193027&piPK=64187937&theSitePK=523679&menuPK=64187510&searchMenuPK=64187283&siteName=WDS&entityID=000333037_20091210014322
http://hdl.handle.net/10986/2693
id okr-10986-2693
recordtype oai_dc
repository_type Digital Repository
institution_category Foreign Institution
institution Digital Repositories
building World Bank Open Knowledge Repository
collection World Bank
language English
topic ACCOUNTABILITY
AUDITS
BENEFICIARIES
CAPACITY BUILDING
CLINICS
COMMUNITY DEVELOPMENT
COMMUNITY PARTICIPATION
COMPARISON GROUPS
CONTROL GROUPS
COUNTERFACTUAL
COUNTERFACTUALS
DATA ANALYSIS
DATA COLLECTION
DECISION MAKING
DEVELOPMENT RESEARCH
ECONOMIC FACTORS
EVALUATION DESIGN
EVALUATION METHODS
EVALUATION STUDIES
EVALUATORS
EX ANTE ANALYSIS
EX POST EVALUATION
EX POST IMPACT EVALUATION
EXERCISES
EXPERIMENTAL DATA
EXPERIMENTAL DESIGN
FAMILIES
FINAL INDICATORS
FINANCIAL SUPPORT
FLEXIBILITY
GENERAL PRACTICE
GROSS DOMESTIC PRODUCT
HOUSEHOLD INCOME
HYGIENE
IMPACT ASSESSMENT
IMPACT EVALUATION
IMPACT EVALUATION TOOLS
IMPACT INDICATORS
INCOME
INEQUALITY
INSTRUMENTAL VARIABLES
INTERMEDIATE INDICATORS
INTERMEDIATE OUTCOMES
INTERVENTION
INTERVIEWS
LABOR MARKETS
LEARNING
M&E SYSTEMS
MATCHING METHODS
METHODOLOGIES
MODELING
MORTALITY
NONEXPERIMENTAL METHODS
NONGOVERNMENTAL ORGANIZATIONS
NONPARTICIPANT GROUPS
NUTRITION
PERFORMANCE INDICATORS
POLICY CHANGES
POLLUTION
POVERTY ALLEVIATION
POVERTY IMPACTS
POVERTY REDUCTION
POVERTY REDUCTION PROGRAMS
PROGRAM BENEFICIARIES
PROGRAM EFFECTIVENESS
PROGRAM EFFECTS
PROGRAM EVALUATION
PROGRAM IMPACTS
PROGRAM IMPLEMENTATION
PROGRAM INTERVENTIONS
PROGRAM OUTCOMES
PROGRAMS
PROJECT MANAGEMENT
PROJECT MONITORING
PROJECT OBJECTIVES
PROPENSITY SCORE MATCHING
QUALITATIVE ANALYSIS
QUALITATIVE DATA
QUALITATIVE METHODS
QUANTITATIVE DATA
QUANTITATIVE EVALUATION
QUANTITATIVE METHODS
QUANTITATIVE RESEARCH
QUESTIONNAIRES
REDUCING POVERTY
REFLEXIVE COMPARISONS
RELIABILITY
RESEARCH PROJECTS
RESEARCHERS
SECONDARY SCHOOLS
SELECTION BIAS
SERVICE DELIVERY
SIMULATION
SIMULATIONS
SOCIAL NETWORKS
SURVEY DATA
SURVEY INSTRUMENTS
TARGETING
TECHNIQUES
TRAINING PROGRAMS
TRANSPARENCY
TREATMENT EFFECTS
WAGES
WELL-BEING
Microdata Set
spellingShingle ACCOUNTABILITY
AUDITS
BENEFICIARIES
CAPACITY BUILDING
CLINICS
COMMUNITY DEVELOPMENT
COMMUNITY PARTICIPATION
COMPARISON GROUPS
CONTROL GROUPS
COUNTERFACTUAL
COUNTERFACTUALS
DATA ANALYSIS
DATA COLLECTION
DECISION MAKING
DEVELOPMENT RESEARCH
ECONOMIC FACTORS
EVALUATION DESIGN
EVALUATION METHODS
EVALUATION STUDIES
EVALUATORS
EX ANTE ANALYSIS
EX POST EVALUATION
EX POST IMPACT EVALUATION
EXERCISES
EXPERIMENTAL DATA
EXPERIMENTAL DESIGN
FAMILIES
FINAL INDICATORS
FINANCIAL SUPPORT
FLEXIBILITY
GENERAL PRACTICE
GROSS DOMESTIC PRODUCT
HOUSEHOLD INCOME
HYGIENE
IMPACT ASSESSMENT
IMPACT EVALUATION
IMPACT EVALUATION TOOLS
IMPACT INDICATORS
INCOME
INEQUALITY
INSTRUMENTAL VARIABLES
INTERMEDIATE INDICATORS
INTERMEDIATE OUTCOMES
INTERVENTION
INTERVIEWS
LABOR MARKETS
LEARNING
M&E SYSTEMS
MATCHING METHODS
METHODOLOGIES
MODELING
MORTALITY
NONEXPERIMENTAL METHODS
NONGOVERNMENTAL ORGANIZATIONS
NONPARTICIPANT GROUPS
NUTRITION
PERFORMANCE INDICATORS
POLICY CHANGES
POLLUTION
POVERTY ALLEVIATION
POVERTY IMPACTS
POVERTY REDUCTION
POVERTY REDUCTION PROGRAMS
PROGRAM BENEFICIARIES
PROGRAM EFFECTIVENESS
PROGRAM EFFECTS
PROGRAM EVALUATION
PROGRAM IMPACTS
PROGRAM IMPLEMENTATION
PROGRAM INTERVENTIONS
PROGRAM OUTCOMES
PROGRAMS
PROJECT MANAGEMENT
PROJECT MONITORING
PROJECT OBJECTIVES
PROPENSITY SCORE MATCHING
QUALITATIVE ANALYSIS
QUALITATIVE DATA
QUALITATIVE METHODS
QUANTITATIVE DATA
QUANTITATIVE EVALUATION
QUANTITATIVE METHODS
QUANTITATIVE RESEARCH
QUESTIONNAIRES
REDUCING POVERTY
REFLEXIVE COMPARISONS
RELIABILITY
RESEARCH PROJECTS
RESEARCHERS
SECONDARY SCHOOLS
SELECTION BIAS
SERVICE DELIVERY
SIMULATION
SIMULATIONS
SOCIAL NETWORKS
SURVEY DATA
SURVEY INSTRUMENTS
TARGETING
TECHNIQUES
TRAINING PROGRAMS
TRANSPARENCY
TREATMENT EFFECTS
WAGES
WELL-BEING
Microdata Set
Khandker, Shahidur R.
Koolwal, Gayatri B.
Samad, Hussain A.
Handbook on Impact Evaluation : Quantitative Methods and Practices
description This book reviews quantitative methods and models of impact evaluation. The formal literature on impact evaluation methods and practices is large, with a few useful overviews. Yet there is a need to put the theory into practice in a hands-on fashion for practitioners. This book also details challenges and goals in other realms of evaluation, including monitoring and evaluation (M&E), operational evaluation, and mixed-methods approaches combining quantitative and qualitative analyses. This book is organized as follows. Chapter two reviews the basic issues pertaining to an evaluation of an intervention to reach certain targets and goals. It distinguishes impact evaluation from related concepts such as M&E, operational evaluation, qualitative versus quantitative evaluation, and ex-ante versus ex post impact evaluation. Chapter three focuses on the experimental design of an impact evaluation, discussing its strengths and shortcomings. Various non-experimental methods exist as well, each of which are discussed in turn through chapters four to seven. Chapter four examines matching methods, including the propensity score matching technique. Chapter five deal with double-difference methods in the context of panel data, which relax some of the assumptions on the potential sources of selection bias. Chapter six reviews the instrumental variable method, which further relaxes assumptions on self-selection. Chapter seven examines regression discontinuity and pipeline methods, which exploit the design of the program itself as potential sources of identification of program impacts. Specifically, chapter eight presents a discussion of how distributional impacts of programs can be measured, including new techniques related to quantile regression. Chapter nine discusses structural approaches to program evaluation, including economic models that can lay the groundwork for estimating direct and indirect effects of a program. Finally, chapter ten discusses the strengths and weaknesses of experimental and non-experimental methods and also highlights the usefulness of impact evaluation tools in policy making.
format Publications & Research :: Publication
author Khandker, Shahidur R.
Koolwal, Gayatri B.
Samad, Hussain A.
author_facet Khandker, Shahidur R.
Koolwal, Gayatri B.
Samad, Hussain A.
author_sort Khandker, Shahidur R.
title Handbook on Impact Evaluation : Quantitative Methods and Practices
title_short Handbook on Impact Evaluation : Quantitative Methods and Practices
title_full Handbook on Impact Evaluation : Quantitative Methods and Practices
title_fullStr Handbook on Impact Evaluation : Quantitative Methods and Practices
title_full_unstemmed Handbook on Impact Evaluation : Quantitative Methods and Practices
title_sort handbook on impact evaluation : quantitative methods and practices
publisher World Bank
publishDate 2012
url http://www-wds.worldbank.org/external/default/main?menuPK=64187510&pagePK=64193027&piPK=64187937&theSitePK=523679&menuPK=64187510&searchMenuPK=64187283&siteName=WDS&entityID=000333037_20091210014322
http://hdl.handle.net/10986/2693
_version_ 1764385828098801664
spelling okr-10986-26932021-04-23T14:02:03Z Handbook on Impact Evaluation : Quantitative Methods and Practices Khandker, Shahidur R. Koolwal, Gayatri B. Samad, Hussain A. ACCOUNTABILITY AUDITS BENEFICIARIES CAPACITY BUILDING CLINICS COMMUNITY DEVELOPMENT COMMUNITY PARTICIPATION COMPARISON GROUPS CONTROL GROUPS COUNTERFACTUAL COUNTERFACTUALS DATA ANALYSIS DATA COLLECTION DECISION MAKING DEVELOPMENT RESEARCH ECONOMIC FACTORS EVALUATION DESIGN EVALUATION METHODS EVALUATION STUDIES EVALUATORS EX ANTE ANALYSIS EX POST EVALUATION EX POST IMPACT EVALUATION EXERCISES EXPERIMENTAL DATA EXPERIMENTAL DESIGN FAMILIES FINAL INDICATORS FINANCIAL SUPPORT FLEXIBILITY GENERAL PRACTICE GROSS DOMESTIC PRODUCT HOUSEHOLD INCOME HYGIENE IMPACT ASSESSMENT IMPACT EVALUATION IMPACT EVALUATION TOOLS IMPACT INDICATORS INCOME INEQUALITY INSTRUMENTAL VARIABLES INTERMEDIATE INDICATORS INTERMEDIATE OUTCOMES INTERVENTION INTERVIEWS LABOR MARKETS LEARNING M&E SYSTEMS MATCHING METHODS METHODOLOGIES MODELING MORTALITY NONEXPERIMENTAL METHODS NONGOVERNMENTAL ORGANIZATIONS NONPARTICIPANT GROUPS NUTRITION PERFORMANCE INDICATORS POLICY CHANGES POLLUTION POVERTY ALLEVIATION POVERTY IMPACTS POVERTY REDUCTION POVERTY REDUCTION PROGRAMS PROGRAM BENEFICIARIES PROGRAM EFFECTIVENESS PROGRAM EFFECTS PROGRAM EVALUATION PROGRAM IMPACTS PROGRAM IMPLEMENTATION PROGRAM INTERVENTIONS PROGRAM OUTCOMES PROGRAMS PROJECT MANAGEMENT PROJECT MONITORING PROJECT OBJECTIVES PROPENSITY SCORE MATCHING QUALITATIVE ANALYSIS QUALITATIVE DATA QUALITATIVE METHODS QUANTITATIVE DATA QUANTITATIVE EVALUATION QUANTITATIVE METHODS QUANTITATIVE RESEARCH QUESTIONNAIRES REDUCING POVERTY REFLEXIVE COMPARISONS RELIABILITY RESEARCH PROJECTS RESEARCHERS SECONDARY SCHOOLS SELECTION BIAS SERVICE DELIVERY SIMULATION SIMULATIONS SOCIAL NETWORKS SURVEY DATA SURVEY INSTRUMENTS TARGETING TECHNIQUES TRAINING PROGRAMS TRANSPARENCY TREATMENT EFFECTS WAGES WELL-BEING Microdata Set This book reviews quantitative methods and models of impact evaluation. The formal literature on impact evaluation methods and practices is large, with a few useful overviews. Yet there is a need to put the theory into practice in a hands-on fashion for practitioners. This book also details challenges and goals in other realms of evaluation, including monitoring and evaluation (M&E), operational evaluation, and mixed-methods approaches combining quantitative and qualitative analyses. This book is organized as follows. Chapter two reviews the basic issues pertaining to an evaluation of an intervention to reach certain targets and goals. It distinguishes impact evaluation from related concepts such as M&E, operational evaluation, qualitative versus quantitative evaluation, and ex-ante versus ex post impact evaluation. Chapter three focuses on the experimental design of an impact evaluation, discussing its strengths and shortcomings. Various non-experimental methods exist as well, each of which are discussed in turn through chapters four to seven. Chapter four examines matching methods, including the propensity score matching technique. Chapter five deal with double-difference methods in the context of panel data, which relax some of the assumptions on the potential sources of selection bias. Chapter six reviews the instrumental variable method, which further relaxes assumptions on self-selection. Chapter seven examines regression discontinuity and pipeline methods, which exploit the design of the program itself as potential sources of identification of program impacts. Specifically, chapter eight presents a discussion of how distributional impacts of programs can be measured, including new techniques related to quantile regression. Chapter nine discusses structural approaches to program evaluation, including economic models that can lay the groundwork for estimating direct and indirect effects of a program. Finally, chapter ten discusses the strengths and weaknesses of experimental and non-experimental methods and also highlights the usefulness of impact evaluation tools in policy making. 2012-03-19T10:04:58Z 2012-03-19T10:04:58Z 2010 http://www-wds.worldbank.org/external/default/main?menuPK=64187510&pagePK=64193027&piPK=64187937&theSitePK=523679&menuPK=64187510&searchMenuPK=64187283&siteName=WDS&entityID=000333037_20091210014322 978-0-8213-8028-4 http://hdl.handle.net/10986/2693 English CC BY 3.0 IGO http://creativecommons.org/licenses/by/3.0/igo World Bank World Bank Publications & Research :: Publication Publications & Research :: Publication