Using Mixed Methods in Monitoring and Evaluation : Experiences from International Development

This paper provides an overview of the various ways in which mixing qualitative and quantitative methods could add value to monitoring and evaluating development projects. In particular it examines how qualitative methods could address some of the...

Full description

Bibliographic Details
Main Authors: Bamberger, Michael, Rao, Vijayendra, Woolcock, Michael
Format: Policy Research Working Paper
Language:English
Published: 2012
Subjects:
PRA
Online Access:http://www-wds.worldbank.org/external/default/main?menuPK=64187510&pagePK=64193027&piPK=64187937&theSitePK=523679&menuPK=64187510&searchMenuPK=64187283&siteName=WDS&entityID=000158349_20100323100628
http://hdl.handle.net/10986/3732
id okr-10986-3732
recordtype oai_dc
spelling okr-10986-37322021-04-23T14:02:12Z Using Mixed Methods in Monitoring and Evaluation : Experiences from International Development Bamberger, Michael Rao, Vijayendra Woolcock, Michael ACCOUNTABILITY ANTIPOVERTY PROGRAMS BENEFICIARY PARTICIPATION COMPARISON GROUPS CONTROL GROUPS CORRUPTION COUNTERFACTUAL COUNTERFACTUALS CULTURAL FACTORS DATA COLLECTION DATA REQUIREMENTS DEVELOPMENT RESEARCH DUMMY VARIABLES ECONOMETRIC ANALYSIS EVALUATION DESIGN EVALUATION METHODS EVALUATION STRATEGIES EVALUATION TECHNIQUES EVALUATORS EXPERIMENTAL DESIGN EXPERIMENTAL DESIGNS EXTRAPOLATION FIELD WORK FLEXIBILITY GOVERNMENT AGENCIES HOUSEHOLD SURVEYS HYPOTHESES IMPACT ANALYSIS IMPACT ASSESSMENT IMPACT EVALUATION IMPACT EVALUATION DESIGN IMPACT INDICATORS INCOME INCOME DISTRIBUTION INCOME INEQUALITY INSTRUMENTAL VARIABLES INTERNAL MONITORING INTERVENTION KEY INFORMANT INTERVIEWS LABOR MARKETS LEARNING MATCHING METHODS METHODOLOGICAL ISSUES METHODOLOGIES MODELING MONITORING DATA MORTALITY OPINION POLLS OUTCOME INDICATORS PARTICIPATION RATES PARTICIPATORY PROJECTS PRA PROGRAM ASSESSMENTS PROGRAM EVALUATION PROGRAM INTERVENTIONS PROGRAM OUTCOMES PROGRAMS PROJECT BENEFICIARIES PROJECT EVALUATION PROJECT IMPACTS PROJECT MANAGEMENT PROJECT MONITORING PROPENSITY SCORE MATCHING QUALITATIVE DATA QUALITATIVE EVALUATION QUALITATIVE METHODS QUALITATIVE RESEARCH QUALITATIVE TOOLS QUANTITATIVE DATA QUANTITATIVE DATA COLLECTION METHODS QUANTITATIVE EVALUATION QUANTITATIVE METHODS QUANTITATIVE RESEARCH QUANTITATIVE SURVEYS QUESTIONNAIRES RANDOM SAMPLING RANDOMIZATION REGRESSION ANALYSES REGRESSION ANALYSIS RELIABILITY REPRESENTATIVE SAMPLES RESEARCH CENTERS RESEARCH METHODS RESEARCH WORKING PAPERS RESEARCHERS SAMPLE SELECTION SAMPLE SURVEYS SAMPLING FRAMES SAMPLING TECHNIQUES SCENARIO SCENARIOS SELECTION BIAS SERVICE DELIVERY STANDARD ERRORS STATISTICAL ANALYSIS STATISTICAL DATA STATISTICAL INDICATORS STATISTICAL METHODS STATISTICAL SIGNIFICANCE STATISTICAL TECHNIQUES STATISTICIANS STRUCTURAL MODELING SURVEY DATA SURVEY INSTRUMENTS TECHNIQUES TREATMENT EFFECTS VALIDITY This paper provides an overview of the various ways in which mixing qualitative and quantitative methods could add value to monitoring and evaluating development projects. In particular it examines how qualitative methods could address some of the limitations of randomized trials and other quantitative impact evaluation methods; it also explores the importance of examining "process" in addition to "impact", distinguishing design from implementation failures, and the value of mixed methods in the real-time monitoring of projects. It concludes by suggesting topics for future research -- including the use of mixed methods in constructing counterfactuals, and in conducting reasonable evaluations within severe time and budget constraints. 2012-03-19T18:38:49Z 2012-03-19T18:38:49Z 2010-03-01 http://www-wds.worldbank.org/external/default/main?menuPK=64187510&pagePK=64193027&piPK=64187937&theSitePK=523679&menuPK=64187510&searchMenuPK=64187283&siteName=WDS&entityID=000158349_20100323100628 http://hdl.handle.net/10986/3732 English Policy Research working paper ; no. WPS 5245 CC BY 3.0 IGO http://creativecommons.org/licenses/by/3.0/igo/ World Bank Publications & Research :: Policy Research Working Paper The World Region The World Region
repository_type Digital Repository
institution_category Foreign Institution
institution Digital Repositories
building World Bank Open Knowledge Repository
collection World Bank
language English
topic ACCOUNTABILITY
ANTIPOVERTY PROGRAMS
BENEFICIARY PARTICIPATION
COMPARISON GROUPS
CONTROL GROUPS
CORRUPTION
COUNTERFACTUAL
COUNTERFACTUALS
CULTURAL FACTORS
DATA COLLECTION
DATA REQUIREMENTS
DEVELOPMENT RESEARCH
DUMMY VARIABLES
ECONOMETRIC ANALYSIS
EVALUATION DESIGN
EVALUATION METHODS
EVALUATION STRATEGIES
EVALUATION TECHNIQUES
EVALUATORS
EXPERIMENTAL DESIGN
EXPERIMENTAL DESIGNS
EXTRAPOLATION
FIELD WORK
FLEXIBILITY
GOVERNMENT AGENCIES
HOUSEHOLD SURVEYS
HYPOTHESES
IMPACT ANALYSIS
IMPACT ASSESSMENT
IMPACT EVALUATION
IMPACT EVALUATION DESIGN
IMPACT INDICATORS
INCOME
INCOME DISTRIBUTION
INCOME INEQUALITY
INSTRUMENTAL VARIABLES
INTERNAL MONITORING
INTERVENTION
KEY INFORMANT INTERVIEWS
LABOR MARKETS
LEARNING
MATCHING METHODS
METHODOLOGICAL ISSUES
METHODOLOGIES
MODELING
MONITORING DATA
MORTALITY
OPINION POLLS
OUTCOME INDICATORS
PARTICIPATION RATES
PARTICIPATORY PROJECTS
PRA
PROGRAM ASSESSMENTS
PROGRAM EVALUATION
PROGRAM INTERVENTIONS
PROGRAM OUTCOMES
PROGRAMS
PROJECT BENEFICIARIES
PROJECT EVALUATION
PROJECT IMPACTS
PROJECT MANAGEMENT
PROJECT MONITORING
PROPENSITY SCORE MATCHING
QUALITATIVE DATA
QUALITATIVE EVALUATION
QUALITATIVE METHODS
QUALITATIVE RESEARCH
QUALITATIVE TOOLS
QUANTITATIVE DATA
QUANTITATIVE DATA COLLECTION METHODS
QUANTITATIVE EVALUATION
QUANTITATIVE METHODS
QUANTITATIVE RESEARCH
QUANTITATIVE SURVEYS
QUESTIONNAIRES
RANDOM SAMPLING
RANDOMIZATION
REGRESSION ANALYSES
REGRESSION ANALYSIS
RELIABILITY
REPRESENTATIVE SAMPLES
RESEARCH CENTERS
RESEARCH METHODS
RESEARCH WORKING PAPERS
RESEARCHERS
SAMPLE SELECTION
SAMPLE SURVEYS
SAMPLING FRAMES
SAMPLING TECHNIQUES
SCENARIO
SCENARIOS
SELECTION BIAS
SERVICE DELIVERY
STANDARD ERRORS
STATISTICAL ANALYSIS
STATISTICAL DATA
STATISTICAL INDICATORS
STATISTICAL METHODS
STATISTICAL SIGNIFICANCE
STATISTICAL TECHNIQUES
STATISTICIANS
STRUCTURAL MODELING
SURVEY DATA
SURVEY INSTRUMENTS
TECHNIQUES
TREATMENT EFFECTS
VALIDITY
spellingShingle ACCOUNTABILITY
ANTIPOVERTY PROGRAMS
BENEFICIARY PARTICIPATION
COMPARISON GROUPS
CONTROL GROUPS
CORRUPTION
COUNTERFACTUAL
COUNTERFACTUALS
CULTURAL FACTORS
DATA COLLECTION
DATA REQUIREMENTS
DEVELOPMENT RESEARCH
DUMMY VARIABLES
ECONOMETRIC ANALYSIS
EVALUATION DESIGN
EVALUATION METHODS
EVALUATION STRATEGIES
EVALUATION TECHNIQUES
EVALUATORS
EXPERIMENTAL DESIGN
EXPERIMENTAL DESIGNS
EXTRAPOLATION
FIELD WORK
FLEXIBILITY
GOVERNMENT AGENCIES
HOUSEHOLD SURVEYS
HYPOTHESES
IMPACT ANALYSIS
IMPACT ASSESSMENT
IMPACT EVALUATION
IMPACT EVALUATION DESIGN
IMPACT INDICATORS
INCOME
INCOME DISTRIBUTION
INCOME INEQUALITY
INSTRUMENTAL VARIABLES
INTERNAL MONITORING
INTERVENTION
KEY INFORMANT INTERVIEWS
LABOR MARKETS
LEARNING
MATCHING METHODS
METHODOLOGICAL ISSUES
METHODOLOGIES
MODELING
MONITORING DATA
MORTALITY
OPINION POLLS
OUTCOME INDICATORS
PARTICIPATION RATES
PARTICIPATORY PROJECTS
PRA
PROGRAM ASSESSMENTS
PROGRAM EVALUATION
PROGRAM INTERVENTIONS
PROGRAM OUTCOMES
PROGRAMS
PROJECT BENEFICIARIES
PROJECT EVALUATION
PROJECT IMPACTS
PROJECT MANAGEMENT
PROJECT MONITORING
PROPENSITY SCORE MATCHING
QUALITATIVE DATA
QUALITATIVE EVALUATION
QUALITATIVE METHODS
QUALITATIVE RESEARCH
QUALITATIVE TOOLS
QUANTITATIVE DATA
QUANTITATIVE DATA COLLECTION METHODS
QUANTITATIVE EVALUATION
QUANTITATIVE METHODS
QUANTITATIVE RESEARCH
QUANTITATIVE SURVEYS
QUESTIONNAIRES
RANDOM SAMPLING
RANDOMIZATION
REGRESSION ANALYSES
REGRESSION ANALYSIS
RELIABILITY
REPRESENTATIVE SAMPLES
RESEARCH CENTERS
RESEARCH METHODS
RESEARCH WORKING PAPERS
RESEARCHERS
SAMPLE SELECTION
SAMPLE SURVEYS
SAMPLING FRAMES
SAMPLING TECHNIQUES
SCENARIO
SCENARIOS
SELECTION BIAS
SERVICE DELIVERY
STANDARD ERRORS
STATISTICAL ANALYSIS
STATISTICAL DATA
STATISTICAL INDICATORS
STATISTICAL METHODS
STATISTICAL SIGNIFICANCE
STATISTICAL TECHNIQUES
STATISTICIANS
STRUCTURAL MODELING
SURVEY DATA
SURVEY INSTRUMENTS
TECHNIQUES
TREATMENT EFFECTS
VALIDITY
Bamberger, Michael
Rao, Vijayendra
Woolcock, Michael
Using Mixed Methods in Monitoring and Evaluation : Experiences from International Development
geographic_facet The World Region
The World Region
relation Policy Research working paper ; no. WPS 5245
description This paper provides an overview of the various ways in which mixing qualitative and quantitative methods could add value to monitoring and evaluating development projects. In particular it examines how qualitative methods could address some of the limitations of randomized trials and other quantitative impact evaluation methods; it also explores the importance of examining "process" in addition to "impact", distinguishing design from implementation failures, and the value of mixed methods in the real-time monitoring of projects. It concludes by suggesting topics for future research -- including the use of mixed methods in constructing counterfactuals, and in conducting reasonable evaluations within severe time and budget constraints.
format Publications & Research :: Policy Research Working Paper
author Bamberger, Michael
Rao, Vijayendra
Woolcock, Michael
author_facet Bamberger, Michael
Rao, Vijayendra
Woolcock, Michael
author_sort Bamberger, Michael
title Using Mixed Methods in Monitoring and Evaluation : Experiences from International Development
title_short Using Mixed Methods in Monitoring and Evaluation : Experiences from International Development
title_full Using Mixed Methods in Monitoring and Evaluation : Experiences from International Development
title_fullStr Using Mixed Methods in Monitoring and Evaluation : Experiences from International Development
title_full_unstemmed Using Mixed Methods in Monitoring and Evaluation : Experiences from International Development
title_sort using mixed methods in monitoring and evaluation : experiences from international development
publishDate 2012
url http://www-wds.worldbank.org/external/default/main?menuPK=64187510&pagePK=64193027&piPK=64187937&theSitePK=523679&menuPK=64187510&searchMenuPK=64187283&siteName=WDS&entityID=000158349_20100323100628
http://hdl.handle.net/10986/3732
_version_ 1764388048831774720