Using Mixed Methods in Monitoring and Evaluation : Experiences from International Development

This paper provides an overview of the various ways in which mixing qualitative and quantitative methods could add value to monitoring and evaluating development projects. In particular it examines how qualitative methods could address some of the...

Full description

Bibliographic Details
Main Authors:	Bamberger, Michael, Rao, Vijayendra, Woolcock, Michael
Format:	Policy Research Working Paper
Language:	English
Published:	2012
Subjects:	ACCOUNTABILITY ANTIPOVERTY PROGRAMS BENEFICIARY PARTICIPATION COMPARISON GROUPS CONTROL GROUPS CORRUPTION COUNTERFACTUAL COUNTERFACTUALS CULTURAL FACTORS DATA COLLECTION DATA REQUIREMENTS DEVELOPMENT RESEARCH DUMMY VARIABLES ECONOMETRIC ANALYSIS EVALUATION DESIGN EVALUATION METHODS EVALUATION STRATEGIES EVALUATION TECHNIQUES EVALUATORS EXPERIMENTAL DESIGN EXPERIMENTAL DESIGNS EXTRAPOLATION FIELD WORK FLEXIBILITY GOVERNMENT AGENCIES HOUSEHOLD SURVEYS HYPOTHESES IMPACT ANALYSIS IMPACT ASSESSMENT IMPACT EVALUATION IMPACT EVALUATION DESIGN IMPACT INDICATORS INCOME INCOME DISTRIBUTION INCOME INEQUALITY INSTRUMENTAL VARIABLES INTERNAL MONITORING INTERVENTION KEY INFORMANT INTERVIEWS LABOR MARKETS LEARNING MATCHING METHODS METHODOLOGICAL ISSUES METHODOLOGIES MODELING MONITORING DATA MORTALITY OPINION POLLS OUTCOME INDICATORS PARTICIPATION RATES PARTICIPATORY PROJECTS PRA PROGRAM ASSESSMENTS PROGRAM EVALUATION PROGRAM INTERVENTIONS PROGRAM OUTCOMES PROGRAMS PROJECT BENEFICIARIES PROJECT EVALUATION PROJECT IMPACTS PROJECT MANAGEMENT PROJECT MONITORING PROPENSITY SCORE MATCHING QUALITATIVE DATA QUALITATIVE EVALUATION QUALITATIVE METHODS QUALITATIVE RESEARCH QUALITATIVE TOOLS QUANTITATIVE DATA QUANTITATIVE DATA COLLECTION METHODS QUANTITATIVE EVALUATION QUANTITATIVE METHODS QUANTITATIVE RESEARCH QUANTITATIVE SURVEYS QUESTIONNAIRES RANDOM SAMPLING RANDOMIZATION REGRESSION ANALYSES REGRESSION ANALYSIS RELIABILITY REPRESENTATIVE SAMPLES RESEARCH CENTERS RESEARCH METHODS RESEARCH WORKING PAPERS RESEARCHERS SAMPLE SELECTION SAMPLE SURVEYS SAMPLING FRAMES SAMPLING TECHNIQUES SCENARIO SCENARIOS SELECTION BIAS SERVICE DELIVERY STANDARD ERRORS STATISTICAL ANALYSIS STATISTICAL DATA STATISTICAL INDICATORS STATISTICAL METHODS STATISTICAL SIGNIFICANCE STATISTICAL TECHNIQUES STATISTICIANS STRUCTURAL MODELING SURVEY DATA SURVEY INSTRUMENTS TECHNIQUES TREATMENT EFFECTS VALIDITY
Online Access:	http://www-wds.worldbank.org/external/default/main?menuPK=64187510&pagePK=64193027&piPK=64187937&theSitePK=523679&menuPK=64187510&searchMenuPK=64187283&siteName=WDS&entityID=000158349_20100323100628 http://hdl.handle.net/10986/3732

id	okr-10986-3732
recordtype	oai_dc
spelling	okr-10986-37322021-04-23T14:02:12Z Using Mixed Methods in Monitoring and Evaluation : Experiences from International Development Bamberger, Michael Rao, Vijayendra Woolcock, Michael ACCOUNTABILITY ANTIPOVERTY PROGRAMS BENEFICIARY PARTICIPATION COMPARISON GROUPS CONTROL GROUPS CORRUPTION COUNTERFACTUAL COUNTERFACTUALS CULTURAL FACTORS DATA COLLECTION DATA REQUIREMENTS DEVELOPMENT RESEARCH DUMMY VARIABLES ECONOMETRIC ANALYSIS EVALUATION DESIGN EVALUATION METHODS EVALUATION STRATEGIES EVALUATION TECHNIQUES EVALUATORS EXPERIMENTAL DESIGN EXPERIMENTAL DESIGNS EXTRAPOLATION FIELD WORK FLEXIBILITY GOVERNMENT AGENCIES HOUSEHOLD SURVEYS HYPOTHESES IMPACT ANALYSIS IMPACT ASSESSMENT IMPACT EVALUATION IMPACT EVALUATION DESIGN IMPACT INDICATORS INCOME INCOME DISTRIBUTION INCOME INEQUALITY INSTRUMENTAL VARIABLES INTERNAL MONITORING INTERVENTION KEY INFORMANT INTERVIEWS LABOR MARKETS LEARNING MATCHING METHODS METHODOLOGICAL ISSUES METHODOLOGIES MODELING MONITORING DATA MORTALITY OPINION POLLS OUTCOME INDICATORS PARTICIPATION RATES PARTICIPATORY PROJECTS PRA PROGRAM ASSESSMENTS PROGRAM EVALUATION PROGRAM INTERVENTIONS PROGRAM OUTCOMES PROGRAMS PROJECT BENEFICIARIES PROJECT EVALUATION PROJECT IMPACTS PROJECT MANAGEMENT PROJECT MONITORING PROPENSITY SCORE MATCHING QUALITATIVE DATA QUALITATIVE EVALUATION QUALITATIVE METHODS QUALITATIVE RESEARCH QUALITATIVE TOOLS QUANTITATIVE DATA QUANTITATIVE DATA COLLECTION METHODS QUANTITATIVE EVALUATION QUANTITATIVE METHODS QUANTITATIVE RESEARCH QUANTITATIVE SURVEYS QUESTIONNAIRES RANDOM SAMPLING RANDOMIZATION REGRESSION ANALYSES REGRESSION ANALYSIS RELIABILITY REPRESENTATIVE SAMPLES RESEARCH CENTERS RESEARCH METHODS RESEARCH WORKING PAPERS RESEARCHERS SAMPLE SELECTION SAMPLE SURVEYS SAMPLING FRAMES SAMPLING TECHNIQUES SCENARIO SCENARIOS SELECTION BIAS SERVICE DELIVERY STANDARD ERRORS STATISTICAL ANALYSIS STATISTICAL DATA STATISTICAL INDICATORS STATISTICAL METHODS STATISTICAL SIGNIFICANCE STATISTICAL TECHNIQUES STATISTICIANS STRUCTURAL MODELING SURVEY DATA SURVEY INSTRUMENTS TECHNIQUES TREATMENT EFFECTS VALIDITY This paper provides an overview of the various ways in which mixing qualitative and quantitative methods could add value to monitoring and evaluating development projects. In particular it examines how qualitative methods could address some of the limitations of randomized trials and other quantitative impact evaluation methods; it also explores the importance of examining "process" in addition to "impact", distinguishing design from implementation failures, and the value of mixed methods in the real-time monitoring of projects. It concludes by suggesting topics for future research -- including the use of mixed methods in constructing counterfactuals, and in conducting reasonable evaluations within severe time and budget constraints. 2012-03-19T18:38:49Z 2012-03-19T18:38:49Z 2010-03-01 http://www-wds.worldbank.org/external/default/main?menuPK=64187510&pagePK=64193027&piPK=64187937&theSitePK=523679&menuPK=64187510&searchMenuPK=64187283&siteName=WDS&entityID=000158349_20100323100628 http://hdl.handle.net/10986/3732 English Policy Research working paper ; no. WPS 5245 CC BY 3.0 IGO http://creativecommons.org/licenses/by/3.0/igo/ World Bank Publications & Research :: Policy Research Working Paper The World Region The World Region
repository_type	Digital Repository
institution_category	Foreign Institution
institution	Digital Repositories
building	World Bank Open Knowledge Repository
collection	World Bank
language	English
topic	ACCOUNTABILITY ANTIPOVERTY PROGRAMS BENEFICIARY PARTICIPATION COMPARISON GROUPS CONTROL GROUPS CORRUPTION COUNTERFACTUAL COUNTERFACTUALS CULTURAL FACTORS DATA COLLECTION DATA REQUIREMENTS DEVELOPMENT RESEARCH DUMMY VARIABLES ECONOMETRIC ANALYSIS EVALUATION DESIGN EVALUATION METHODS EVALUATION STRATEGIES EVALUATION TECHNIQUES EVALUATORS EXPERIMENTAL DESIGN EXPERIMENTAL DESIGNS EXTRAPOLATION FIELD WORK FLEXIBILITY GOVERNMENT AGENCIES HOUSEHOLD SURVEYS HYPOTHESES IMPACT ANALYSIS IMPACT ASSESSMENT IMPACT EVALUATION IMPACT EVALUATION DESIGN IMPACT INDICATORS INCOME INCOME DISTRIBUTION INCOME INEQUALITY INSTRUMENTAL VARIABLES INTERNAL MONITORING INTERVENTION KEY INFORMANT INTERVIEWS LABOR MARKETS LEARNING MATCHING METHODS METHODOLOGICAL ISSUES METHODOLOGIES MODELING MONITORING DATA MORTALITY OPINION POLLS OUTCOME INDICATORS PARTICIPATION RATES PARTICIPATORY PROJECTS PRA PROGRAM ASSESSMENTS PROGRAM EVALUATION PROGRAM INTERVENTIONS PROGRAM OUTCOMES PROGRAMS PROJECT BENEFICIARIES PROJECT EVALUATION PROJECT IMPACTS PROJECT MANAGEMENT PROJECT MONITORING PROPENSITY SCORE MATCHING QUALITATIVE DATA QUALITATIVE EVALUATION QUALITATIVE METHODS QUALITATIVE RESEARCH QUALITATIVE TOOLS QUANTITATIVE DATA QUANTITATIVE DATA COLLECTION METHODS QUANTITATIVE EVALUATION QUANTITATIVE METHODS QUANTITATIVE RESEARCH QUANTITATIVE SURVEYS QUESTIONNAIRES RANDOM SAMPLING RANDOMIZATION REGRESSION ANALYSES REGRESSION ANALYSIS RELIABILITY REPRESENTATIVE SAMPLES RESEARCH CENTERS RESEARCH METHODS RESEARCH WORKING PAPERS RESEARCHERS SAMPLE SELECTION SAMPLE SURVEYS SAMPLING FRAMES SAMPLING TECHNIQUES SCENARIO SCENARIOS SELECTION BIAS SERVICE DELIVERY STANDARD ERRORS STATISTICAL ANALYSIS STATISTICAL DATA STATISTICAL INDICATORS STATISTICAL METHODS STATISTICAL SIGNIFICANCE STATISTICAL TECHNIQUES STATISTICIANS STRUCTURAL MODELING SURVEY DATA SURVEY INSTRUMENTS TECHNIQUES TREATMENT EFFECTS VALIDITY
spellingShingle	ACCOUNTABILITY ANTIPOVERTY PROGRAMS BENEFICIARY PARTICIPATION COMPARISON GROUPS CONTROL GROUPS CORRUPTION COUNTERFACTUAL COUNTERFACTUALS CULTURAL FACTORS DATA COLLECTION DATA REQUIREMENTS DEVELOPMENT RESEARCH DUMMY VARIABLES ECONOMETRIC ANALYSIS EVALUATION DESIGN EVALUATION METHODS EVALUATION STRATEGIES EVALUATION TECHNIQUES EVALUATORS EXPERIMENTAL DESIGN EXPERIMENTAL DESIGNS EXTRAPOLATION FIELD WORK FLEXIBILITY GOVERNMENT AGENCIES HOUSEHOLD SURVEYS HYPOTHESES IMPACT ANALYSIS IMPACT ASSESSMENT IMPACT EVALUATION IMPACT EVALUATION DESIGN IMPACT INDICATORS INCOME INCOME DISTRIBUTION INCOME INEQUALITY INSTRUMENTAL VARIABLES INTERNAL MONITORING INTERVENTION KEY INFORMANT INTERVIEWS LABOR MARKETS LEARNING MATCHING METHODS METHODOLOGICAL ISSUES METHODOLOGIES MODELING MONITORING DATA MORTALITY OPINION POLLS OUTCOME INDICATORS PARTICIPATION RATES PARTICIPATORY PROJECTS PRA PROGRAM ASSESSMENTS PROGRAM EVALUATION PROGRAM INTERVENTIONS PROGRAM OUTCOMES PROGRAMS PROJECT BENEFICIARIES PROJECT EVALUATION PROJECT IMPACTS PROJECT MANAGEMENT PROJECT MONITORING PROPENSITY SCORE MATCHING QUALITATIVE DATA QUALITATIVE EVALUATION QUALITATIVE METHODS QUALITATIVE RESEARCH QUALITATIVE TOOLS QUANTITATIVE DATA QUANTITATIVE DATA COLLECTION METHODS QUANTITATIVE EVALUATION QUANTITATIVE METHODS QUANTITATIVE RESEARCH QUANTITATIVE SURVEYS QUESTIONNAIRES RANDOM SAMPLING RANDOMIZATION REGRESSION ANALYSES REGRESSION ANALYSIS RELIABILITY REPRESENTATIVE SAMPLES RESEARCH CENTERS RESEARCH METHODS RESEARCH WORKING PAPERS RESEARCHERS SAMPLE SELECTION SAMPLE SURVEYS SAMPLING FRAMES SAMPLING TECHNIQUES SCENARIO SCENARIOS SELECTION BIAS SERVICE DELIVERY STANDARD ERRORS STATISTICAL ANALYSIS STATISTICAL DATA STATISTICAL INDICATORS STATISTICAL METHODS STATISTICAL SIGNIFICANCE STATISTICAL TECHNIQUES STATISTICIANS STRUCTURAL MODELING SURVEY DATA SURVEY INSTRUMENTS TECHNIQUES TREATMENT EFFECTS VALIDITY Bamberger, Michael Rao, Vijayendra Woolcock, Michael Using Mixed Methods in Monitoring and Evaluation : Experiences from International Development
geographic_facet	The World Region The World Region
relation	Policy Research working paper ; no. WPS 5245
description	This paper provides an overview of the various ways in which mixing qualitative and quantitative methods could add value to monitoring and evaluating development projects. In particular it examines how qualitative methods could address some of the limitations of randomized trials and other quantitative impact evaluation methods; it also explores the importance of examining "process" in addition to "impact", distinguishing design from implementation failures, and the value of mixed methods in the real-time monitoring of projects. It concludes by suggesting topics for future research -- including the use of mixed methods in constructing counterfactuals, and in conducting reasonable evaluations within severe time and budget constraints.
format	Publications & Research :: Policy Research Working Paper
author	Bamberger, Michael Rao, Vijayendra Woolcock, Michael
author_facet	Bamberger, Michael Rao, Vijayendra Woolcock, Michael
author_sort	Bamberger, Michael
title	Using Mixed Methods in Monitoring and Evaluation : Experiences from International Development
title_short	Using Mixed Methods in Monitoring and Evaluation : Experiences from International Development
title_full	Using Mixed Methods in Monitoring and Evaluation : Experiences from International Development
title_fullStr	Using Mixed Methods in Monitoring and Evaluation : Experiences from International Development
title_full_unstemmed	Using Mixed Methods in Monitoring and Evaluation : Experiences from International Development
title_sort	using mixed methods in monitoring and evaluation : experiences from international development
publishDate	2012
url	http://www-wds.worldbank.org/external/default/main?menuPK=64187510&pagePK=64193027&piPK=64187937&theSitePK=523679&menuPK=64187510&searchMenuPK=64187283&siteName=WDS&entityID=000158349_20100323100628 http://hdl.handle.net/10986/3732
_version_	1764388048831774720

Using Mixed Methods in Monitoring and Evaluation : Experiences from International Development

Similar Items