Advanced Content Analysis : Can Artificial Intelligence Accelerate Theory-Driven Complex Program Evaluation?

This pilot study tests the applicability, usefulness, and added value of using AI for advanced theory-based content analysis within the framework of IEG’s thematic evaluations. Using a set of interventions associated with the World Bank’s chronic m...

Full description

Bibliographic Details
Main Authors: Franzen, Samuel, Quang, Cuong, Schweizer, Lukas, Budzier, Alexander, Hrstich, Peter, Reissfelder, Stéphane, Gold, Jenny, Vellez, Mercedes, Ramirez, Santiago, Raimondo, Estelle
Format: Working Paper
Language:English
Published: World Bank, Washington, DC 2022
Subjects:
Online Access:http://documents.worldbank.org/curated/en/400031645128516191/Advanced-Content-Analysis-Can-Artificial-Intelligence-Accelerate-Theory-Driven-Complex-Program-Evaluation
http://hdl.handle.net/10986/37117
id okr-10986-37117
recordtype oai_dc
spelling okr-10986-371172022-03-10T05:10:39Z Advanced Content Analysis : Can Artificial Intelligence Accelerate Theory-Driven Complex Program Evaluation? Franzen, Samuel Quang, Cuong Schweizer, Lukas Budzier, Alexander Hrstich, Peter Reissfelder, Stéphane Gold, Jenny Vellez, Mercedes Ramirez, Santiago Raimondo, Estelle COMPLEX PROGRAM EVALUATION DEVELOPMENT EVALUATION CHALLENGES THEORY-DRIVEN EVALUATION AUTOMATE CONTENT ANALYSIS AUTOMATE QUALITATIVE SYNTHESIS MACHINE LEARNING ARTIFICIAL INTENNIGENCE (AI) This pilot study tests the applicability, usefulness, and added value of using AI for advanced theory-based content analysis within the framework of IEG’s thematic evaluations. Using a set of interventions associated with the World Bank’s chronic malnutrition and stunted growth portfolio, the paper assesses the efficiency gains generated by AI-assisted content analysis in labeling and classifying text according to an outcome-based conceptual framework. 2022-03-09T21:38:59Z 2022-03-09T21:38:59Z 2022 Working Paper http://documents.worldbank.org/curated/en/400031645128516191/Advanced-Content-Analysis-Can-Artificial-Intelligence-Accelerate-Theory-Driven-Complex-Program-Evaluation http://hdl.handle.net/10986/37117 English CC BY 3.0 IGO http://creativecommons.org/licenses/by/3.0/igo World Bank World Bank, Washington, DC Publications & Research :: Departmental Working Paper
repository_type Digital Repository
institution_category Foreign Institution
institution Digital Repositories
building World Bank Open Knowledge Repository
collection World Bank
language English
topic COMPLEX PROGRAM EVALUATION
DEVELOPMENT EVALUATION CHALLENGES
THEORY-DRIVEN EVALUATION
AUTOMATE CONTENT ANALYSIS
AUTOMATE QUALITATIVE SYNTHESIS
MACHINE LEARNING
ARTIFICIAL INTENNIGENCE (AI)
spellingShingle COMPLEX PROGRAM EVALUATION
DEVELOPMENT EVALUATION CHALLENGES
THEORY-DRIVEN EVALUATION
AUTOMATE CONTENT ANALYSIS
AUTOMATE QUALITATIVE SYNTHESIS
MACHINE LEARNING
ARTIFICIAL INTENNIGENCE (AI)
Franzen, Samuel
Quang, Cuong
Schweizer, Lukas
Budzier, Alexander
Hrstich, Peter
Reissfelder, Stéphane
Gold, Jenny
Vellez, Mercedes
Ramirez, Santiago
Raimondo, Estelle
Advanced Content Analysis : Can Artificial Intelligence Accelerate Theory-Driven Complex Program Evaluation?
description This pilot study tests the applicability, usefulness, and added value of using AI for advanced theory-based content analysis within the framework of IEG’s thematic evaluations. Using a set of interventions associated with the World Bank’s chronic malnutrition and stunted growth portfolio, the paper assesses the efficiency gains generated by AI-assisted content analysis in labeling and classifying text according to an outcome-based conceptual framework.
format Working Paper
author Franzen, Samuel
Quang, Cuong
Schweizer, Lukas
Budzier, Alexander
Hrstich, Peter
Reissfelder, Stéphane
Gold, Jenny
Vellez, Mercedes
Ramirez, Santiago
Raimondo, Estelle
author_facet Franzen, Samuel
Quang, Cuong
Schweizer, Lukas
Budzier, Alexander
Hrstich, Peter
Reissfelder, Stéphane
Gold, Jenny
Vellez, Mercedes
Ramirez, Santiago
Raimondo, Estelle
author_sort Franzen, Samuel
title Advanced Content Analysis : Can Artificial Intelligence Accelerate Theory-Driven Complex Program Evaluation?
title_short Advanced Content Analysis : Can Artificial Intelligence Accelerate Theory-Driven Complex Program Evaluation?
title_full Advanced Content Analysis : Can Artificial Intelligence Accelerate Theory-Driven Complex Program Evaluation?
title_fullStr Advanced Content Analysis : Can Artificial Intelligence Accelerate Theory-Driven Complex Program Evaluation?
title_full_unstemmed Advanced Content Analysis : Can Artificial Intelligence Accelerate Theory-Driven Complex Program Evaluation?
title_sort advanced content analysis : can artificial intelligence accelerate theory-driven complex program evaluation?
publisher World Bank, Washington, DC
publishDate 2022
url http://documents.worldbank.org/curated/en/400031645128516191/Advanced-Content-Analysis-Can-Artificial-Intelligence-Accelerate-Theory-Driven-Complex-Program-Evaluation
http://hdl.handle.net/10986/37117
_version_ 1764486451280478208