Short-run Learning Dynamics under a Test-based Accountability System : Evidence from Pakistan

Low student learning is a common finding in much of the developing world. This paper uses a relatively unique dataset of five semiannual rounds of standardized test data to characterize and explain the short-term changes in student learning. The da...

Full description

Bibliographic Details
Main Authors: Barrera-Osorio, Felipe, Raju, Dhushyanth
Format: Policy Research Working Paper
Language:English
Published: 2012
Subjects:
LET
Online Access:http://www-wds.worldbank.org/external/default/main?menuPK=64187510&pagePK=64193027&piPK=64187937&theSitePK=523679&menuPK=64187510&searchMenuPK=64187283&siteName=WDS&entityID=000158349_20101101161208
http://hdl.handle.net/10986/3946
id okr-10986-3946
recordtype oai_dc
repository_type Digital Repository
institution_category Foreign Institution
institution Digital Repositories
building World Bank Open Knowledge Repository
collection World Bank
language English
topic ACADEMIC YEAR
ACADEMIC YEARS
ACCESS TO SCHOOLING
ASSESSMENT SYSTEM
ATTENDANCE RATE
ATTENDANCE RECORDS
ATTENDANCE REQUIREMENT
AVERAGE TREATMENT EFFECT
BINDING
BLACKBOARDS
BOARD OF DIRECTORS
CLASSROOM
CLASSROOM MANAGEMENT
CLASSROOM SPACE
CLASSROOMS
COMPUTER SCIENCE
CURRICULUM
DEGREES
EDUCATION ASSESSMENT
EDUCATION SYSTEM
EDUCATION SYSTEMS
ENROLLMENT FIGURES
ENROLLMENT INCREASES
EQUITABLE ACCESS
EXPENDITURES
FORMAL SCHOOLING
GENDER PARITY
GIRLS
GIRLS ENROLLMENT
HIGHER LEVELS OF EDUCATION
HOMEWORK
HUMAN DEVELOPMENT
ILLITERACY
INDEXES
LEARNERS
LEARNING
LEARNING LEVELS
LEARNING OUTCOMES
LET
LEVELS OF EDUCATION
LITERATURE
MATHEMATICS
MIDDLE SCHOOLS
NATIONAL CURRICULUM
NATIONAL EDUCATION
NUMBER OF SCHOOLS
NUMBER OF STUDENTS
NUMBER OF TEACHERS
NUTRITION
PAPERS
PASS RATE
PHYSICAL INFRASTRUCTURE
PRIMARY SCHOOL
PRIMARY SCHOOLS
PRIVATE SCHOOL
PRIVATE SCHOOLING
PRIVATE SCHOOLS
PUBLIC EDUCATION
PUBLIC FUNDS
PUBLIC SCHOOL
PUBLIC SCHOOL SYSTEM
PUBLIC SCHOOL TEACHER
PUBLIC SCHOOL TEACHERS
PUBLIC SCHOOLS
QUALITY ASSURANCE
QUALITY OF EDUCATION
QUALITY STANDARDS
RURAL AREAS
RURAL CHILDREN
SCHOOL COUNTERPARTS
SCHOOL EDUCATION
SCHOOL EFFECTIVENESS
SCHOOL EFFECTS
SCHOOL ENROLLMENT
SCHOOL HOURS
SCHOOL INSPECTIONS
SCHOOL LEVEL
SCHOOL MANAGEMENT
SCHOOL PARTICIPATION
SCHOOL QUALITY
SCHOOL SIZE
SCHOOL TEACHER
SCHOOL TEACHERS
SCHOOL VOUCHERS
SECONDARY EDUCATION
SECONDARY EDUCATION SYSTEM
SECONDARY SCHOOL
SECONDARY SCHOOLS
SMALL SCHOOLS
STANDARDIZED TESTS
STUDENT ACHIEVEMENT
STUDENT ATTENDANCE
STUDENT LEARNING
STUDENT PERFORMANCE
STUDENT SCORES
STUDENT SUBSIDIES
STUDENT SUBSIDY
SUBJECT SPECIALIST
SUBJECT SPECIALISTS
SUBJECTS
SYLLABI
TEACHER
TEACHER ABSENTEEISM
TEACHER CREDENTIALS
TEACHER INCENTIVES
TEACHER PERFORMANCE
TEACHER QUALITY
TEACHER SALARIES
TEACHER TRAINING
TEACHERS
TEACHING
TEACHING EXPERIENCE
TEACHING TOOLS
TEST ADMINISTRATION
TEST SCORES
TEXTBOOK
TEXTBOOK BOARD
TEXTBOOKS
TRAINING COURSES
TUITION
TUITION PAYMENTS
TUTORING
UNIVERSITY EDUCATION
VERNACULAR LANGUAGE
spellingShingle ACADEMIC YEAR
ACADEMIC YEARS
ACCESS TO SCHOOLING
ASSESSMENT SYSTEM
ATTENDANCE RATE
ATTENDANCE RECORDS
ATTENDANCE REQUIREMENT
AVERAGE TREATMENT EFFECT
BINDING
BLACKBOARDS
BOARD OF DIRECTORS
CLASSROOM
CLASSROOM MANAGEMENT
CLASSROOM SPACE
CLASSROOMS
COMPUTER SCIENCE
CURRICULUM
DEGREES
EDUCATION ASSESSMENT
EDUCATION SYSTEM
EDUCATION SYSTEMS
ENROLLMENT FIGURES
ENROLLMENT INCREASES
EQUITABLE ACCESS
EXPENDITURES
FORMAL SCHOOLING
GENDER PARITY
GIRLS
GIRLS ENROLLMENT
HIGHER LEVELS OF EDUCATION
HOMEWORK
HUMAN DEVELOPMENT
ILLITERACY
INDEXES
LEARNERS
LEARNING
LEARNING LEVELS
LEARNING OUTCOMES
LET
LEVELS OF EDUCATION
LITERATURE
MATHEMATICS
MIDDLE SCHOOLS
NATIONAL CURRICULUM
NATIONAL EDUCATION
NUMBER OF SCHOOLS
NUMBER OF STUDENTS
NUMBER OF TEACHERS
NUTRITION
PAPERS
PASS RATE
PHYSICAL INFRASTRUCTURE
PRIMARY SCHOOL
PRIMARY SCHOOLS
PRIVATE SCHOOL
PRIVATE SCHOOLING
PRIVATE SCHOOLS
PUBLIC EDUCATION
PUBLIC FUNDS
PUBLIC SCHOOL
PUBLIC SCHOOL SYSTEM
PUBLIC SCHOOL TEACHER
PUBLIC SCHOOL TEACHERS
PUBLIC SCHOOLS
QUALITY ASSURANCE
QUALITY OF EDUCATION
QUALITY STANDARDS
RURAL AREAS
RURAL CHILDREN
SCHOOL COUNTERPARTS
SCHOOL EDUCATION
SCHOOL EFFECTIVENESS
SCHOOL EFFECTS
SCHOOL ENROLLMENT
SCHOOL HOURS
SCHOOL INSPECTIONS
SCHOOL LEVEL
SCHOOL MANAGEMENT
SCHOOL PARTICIPATION
SCHOOL QUALITY
SCHOOL SIZE
SCHOOL TEACHER
SCHOOL TEACHERS
SCHOOL VOUCHERS
SECONDARY EDUCATION
SECONDARY EDUCATION SYSTEM
SECONDARY SCHOOL
SECONDARY SCHOOLS
SMALL SCHOOLS
STANDARDIZED TESTS
STUDENT ACHIEVEMENT
STUDENT ATTENDANCE
STUDENT LEARNING
STUDENT PERFORMANCE
STUDENT SCORES
STUDENT SUBSIDIES
STUDENT SUBSIDY
SUBJECT SPECIALIST
SUBJECT SPECIALISTS
SUBJECTS
SYLLABI
TEACHER
TEACHER ABSENTEEISM
TEACHER CREDENTIALS
TEACHER INCENTIVES
TEACHER PERFORMANCE
TEACHER QUALITY
TEACHER SALARIES
TEACHER TRAINING
TEACHERS
TEACHING
TEACHING EXPERIENCE
TEACHING TOOLS
TEST ADMINISTRATION
TEST SCORES
TEXTBOOK
TEXTBOOK BOARD
TEXTBOOKS
TRAINING COURSES
TUITION
TUITION PAYMENTS
TUTORING
UNIVERSITY EDUCATION
VERNACULAR LANGUAGE
Barrera-Osorio, Felipe
Raju, Dhushyanth
Short-run Learning Dynamics under a Test-based Accountability System : Evidence from Pakistan
geographic_facet South Asia
South Asia
South Asia
Asia
Pakistan
relation Policy Research working paper ; no. WPS 5465
description Low student learning is a common finding in much of the developing world. This paper uses a relatively unique dataset of five semiannual rounds of standardized test data to characterize and explain the short-term changes in student learning. The data are collected as part of the quality assurance system for a public-private partnership program that offers public subsidies conditional on minimum learning levels to low-cost private schools in Pakistan. Apart from a large positive distributional shift in learning between the first two test rounds, the learning distributions over test rounds show little progress. Schools are ejected from the program if they fail to achieve a minimum pass rate in the test in two consecutive attempts, making the test high stakes. Sharp regression discontinuity estimates show that the threat of program exit on schools that barely failed the test for the first time induces large learning gains. The large change in learning between the first two test rounds is likely attributable to this accountability pressure given that a large share of new program entrants failed in the first test round. Schools also qualify for substantial annual teacher bonuses if they achieve a minimum score in a composite measure of student test participation and mean test score. Sharp regression discontinuity estimates do not show that the prospect of future teacher bonus rewards induces learning gains for schools that barely did not qualify for the bonus.
format Publications & Research :: Policy Research Working Paper
author Barrera-Osorio, Felipe
Raju, Dhushyanth
author_facet Barrera-Osorio, Felipe
Raju, Dhushyanth
author_sort Barrera-Osorio, Felipe
title Short-run Learning Dynamics under a Test-based Accountability System : Evidence from Pakistan
title_short Short-run Learning Dynamics under a Test-based Accountability System : Evidence from Pakistan
title_full Short-run Learning Dynamics under a Test-based Accountability System : Evidence from Pakistan
title_fullStr Short-run Learning Dynamics under a Test-based Accountability System : Evidence from Pakistan
title_full_unstemmed Short-run Learning Dynamics under a Test-based Accountability System : Evidence from Pakistan
title_sort short-run learning dynamics under a test-based accountability system : evidence from pakistan
publishDate 2012
url http://www-wds.worldbank.org/external/default/main?menuPK=64187510&pagePK=64193027&piPK=64187937&theSitePK=523679&menuPK=64187510&searchMenuPK=64187283&siteName=WDS&entityID=000158349_20101101161208
http://hdl.handle.net/10986/3946
_version_ 1764389152494714880
spelling okr-10986-39462021-04-23T14:02:14Z Short-run Learning Dynamics under a Test-based Accountability System : Evidence from Pakistan Barrera-Osorio, Felipe Raju, Dhushyanth ACADEMIC YEAR ACADEMIC YEARS ACCESS TO SCHOOLING ASSESSMENT SYSTEM ATTENDANCE RATE ATTENDANCE RECORDS ATTENDANCE REQUIREMENT AVERAGE TREATMENT EFFECT BINDING BLACKBOARDS BOARD OF DIRECTORS CLASSROOM CLASSROOM MANAGEMENT CLASSROOM SPACE CLASSROOMS COMPUTER SCIENCE CURRICULUM DEGREES EDUCATION ASSESSMENT EDUCATION SYSTEM EDUCATION SYSTEMS ENROLLMENT FIGURES ENROLLMENT INCREASES EQUITABLE ACCESS EXPENDITURES FORMAL SCHOOLING GENDER PARITY GIRLS GIRLS ENROLLMENT HIGHER LEVELS OF EDUCATION HOMEWORK HUMAN DEVELOPMENT ILLITERACY INDEXES LEARNERS LEARNING LEARNING LEVELS LEARNING OUTCOMES LET LEVELS OF EDUCATION LITERATURE MATHEMATICS MIDDLE SCHOOLS NATIONAL CURRICULUM NATIONAL EDUCATION NUMBER OF SCHOOLS NUMBER OF STUDENTS NUMBER OF TEACHERS NUTRITION PAPERS PASS RATE PHYSICAL INFRASTRUCTURE PRIMARY SCHOOL PRIMARY SCHOOLS PRIVATE SCHOOL PRIVATE SCHOOLING PRIVATE SCHOOLS PUBLIC EDUCATION PUBLIC FUNDS PUBLIC SCHOOL PUBLIC SCHOOL SYSTEM PUBLIC SCHOOL TEACHER PUBLIC SCHOOL TEACHERS PUBLIC SCHOOLS QUALITY ASSURANCE QUALITY OF EDUCATION QUALITY STANDARDS RURAL AREAS RURAL CHILDREN SCHOOL COUNTERPARTS SCHOOL EDUCATION SCHOOL EFFECTIVENESS SCHOOL EFFECTS SCHOOL ENROLLMENT SCHOOL HOURS SCHOOL INSPECTIONS SCHOOL LEVEL SCHOOL MANAGEMENT SCHOOL PARTICIPATION SCHOOL QUALITY SCHOOL SIZE SCHOOL TEACHER SCHOOL TEACHERS SCHOOL VOUCHERS SECONDARY EDUCATION SECONDARY EDUCATION SYSTEM SECONDARY SCHOOL SECONDARY SCHOOLS SMALL SCHOOLS STANDARDIZED TESTS STUDENT ACHIEVEMENT STUDENT ATTENDANCE STUDENT LEARNING STUDENT PERFORMANCE STUDENT SCORES STUDENT SUBSIDIES STUDENT SUBSIDY SUBJECT SPECIALIST SUBJECT SPECIALISTS SUBJECTS SYLLABI TEACHER TEACHER ABSENTEEISM TEACHER CREDENTIALS TEACHER INCENTIVES TEACHER PERFORMANCE TEACHER QUALITY TEACHER SALARIES TEACHER TRAINING TEACHERS TEACHING TEACHING EXPERIENCE TEACHING TOOLS TEST ADMINISTRATION TEST SCORES TEXTBOOK TEXTBOOK BOARD TEXTBOOKS TRAINING COURSES TUITION TUITION PAYMENTS TUTORING UNIVERSITY EDUCATION VERNACULAR LANGUAGE Low student learning is a common finding in much of the developing world. This paper uses a relatively unique dataset of five semiannual rounds of standardized test data to characterize and explain the short-term changes in student learning. The data are collected as part of the quality assurance system for a public-private partnership program that offers public subsidies conditional on minimum learning levels to low-cost private schools in Pakistan. Apart from a large positive distributional shift in learning between the first two test rounds, the learning distributions over test rounds show little progress. Schools are ejected from the program if they fail to achieve a minimum pass rate in the test in two consecutive attempts, making the test high stakes. Sharp regression discontinuity estimates show that the threat of program exit on schools that barely failed the test for the first time induces large learning gains. The large change in learning between the first two test rounds is likely attributable to this accountability pressure given that a large share of new program entrants failed in the first test round. Schools also qualify for substantial annual teacher bonuses if they achieve a minimum score in a composite measure of student test participation and mean test score. Sharp regression discontinuity estimates do not show that the prospect of future teacher bonus rewards induces learning gains for schools that barely did not qualify for the bonus. 2012-03-19T18:42:38Z 2012-03-19T18:42:38Z 2010-11-01 http://www-wds.worldbank.org/external/default/main?menuPK=64187510&pagePK=64193027&piPK=64187937&theSitePK=523679&menuPK=64187510&searchMenuPK=64187283&siteName=WDS&entityID=000158349_20101101161208 http://hdl.handle.net/10986/3946 English Policy Research working paper ; no. WPS 5465 CC BY 3.0 IGO http://creativecommons.org/licenses/by/3.0/igo/ World Bank Publications & Research :: Policy Research Working Paper South Asia South Asia South Asia Asia Pakistan