An Evaluation of the Performance of Regression Discontinuity Design on PROGRESA

While providing the most reliable method of evaluating social programs, randomized experiments in developing and developed countries alike are accompanied by political risks and ethical issues that jeopardize the chances of adopting them. In this...

Full description

Bibliographic Details
Main Authors: Buddelmeyer, Hielke, Skoufias, Emmanuel
Format: Policy Research Working Paper
Language:English
en_US
Published: World Bank, Washington, D.C. 2013
Subjects:
Online Access:http://documents.worldbank.org/curated/en/2004/09/5114458/evaluation-performance-regression-discontinuity-design-progresa
http://hdl.handle.net/10986/14153
id okr-10986-14153
recordtype oai_dc
spelling okr-10986-141532021-04-23T14:03:21Z An Evaluation of the Performance of Regression Discontinuity Design on PROGRESA Buddelmeyer, Hielke Skoufias, Emmanuel DEVELOPING COUNTRIES ESTIMATORS ETHICS EXPERIMENTAL DESIGN EXPERIMENTAL DESIGNS EXPERIMENTAL IMPACT ESTIMATES EXPERIMENTATION EXPERIMENTS FAMILIES GENDER GIRLS HOUSEHOLD CHARACTERISTICS HOUSEHOLDS HUMAN CAPITAL INHABITANTS INTERVENTION LABOR MARKETS MEDIA MOTHERS NUTRITION PARENTS RESEARCH WORKING PAPERS RURAL COMMUNITIES SOCIAL POLICY SOCIAL RESEARCH URBAN AREAS VILLAGES WEIGHT YOUTH TREATMENT EFFECTS While providing the most reliable method of evaluating social programs, randomized experiments in developing and developed countries alike are accompanied by political risks and ethical issues that jeopardize the chances of adopting them. In this paper the authors use a unique data set from rural Mexico collected for the purposes of evaluating the impact of the PROGRESA poverty alleviation program to examine the performance of a quasi-experimental estimator, the Regression Discontinuity Design (RDD). Using as a benchmark the impact estimates based on the experimental nature of the sample, we examine how estimates differ when we use the RDD as the estimator for evaluating program impact on two key indicators: child school attendance and child work. Overall the performance of the RDD was remarkably good. The RDD estimates of program impact agreed with the experimental estimates in 10 out of the 12 possible cases. The two cases in which the RDD method failed to reveal any significant program impact on the school attendance of boys and girls were in the first year of the program (round 3). RDD estimates comparable to the experimental estimates were obtained when we used as a comparison group children from non-eligible households in the control localities. 2013-06-24T18:29:35Z 2013-06-24T18:29:35Z 2004-09 http://documents.worldbank.org/curated/en/2004/09/5114458/evaluation-performance-regression-discontinuity-design-progresa http://hdl.handle.net/10986/14153 English en_US Policy Research Working Paper;No.3386 CC BY 3.0 IGO http://creativecommons.org/licenses/by/3.0/igo/ World Bank World Bank, Washington, D.C. Publications & Research :: Policy Research Working Paper Publications & Research Latin America & Caribbean Mexico
repository_type Digital Repository
institution_category Foreign Institution
institution Digital Repositories
building World Bank Open Knowledge Repository
collection World Bank
language English
en_US
topic DEVELOPING COUNTRIES
ESTIMATORS
ETHICS
EXPERIMENTAL DESIGN
EXPERIMENTAL DESIGNS
EXPERIMENTAL IMPACT ESTIMATES
EXPERIMENTATION
EXPERIMENTS
FAMILIES
GENDER
GIRLS
HOUSEHOLD CHARACTERISTICS
HOUSEHOLDS
HUMAN CAPITAL
INHABITANTS
INTERVENTION
LABOR MARKETS
MEDIA
MOTHERS
NUTRITION
PARENTS
RESEARCH WORKING PAPERS
RURAL COMMUNITIES
SOCIAL POLICY
SOCIAL RESEARCH
URBAN AREAS
VILLAGES
WEIGHT
YOUTH
TREATMENT EFFECTS
spellingShingle DEVELOPING COUNTRIES
ESTIMATORS
ETHICS
EXPERIMENTAL DESIGN
EXPERIMENTAL DESIGNS
EXPERIMENTAL IMPACT ESTIMATES
EXPERIMENTATION
EXPERIMENTS
FAMILIES
GENDER
GIRLS
HOUSEHOLD CHARACTERISTICS
HOUSEHOLDS
HUMAN CAPITAL
INHABITANTS
INTERVENTION
LABOR MARKETS
MEDIA
MOTHERS
NUTRITION
PARENTS
RESEARCH WORKING PAPERS
RURAL COMMUNITIES
SOCIAL POLICY
SOCIAL RESEARCH
URBAN AREAS
VILLAGES
WEIGHT
YOUTH
TREATMENT EFFECTS
Buddelmeyer, Hielke
Skoufias, Emmanuel
An Evaluation of the Performance of Regression Discontinuity Design on PROGRESA
geographic_facet Latin America & Caribbean
Mexico
relation Policy Research Working Paper;No.3386
description While providing the most reliable method of evaluating social programs, randomized experiments in developing and developed countries alike are accompanied by political risks and ethical issues that jeopardize the chances of adopting them. In this paper the authors use a unique data set from rural Mexico collected for the purposes of evaluating the impact of the PROGRESA poverty alleviation program to examine the performance of a quasi-experimental estimator, the Regression Discontinuity Design (RDD). Using as a benchmark the impact estimates based on the experimental nature of the sample, we examine how estimates differ when we use the RDD as the estimator for evaluating program impact on two key indicators: child school attendance and child work. Overall the performance of the RDD was remarkably good. The RDD estimates of program impact agreed with the experimental estimates in 10 out of the 12 possible cases. The two cases in which the RDD method failed to reveal any significant program impact on the school attendance of boys and girls were in the first year of the program (round 3). RDD estimates comparable to the experimental estimates were obtained when we used as a comparison group children from non-eligible households in the control localities.
format Publications & Research :: Policy Research Working Paper
author Buddelmeyer, Hielke
Skoufias, Emmanuel
author_facet Buddelmeyer, Hielke
Skoufias, Emmanuel
author_sort Buddelmeyer, Hielke
title An Evaluation of the Performance of Regression Discontinuity Design on PROGRESA
title_short An Evaluation of the Performance of Regression Discontinuity Design on PROGRESA
title_full An Evaluation of the Performance of Regression Discontinuity Design on PROGRESA
title_fullStr An Evaluation of the Performance of Regression Discontinuity Design on PROGRESA
title_full_unstemmed An Evaluation of the Performance of Regression Discontinuity Design on PROGRESA
title_sort evaluation of the performance of regression discontinuity design on progresa
publisher World Bank, Washington, D.C.
publishDate 2013
url http://documents.worldbank.org/curated/en/2004/09/5114458/evaluation-performance-regression-discontinuity-design-progresa
http://hdl.handle.net/10986/14153
_version_ 1764430653050322944