Papers
Topics
Authors
Recent
Search
2000 character limit reached

Correcting Attrition Bias using Changes-in-Changes

Published 23 Mar 2022 in econ.EM | (2203.12740v5)

Abstract: Attrition is a common and potentially important threat to internal validity in treatment effect studies. We extend the changes-in-changes approach to identify the average treatment effect for respondents and the entire study population in the presence of attrition. Our method, which exploits baseline outcome data, can be applied to randomized experiments as well as quasi-experimental difference-in-difference designs. A formal comparison highlights that while widely used corrections typically impose restrictions on whether or how response depends on treatment, our proposed attrition correction exploits restrictions on the outcome model. We further show that the conditions required for our correction can accommodate a broad class of response models that depend on treatment in an arbitrary way. We illustrate the implementation of the proposed corrections in an application to a large-scale randomized experiment.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (26)
  1. Athey, Susan and Guido W. Imbens, “Identification and Inference in Nonlinear Difference-in-Differences Models,” Econometrica, 2006, 74 (2), 431–497.
  2. Attanasio, Orazzio P., Costas Meghir, and Ana Santiago, “Education Choices in Mexico: Using a Structural Model and a Randomized Experiment to Evaluate PROGRESA,” The Review of Economic Studies, 2012, 79 (1), 37–66.
  3. Behaghel, Luc, Bruno Crépon, Marc Gurgand, and Thomas Le Barbanchon, “Please Call Again: Correcting Nonresponse Bias in Treatment Effect Models,” Review of Economics and Statistics, 2015, 97, 1070–1080.
  4. Behrman, Jere R. and Petra Todd, “Randomness in The Experimental Samples of Progresa - Education, Health, and Nutrition Program,” 1999. Unpublished Manuscript.
  5. Bobonis, Gustavo J., “The Impact of Conditional Cash Transfers on Marriage and Divorce,” Economic Development and Cultural Change, 2011, 59 (2), 281–312.
  6. Dinardo, John E., Jordan D. Matsudaira, Justin McCrary, and Lisa Sanbonmatsu, “A Practical Proactive Proposal for Dealing with Attrition: Alternative Approaches and an Empirical Example,” Journal of Labor Economics, 2021, 39, S507 – S541.
  7. Fitzgerald, John, Peter Gottschalk, and Robert Moffitt, “An Analysis of Sample Attrition in Panel Data: The Michigan Panel Study of Income Dynamics,” The Journal of Human Resources, 1998, 33 (2), 251–299.
  8. Gertler, Paul J., Sebastian W. Martinez, and Marta Rubio-Codina, “Investing Cash Transfers to Raise Long-Term Living Standards,” American Economic Journal: Applied Economics, January 2012, 4 (1), 164–92.
  9. Ghanem, Dalia, Sarojini Hirshleifer, and Karen Ortiz-Beccera, “Testing Attrition Bias in Field Experiments,” Journal of Human Resources, 2023.
  10. Heckman, James J, “The Common Structure of Statistical Models of Truncation, Sample Selection and Limited Dependent Variables and a Simple Estimator for Such Models,” in Sanford V. Berg, ed., Annals of Economic and Social Measurement, Vol. 5, National Bureau of Economic Research, 1976, pp. 475–492.
  11. Heckman, James J., “Sample Selection Bias as A Specification Error,” Econometrica, 1979, 47 (1), 153–161.
  12. Horowitz, Joel and Charles Manski, “Identification and Robustness with Contaminated and Corrupted Data,” Econometrica, 1995, 63 (2), 281–302.
  13. Horowitz, Joel L. and Charles F. Manski, “Nonparametric Analysis of Randomized Experiments with Missing Covariate and Outcome Data,” Journal of the American Statistical Association, 2000, 95 (449), 77–84.
  14. Huber, Martin, “Identification of Average Treatment Effects in Social Experiments Under Alternative Forms of Attrition,” Journal of Educational and Behavioral Statistics, 2012, 37 (3), 443–474.
  15. Lee, David S., “Trimming for Bounds on Treatment Effects with Missing Outcomes,” NBER Technical Working Papers 0277, National Bureau of Economic Research, Inc June 2002.
  16.   , “Training, Wages, and Sample Selection: Estimating Sharp Bounds on Treatment Effects,” Review of Economic Studies, 2009, 76 (3), 1071–1102.
  17. Manski, Charles F., “Anatomy of the Selection Problem,” The Journal of Human Resources, 1989, 24 (3), 343–360.
  18. Melly, Blaise and Giulia Santangelo, “The changes-in-changes model with covariates,” 2015. Unpublished Manuscript.
  19. Millán, Teresa Molina and Karen Macours, “Attrition in Randomized Control Trials: Using Tracking Information to Correct Bias,” 2021. Unpublished Manuscript.
  20. Parker, Susan W. and Petra E. Todd, “Conditional Cash Transfers: The Case of Progresa/Oportunidades,” Journal of Economic Literature, September 2017, 55 (3), 866–915.
  21.   , Luis Rubalcava, and Graciela Teruel, “Chapter 62 Evaluating Conditional Schooling and Health Programs,” in T. Paul Schultz and John A. Strauss, eds., Handbook of Development Economics, Vol. 4, Elsevier, 2007, pp. 3963–4035.
  22. Sasaki, Yuya and Yulong Wang, “Extreme Changes in Changes,” 2023. Unpublished Manuscript.
  23. Schultz, Paul, “School Subsidies for the Poor: Evaluating the Mexican Progresa Poverty Program,” Journal of Development Economics, 2004, 74 (1), 199–250. New Research on Education in Developing Economies.
  24. Skoufias, Emmanuel, “PROGRESA and Its Impacts on the Human Capital and Welfare of Households in Rural Mexico: A Synthesis of the Results of an Evaluation by IFPRI,” Working Paper, International Food Policy Research Institute April 2001.
  25. van den Berg, Gerard J. and Maarten Lindeboom, “Attrition in Panel Survey Data and the Estimation of Multi-State Labor Market Models,” The Journal of Human Resources, 1998, 33 (2), 458–478.
  26. Ziliak, James P. and Thomas J. Kniesner, “The Importance of Sample Attrition in Life Cycle Labor Supply Estimation,” The Journal of Human Resources, 1998, 33 (2), 507–530.
Citations (2)

Summary

No one has generated a summary of this paper yet.

Paper to Video (Beta)

No one has generated a video about this paper yet.

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Continue Learning

We haven't generated follow-up questions for this paper yet.

Collections

Sign up for free to add this paper to one or more collections.

Tweets

Sign up for free to view the 1 tweet with 0 likes about this paper.