Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash 91 tok/s
Gemini 2.5 Pro 58 tok/s Pro
GPT-5 Medium 29 tok/s
GPT-5 High 29 tok/s Pro
GPT-4o 102 tok/s
GPT OSS 120B 462 tok/s Pro
Kimi K2 181 tok/s Pro
2000 character limit reached

Decomposition and Interpretation of Treatment Effects in Settings with Delayed Outcomes (2302.11505v4)

Published 22 Feb 2023 in econ.EM

Abstract: This paper studies settings where the analyst is interested in identifying and estimating the average causal effect of a binary treatment on an outcome. We consider a setup in which the outcome realization does not get immediately realized after the treatment assignment, a feature that is ubiquitous in empirical settings. The period between the treatment and the realization of the outcome allows other observed actions to occur and affect the outcome. In this context, we study several regression-based estimands routinely used in empirical work to capture the average treatment effect and shed light on interpreting them in terms of ceteris paribus effects, indirect causal effects, and selection terms. We obtain three main and related takeaways. First, the three most popular estimands do not generally satisfy what we call \emph{strong sign preservation}, in the sense that these estimands may be negative even when the treatment positively affects the outcome conditional on any possible combination of other actions. Second, the most popular regression that includes the other actions as controls satisfies strong sign preservation \emph{if and only if} these actions are mutually exclusive binary variables. Finally, we show that a linear regression that fully stratifies the other actions leads to estimands that satisfy strong sign preservation.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (44)
  1. How airbnb measures future value to standardize tradeoffs. Medium.com. URL https://medium.com/airbnb-engineering/how-airbnb-measures-future-value-to-standardize-tradeoffs-3aa99a941ba5.
  2. How merchant towns shaped parliaments: From the norman conquest of england to the great reform act. American Economic Review, 112 3441–3487.
  3. Angrist, J. D. (1998). Estimating the labor market impact of voluntary military service using social security data on military applicants. Econometrica, 66 249–288.
  4. Mostly harmless econometrics: An empiricist’s companion. Princeton university press.
  5. Design-based analysis in difference-in-differences settings with staggered adoption. Journal of Econometrics, 226 62–79.
  6. The moderator–mediator variable distinction in social psychological research: Conceptual, strategic, and statistical considerations. Journal of personality and social psychology, 51 1173.
  7. Profitability of Fertilizer: Experimental Evidence from Female Rice Farmers in Mali. American Economic Review, 103 381–386.
  8. Revisiting event study designs: Robust and efficient estimation. Available at SSRN 2826228.
  9. Inference under covariate adaptive randomization. Journal of the American Statistical Association (Theory & Methods), 113 1741–1768.
  10. Inference under covariate-adaptive randomization with multiple treatments. Quantitative Economics, 10 1741–1768.
  11. On the use of outcome tests for detecting bias in decision making. Tech. rep., National Bureau of Economic Research.
  12. Criteria for surrogate end points. Journal of the Royal Statistical Society Series B: Statistical Methodology, 69 919–932.
  13. Causal impact of masks, policies, behavior on early covid-19 pandemic in the us. Journal of econometrics, 220 23–62.
  14. Two-way fixed effects estimators with heterogeneous treatment effects. American Economic Review, 110 2964–96.
  15. Nudging Farmers to Use Fertilizer: Theory and Experimental Evidence from Kenya. American Economic Review, 101 2350–2390.
  16. Why do wealthy parents have wealthy children? Journal of Political Economy, 129 703–756.
  17. Glynn, A. N. (2012). The product and difference fallacies for indirect effects. American Journal of Political Science, 56 257–269.
  18. Contamination bias in linear regressions. 2106.05024.
  19. Goodman-Bacon, A. (2021). Difference-in-differences with variation in treatment timing. Journal of Econometrics, 225 254–277.
  20. Understanding the mechanisms through which an influential early childhood program boosted adult outcomes. American Economic Review, 103 2052–86.
  21. Heckman, J. J. (2000). Causal Parameters and Policy Analysis in Economics: A Twentieth Century Retrospective*. Quarterly Journal of Economics, 115 45–97.
  22. Local instrumental variables. In Nonlinear Statistical Interference: Essays in Honor of Takeshi Amemiya (J. P. C. Hsiao, K. Morimune, ed.). Cambridge: Cambridge University Press, 107–111.
  23. Causal Inference: What If. SCRC Press. https://doi.org/10.1201/9781315374932.
  24. Measuring consumer sensitivity to audio advertising: A field experiment on pandora internet radio. Available at SSRN 3166676.
  25. Identification, inference and sensitivity analysis for causal mediation effects. Statistical science, 25 51–71.
  26. Customer lifetime value research in marketing: A review and future directions. Journal of interactive marketing, 16 34–46.
  27. Process analysis: Estimating mediation in treatment evaluations. Evaluation review, 5 602–619.
  28. Juhász, R. (2018). Temporary protection and technology adoption: Evidence from the napoleonic blockade. American Economic Review, 108 3339–3376.
  29. How and why criteria defining moderators and mediators differ between the baron & kenny and macarthur approaches. Health Psychology, 27 S101.
  30. Mediators and moderators of treatment effects in randomized clinical trials. Archives of general psychiatry, 59 877–883.
  31. Manski, C. F. (1997). Monotone Treatment Response. Econometrica, 65 1311.
  32. Returns to Capital in Microenterprises: Evidence from a Field Experiment. The Quarterly Journal of Economics, 124 423–423.
  33. Moderna (2021). A Study of SARS CoV-2 Infection and Potential Transmission in Individuals Immunized With Moderna COVID-19 Vaccine (CoVPN 3006). ClinicalTrials.gov Identifier: NCT04811664. URL https://clinicaltrials.gov/ct2/show/study/NCT04811664.
  34. Nunn, N. (2008). The long-term effects of africa’s slave trades. The Quarterly Journal of Economics, 123 139–176.
  35. Pearl, J. (2001). Direct and indirect effects. In Proceedings of the Seventeenth Conference on Uncertainty in Artificial Intelligence. UAI’01, Morgan Kaufmann Publishers Inc., San Francisco, CA, USA, 411–420.
  36. Robins, J. M. (2003). Semantics of causal dag models and the identification of direct and indirect effects. In Highly Structured Stochastic Systems (N. L. H. P. J. Green and S. Richardson, eds.). Oxford University Press, 70–81.
  37. Identifiability and exchangeability for direct and indirect effects. Epidemiology 143–155.
  38. Natural “Natural Experiments” in Economics. Journal of Economic Literature, 38 827–874.
  39. Estimating dynamic treatment effects in event studies with heterogeneous treatment effects. Journal of Econometrics, 225 175–199.
  40. Semiparametric theory for causal mediation analysis: efficiency bounds, multiple robustness, and sensitivity analysis. Annals of statistics, 40 1816.
  41. VanderWeele, T. J. (2013). Surrogate measures and consistent surrogates. Biometrics, 69 561–565.
  42. Attributing effects to interactions. Epidemiology (Cambridge, Mass.), 25 711.
  43. Persecution perpetuated: the medieval origins of anti-semitic violence in nazi germany. The Quarterly Journal of Economics, 127 1339–1392.
  44. Regression-based causal inference with factorial experiments: estimands, model specifications and design-based properties. Biometrika, 109 799–815.
List To Do Tasks Checklist Streamline Icon: https://streamlinehq.com

Collections

Sign up for free to add this paper to one or more collections.

User Circle Single Streamline Icon: https://streamlinehq.com Sign Up

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now
Ai Generate Text Spark Streamline Icon: https://streamlinehq.com

Paper Prompts

Sign up for free to create and run prompts on this paper using GPT-5.

List Streamline Icon: https://streamlinehq.com Explore 10 Community Prompts
Dice Question Streamline Icon: https://streamlinehq.com

Follow-up Questions

We haven't generated follow-up questions for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Generate Now