Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
140 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
46 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Higher-Order Causal Message Passing for Experimentation with Complex Interference (2411.00945v2)

Published 1 Nov 2024 in cs.LG, econ.EM, and stat.ML

Abstract: Accurate estimation of treatment effects is essential for decision-making across various scientific fields. This task, however, becomes challenging in areas like social sciences and online marketplaces, where treating one experimental unit can influence outcomes for others through direct or indirect interactions. Such interference can lead to biased treatment effect estimates, particularly when the structure of these interactions is unknown. We address this challenge by introducing a new class of estimators based on causal message-passing, specifically designed for settings with pervasive, unknown interference. Our estimator draws on information from the sample mean and variance of unit outcomes and treatments over time, enabling efficient use of observed data to estimate the evolution of the system state. Concretely, we construct non-linear features from the moments of unit outcomes and treatments and then learn a function that maps these features to future mean and variance of unit outcomes. This allows for the estimation of the treatment effect over time. Extensive simulations across multiple domains, using synthetic and real network data, demonstrate the efficacy of our approach in estimating total treatment effect dynamics, even in cases where interference exhibits non-monotonic behavior in the probability of treatment.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (66)
  1. Network synthetic interventions: A framework for panel data with network interference. arXiv preprint arXiv:2210.11355, 2022.
  2. Causal models for longitudinal and panel data: A survey. Technical report, National Bureau of Economic Research, 2023.
  3. Estimating average causal effects under general interference, with application to a social network experiment. 2017.
  4. The local approach to causal inference under network interference. arXiv preprint arXiv:2105.03810, 2021.
  5. Limitations of design-based causal inference and a/b testing under arbitrary and network interference. Sociological Methodology, 48(1):136–151, 2018.
  6. Randomization tests of causal effects under interference. Biometrika, 106(2):487–494, 2019.
  7. The dynamics of message passing on dense graphs, with applications to compressed sensing. IEEE Transactions on Information Theory, 57(2):764–785, 2011.
  8. Neighborhood adaptive estimators for causal inference under network interference. arXiv preprint arXiv:2212.03683, 2022.
  9. Causal inference under interference and network uncertainty. In Uncertainty in Artificial Intelligence, pages 1028–1038. PMLR, 2020.
  10. Why marketplace experimentation is harder than it seems: the role of test-control interference. In Proceedings of the Fifteenth ACM Conference on Economics and Computation, EC ’14, page 567–582, New York, NY, USA, 2014. Association for Computing Machinery. ISBN 9781450325653. doi: 10.1145/2600057.2602837. URL https://doi.org/10.1145/2600057.2602837.
  11. Erwin Bolthausen. An iterative construction of solutions of the tap equations for the sherrington–kirkpatrick model. Communications in Mathematical Physics, 325(1):333–366, 2014.
  12. A 61-million-person experiment in social influence and political mobilization. Nature, 489(7415):295–298, 2012.
  13. Modeling interference using experiment roll-out. arXiv preprint arXiv:2305.10728, 2023.
  14. Reducing marketplace interference bias via shadow prices. arXiv preprint arXiv:2205.02274, 2022.
  15. Social networks and the decision to insure. American Economic Journal: Applied Economics, 7(2):81–108, 2015.
  16. Correlated cluster-based randomized experiments: Robust variance minimization. Management Science, 2023.
  17. Optimized covariance design for ab test on social network under interference. Advances in Neural Information Processing Systems, 36, 2024.
  18. Alex Chin. Central limit theorems via stein’s method for randomized experiments under interference. arXiv preprint arXiv:1804.03105, 2018.
  19. David Choi. Estimation of monotone treatment effects in network experiments. Journal of the American Statistical Association, 112(519):1147–1155, 2017.
  20. Staggered rollout designs enable causal inference under interference without network knowledge. In Advances in Neural Information Processing Systems, 2022.
  21. David Roxbee Cox. Planning of experiments. 1958.
  22. Message-passing algorithms for compressed sensing. Proceedings of the National Academy of Sciences, 106(45):18914–18919, 2009.
  23. Design and analysis of experiments in networks: Reducing bias from interference. Journal of Causal Inference, 5(1):20150021, 2016.
  24. Markovian interference in experiments. Advances in Neural Information Processing Systems, 35:535–549, 2022.
  25. Correcting for interference in experiments: A case study at douyin. arXiv preprint arXiv:2305.02542, 2023.
  26. Estimating causal effects under network interference with bayesian generalized propensity scores. Journal of Machine Learning Research, 23(289):1–61, 2022.
  27. Design and analysis of bipartite experiments under a linear exposure-response model. In Proceedings of the 23rd ACM Conference on Economics and Computation, EC ’22, page 606, New York, NY, USA, 2022. Association for Computing Machinery. ISBN 9781450391504. URL https://doi.org/10.1145/3490486.3538269.
  28. Paul W Holland. Statistics and causal inference. Journal of the American statistical Association, 81(396):945–960, 1986.
  29. Reducing interference bias in online marketplace pricing experiments. arXiv preprint arXiv:2004.12489, 2020.
  30. A generalization of sampling without replacement from a finite universe. Journal of the American statistical Association, pages 663–685, 1952.
  31. Toward causal inference with interference. Journal of the American Statistical Association, 103(482):832–842, 2012.
  32. Causal inference in statistics, social, and biomedical sciences. Cambridge University Press, 2015.
  33. Adjusting for peer-influence in propensity scoring when estimating treatment effects. Available at SSRN 3522256, 2020.
  34. Designs for estimating the treatment effect in networks with interference. 2020.
  35. Clustered switchback experiments: Near-optimal rates under spatiotemporal interference, 2024.
  36. Experimental design in two-sided platforms: An analysis of bias. Management Science, 68(10):7069–7089, 2022.
  37. Peer encouragement designs in causal inference with partial interference and identification of local average network effects. arXiv preprint arXiv:1609.04464, 2016.
  38. A systematic investigation of classical causal inference strategies under mis-specification due to network interference. arXiv preprint arXiv:1810.08259, 2018.
  39. Trustworthy online controlled experiments: A practical guide to a/b testing. Cambridge University Press, 2020.
  40. Michael P Leung. Treatment and spillover effects under network interference. Review of Economics and Statistics, 102(2):368–380, 2020.
  41. Michael P Leung. Causal inference under approximate neighborhood interference. Econometrica, 90(1):267–293, 2022.
  42. Network interference in micro-randomized trials. arXiv preprint arXiv:2202.05356, 2022a.
  43. Random graph asymptotics for treatment effect estimation under network interference. The Annals of Statistics, 50(4):2334–2358, 2022b.
  44. Large sample randomization inference of causal effects in the presence of interference. Journal of the american statistical association, 109(505):288–301, 2014.
  45. Charles F Manski. Nonparametric bounds on treatment effects. The American Economic Review, 80(2):319–323, 1990.
  46. Charles F Manski. Identification of treatment response with social interactions. The Econometrics Journal, 16(1):S1–S23, 2013.
  47. Spin Glass Theory and Beyond, An Introduction to the Replica Method and Its Applications. World Scientific, Paris, Roma, November 1986. doi: 10.1142/0271.
  48. Information, physics, and computation. Oxford University Press, 2009.
  49. Treatment effects in market equilibrium. arXiv preprint arXiv:2109.11647, 2021.
  50. Efficient treatment effect estimation in observational studies under heterogeneous partial interference. arXiv preprint arXiv:2107.12420, 2021.
  51. Paul R Rosenbaum. Interference between units in randomized experiments. Journal of the american statistical association, 102(477):191–200, 2007.
  52. Twitch gamers: a dataset for evaluating proximity preserving and structural role-based node embeddings, 2021.
  53. Donald B Rubin. Bayesian inference for causal effects: The role of randomization. The Annals of statistics, pages 34–58, 1978.
  54. Average treatment effects in the presence of unknown interference. Annals of statistics, 49(2):673, 2021.
  55. Causal message-passing for experiments with unknown and general network interference. Proceedings of the National Academy of Sciences, 121(40):e2322232121, 2024.
  56. Michael E Sobel. What do randomized studies of housing mobility demonstrate? causal inference in the face of interference. Journal of the American Statistical Association, 101(476):1398–1407, 2006.
  57. Elements of estimation theory for causal effects in the presence of network interference. arXiv preprint arXiv:1702.03578, 2017.
  58. Eric J Tchetgen Tchetgen and Tyler J VanderWeele. On causal inference in the presence of interference. Statistical methods in medical research, 21(1):55–75, 2012.
  59. Randomized graph cluster randomization. Journal of Causal Inference, 11(1):20220014, 2023.
  60. Davide Viviano. Experimental design under network interference. arXiv preprint arXiv:2003.08421, 2020a.
  61. Davide Viviano. Policy design in experiments with unknown interference. arXiv preprint arXiv:2011.08174, 2020b.
  62. Causal clustering: design of cluster experiments under network interference. arXiv preprint arXiv:2310.14983, 2023.
  63. Experimenting in equilibrium. Management Science, 67(11):6694–6715, 2021.
  64. Design-based inference for spatial experiments with interference. arXiv preprint arXiv:2010.13599, 2020.
  65. Optimal experimental design for staggered rollouts. Management Science, 70(8):5317–5336, 2024.
  66. Estimating the total treatment effect in randomized experiments with unknown network structure. Proceedings of the National Academy of Sciences, 119(44):e2208975119, 2022.

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now
X Twitter Logo Streamline Icon: https://streamlinehq.com

Tweets