Papers
Topics
Authors
Recent
Assistant
AI Research Assistant
Well-researched responses based on relevant abstracts and paper content.
Custom Instructions Pro
Preferences or requirements that you'd like Emergent Mind to consider when generating responses.
Gemini 2.5 Flash
Gemini 2.5 Flash 69 tok/s
Gemini 2.5 Pro 52 tok/s Pro
GPT-5 Medium 28 tok/s Pro
GPT-5 High 28 tok/s Pro
GPT-4o 75 tok/s Pro
Kimi K2 191 tok/s Pro
GPT OSS 120B 402 tok/s Pro
Claude Sonnet 4.5 34 tok/s Pro
2000 character limit reached

A Dynamical View of the Question of Why (2402.10240v2)

Published 14 Feb 2024 in cs.LG, cs.AI, cs.SY, and eess.SY

Abstract: We address causal reasoning in multivariate time series data generated by stochastic processes. Existing approaches are largely restricted to static settings, ignoring the continuity and emission of variations across time. In contrast, we propose a learning paradigm that directly establishes causation between events in the course of time. We present two key lemmas to compute causal contributions and frame them as reinforcement learning problems. Our approach offers formal and computational tools for uncovering and quantifying causal relationships in diffusion processes, subsuming various important settings such as discrete-time Markov decision processes. Finally, in fairly intricate experiments and through sheer learning, our framework reveals and quantifies causal links, which otherwise seem inexplicable.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (63)
  1. David Lewis. Causation. J. Philos., 70(17):556–567, October 1973.
  2. David Lewis. Counterfactual dependence and time’s arrow. Noûs, 13(4):455–476, 1979.
  3. David Lewis. Postscripts to causation. In David Lewis, editor, Philosophical Papers Vol. Ii. Oxford University Press, 1986.
  4. David Lewis. Causation as influence. J. Philos., 97(4):182–197, 2000.
  5. Wesley C Salmon. Scientific explanation and the causal structure of the world. Princeton University Press, 1984.
  6. Phil Dowe. Physical causation. 2000.
  7. Causation, prediction, and search. MIT press, 2000.
  8. Judea Pearl et al. Models, reasoning and inference. Cambridge, UK: CambridgeUniversityPress, 19(2), 2000.
  9. JY Halpern and J Pearl. Causes and explanations: Part 1: Causes. In UAI, 2001.
  10. Causes and explanations: A structural-model approach. part ii: Explanations. The British journal for the philosophy of science, 2005.
  11. Nancy Cartwright. Hunting causes and using them: Approaches in philosophy and economics. Cambridge University Press, 2007.
  12. A Philip Dawid. Causal inference without counterfactuals. Journal of the American statistical Association, 95(450):407–424, 2000.
  13. Causality: Statistical perspectives and applications. John Wiley & Sons, 2012.
  14. Peter Spirtes. An anytime algorithm for causal inference. In International Workshop on Artificial Intelligence and Statistics, pages 278–285. PMLR, 2001.
  15. David Fair. Causation and the flow of energy. Erkenntnis, 14(3):219–250, 1979.
  16. Max Kistler. Causation and laws of nature. Taylor & Francis, 2007.
  17. Christopher Read Hitchcock. Discussion: Salmon on explanatory relevance. Philosophy of Science, 62(2):304–320, 1995.
  18. A dynamical systems approach to causation. Synthese, 198:6065–6087, 2021.
  19. R E Kalman. On the general theory of control systems. IFAC Proceedings Volumes, 1(1):491–502, August 1960.
  20. A Second Course in Stochastic Processes. Academic Press, New York, 1981.
  21. Nancy L. Stokey. The Economics of Inaction: Stochastic Control Models with Fixed Costs. Princeton University Press, 2009. ISBN 9780691135052. URL http://www.jstor.org/stable/j.ctt7sfgq.
  22. J. Dmitri Gallow. The Metaphysics of Causation. In Edward N. Zalta and Uri Nodelman, editors, The Stanford Encyclopedia of Philosophy. Metaphysics Research Lab, Stanford University, Fall 2022 edition, 2022.
  23. Medical dead-ends and learning to identify High-Risk states and treatments. In M Ranzato, A Beygelzimer, Y Dauphin, P S Liang, and J Wortman Vaughan, editors, Advances in Neural Information Processing Systems, volume 34, pages 4856–4870. Curran Associates, Inc., 2021.
  24. L A Paul. Keeping track of the time: Emending the counterfactual analysis of causation. Analysis, 58(3):191–198, July 1998.
  25. Probabilistic graphical models: principles and techniques. MIT press, 2009.
  26. Causal models for dynamical systems. In Probabilistic and Causal Inference: The Works of Judea Pearl, pages 671–690. 2022.
  27. Causal interpretation of stochastic differential equations. 2014.
  28. The arcade learning environment: An evaluation platform for general agents. Journal of Artificial Intelligence Research, 47:253–279, jun 2013.
  29. Human-level control through deep reinforcement learning. Nature, 518(7540):529–533, February 2015.
  30. In silico preclinical trials: a proof of concept in closed-loop control of type 1 diabetes, 2009.
  31. Judea Pearl. Probabilities of causation: three counterfactual interpretations and their identification. In Probabilistic and Causal Inference: The Works of Judea Pearl, pages 317–372. 2022.
  32. Probabilities of causation: Bounds and identification. Annals of Mathematics and Artificial Intelligence, 28(1-4):287–313, 2000.
  33. The probability of causation. Law, Probability and Risk, 16(4):163–179, 2017.
  34. Causes of effects: Learning individual responses from population data. arXiv preprint arXiv:2104.13730, 2021.
  35. Sander Beckers. Causal sufficiency and actual causation. Journal of Philosophical Logic, 50(6):1341–1374, 2021.
  36. A principled approach to defining actual causation. Synthese, 195(2):835–862, 2018.
  37. Joseph Y Halpern. A modification of the halpern-pearl definition of causality. arXiv preprint arXiv:1505.00162, 2015.
  38. Brad Weslake. A partial theory of actual causation. British Journal for the Philosophy of Science, 2015.
  39. Christopher Hitchcock. The intransitivity of causation revealed in equations and graphs. The Journal of Philosophy, 98(6):273–299, 2001.
  40. Christopher Hitchcock. Prevention, preemption, and the principle of sufficient reason. The Philosophical Review, 116(4):495–532, 2007.
  41. Clive WJ Granger. Investigating causal relations by econometric models and cross-spectral methods. Econometrica: journal of the Econometric Society, pages 424–438, 1969.
  42. Granger causality and dynamic structural systems. Journal of Financial Econometrics, 8(2):193–243, 2010.
  43. Causal inference on time series using restricted structural equation models. Advances in neural information processing systems, 26, 2013.
  44. Invariant causal prediction for sequential data. Journal of the American Statistical Association, 114(527):1264–1276, 2019.
  45. Causal reasoning in graphical time series models. arXiv preprint arXiv:1206.5246, 2012.
  46. Causal discovery from heterogeneous/nonstationary data. The Journal of Machine Learning Research, 21(1):3482–3534, 2020.
  47. From ordinary differential equations to structural causal models: the deterministic case. arXiv preprint arXiv:1304.7920, 2013.
  48. Generalized structural causal models. arXiv preprint arXiv:1805.06539, 2018.
  49. Causal modeling of dynamical systems. arXiv preprint arXiv:1803.08784, 2018.
  50. From deterministic odes to dynamic structural causal models. arXiv preprint arXiv:1608.08028, 2016.
  51. Judea Pearl. Causality: models, reasoning, and inference, 1980.
  52. Joseph Y Halpern. Actual causality. MiT Press, 2016.
  53. Making things happen: A theory of causal explanation. Oxford university press, 2005.
  54. L. Ljung. System Identification: Theory for the User. Bibliyografya ve İndeks. Prentice-Hall, 1987. ISBN 9780138816407. URL https://books.google.ca/books?id=-_hQAAAAMAAJ.
  55. S. Skogestad and I. Postlethwaite. Multivariable Feedback Control: Analysis and Design. Wiley, 2005. ISBN 9780470011676. URL https://books.google.ca/books?id=97iAEAAAQBAJ.
  56. Dead-ends and secure exploration in reinforcement learning. In Kamalika Chaudhuri and Ruslan Salakhutdinov, editors, Proceedings of the 36th International Conference on Machine Learning, volume 97 of Proceedings of Machine Learning Research, pages 1873–1881, Long Beach, California, USA, 2019. PMLR.
  57. A distributional perspective on reinforcement learning. In Doina Precup and Yee Whye Teh, editors, Proceedings of the 34th International Conference on Machine Learning, volume 70 of Proceedings of Machine Learning Research, pages 449–458, International Convention Centre, Sydney, Australia, 2017. PMLR.
  58. Between mdps and semi-mdps: A framework for temporal abstraction in reinforcement learning. Artificial Intelligence, 112(1):181–211, 1999. ISSN 0004-3702.
  59. Semi-Markov offline reinforcement learning for healthcare. In Gerardo Flores, George H Chen, Tom Pollard, Joyce C Ho, and Tristan Naumann, editors, Proceedings of the Conference on Health, Inference, and Learning, volume 174 of Proceedings of Machine Learning Research, pages 119–137. PMLR, 2022.
  60. Systematic rectification of language models via dead-end analysis. In The Eleventh International Conference on Learning Representations, 2023.
  61. The uva/padova type 1 diabetes simulator: new features. Journal of diabetes science and technology, 8(1):26–34, 2014.
  62. The uva/padova type 1 diabetes simulator goes from single meal to single day. Journal of diabetes science and technology, 12(2):273–281, 2018.
  63. Prioritized experience replay. arXiv preprint arXiv:1511.05952, 2015.

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now
Lightbulb Streamline Icon: https://streamlinehq.com

Continue Learning

We haven't generated follow-up questions for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Generate Now
List To Do Tasks Checklist Streamline Icon: https://streamlinehq.com

Collections

Sign up for free to add this paper to one or more collections.

User Circle Single Streamline Icon: https://streamlinehq.com Sign Up
X Twitter Logo Streamline Icon: https://streamlinehq.com

Tweets

This paper has been mentioned in 4 posts and received 4 likes.

User Circle Single Streamline Icon: https://streamlinehq.com Sign Up to View