Papers
Topics
Authors
Recent
Detailed Answer
Quick Answer
Concise responses based on abstracts only
Detailed Answer
Well-researched responses based on abstracts and relevant paper content.
Custom Instructions Pro
Preferences or requirements that you'd like Emergent Mind to consider when generating responses
Gemini 2.5 Flash
Gemini 2.5 Flash 34 tok/s
Gemini 2.5 Pro 49 tok/s Pro
GPT-5 Medium 27 tok/s Pro
GPT-5 High 30 tok/s Pro
GPT-4o 80 tok/s Pro
Kimi K2 198 tok/s Pro
GPT OSS 120B 461 tok/s Pro
Claude Sonnet 4 38 tok/s Pro
2000 character limit reached

Optimal Survival Trees: A Dynamic Programming Approach (2401.04489v1)

Published 9 Jan 2024 in cs.LG, cs.AI, and cs.DS

Abstract: Survival analysis studies and predicts the time of death, or other singular unrepeated events, based on historical data, while the true time of death for some instances is unknown. Survival trees enable the discovery of complex nonlinear relations in a compact human comprehensible model, by recursively splitting the population and predicting a distinct survival distribution in each leaf node. We use dynamic programming to provide the first survival tree method with optimality guarantees, enabling the assessment of the optimality gap of heuristics. We improve the scalability of our method through a special algorithm for computing trees up to depth two. The experiments show that our method's run time even outperforms some heuristics for realistic cases while obtaining similar out-of-sample performance with the state-of-the-art.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (55)
  1. Aalen, O. 1978. Nonparametric Inference for a Family of Counting Processes. The Annals of Statistics, 6(4): 701–726.
  2. Strong Optimal Classification Trees. arXiv preprint arXiv:2103.15965.
  3. Learning Optimal Decision Trees Using Caching Branch-and-Bound Search. In Proceedings of AAAI-20, 3146–3153.
  4. PyDL8.5: a Library for Learning Optimal Decision Trees. In Proceedings of IJCAI-20, 5222–5224.
  5. Optimal classification trees. Machine Learning, 106(7): 1039–1082.
  6. Machine Learning Under a Modern Optimization Lens. Belmont, MA: Dynamic Ideas.
  7. Optimal Survival Trees. Machine Learning, 111(8): 2951–3023.
  8. Classification and Regression Trees. Monterey, CA: Wadsworth and Brooks.
  9. Brier, G. W. 1950. Verification of Forecasts Expressed in Terms of Probability. Monthly Weather Review, 78(1): 1–3.
  10. Mathematical optimization in classification and regression trees. TOP: An Official Journal of the Spanish Society of Statistics and Operations Research, 29(1): 5–33.
  11. Quantifying migratory delay: a new application of survival analysis methods. Canadian Journal of Fisheries and Aquatic Sciences, 60(8): 986–996.
  12. Application of Artificial Neural Network-Based Survival Analysis on Two Breast Cancer Datasets. In Proceedings of the annual AMIA Symposium, 130–134.
  13. Survival Analysis: A Survey. Journal of Quantitative Criminology, 7: 59–98.
  14. Stratification by stepwise regression, correspondence analysis and recursive partition: a comparison of three methods of analysis for survival data with covariates. Computational Statistics & Data Analysis, 4(3): 185–204.
  15. Cox, D. R. 1972. Regression Models and Life-Tables. Journal of the Royal Statistical Society: Series B (Methodological), 34(2): 187–202.
  16. Exponential survival trees. Statistics in Medicine, 8(8): 947–961.
  17. MurTree: Optimal Classification Trees via Dynamic Programming and Search. Journal of Machine Learning Research, 23(26): 1–47.
  18. Drysdale, E. 2022. SurvSet: An open-source time-to-event dataset repository. arXiv preprint arXiv:2203.03094.
  19. Dunn, J. W. 2018. Optimal Trees for Prediction and Prescription. Ph.D. thesis, Massachusetts Institute of Technology.
  20. Basic Statistics: A Primer for the Biomedical Sciences. Hoboken, NJ: John Wiley & Sons.
  21. Internal migration and fertility in Turkey: Kaplan-Meier survival analysis. International Journal of Population Research, 2012.
  22. Freitas, A. A. 2014. Comprehensible Classification Models – a position paper. ACM SIGKDD Explorations Newsletter, 15(1): 1–10.
  23. Tree-Structured Survival Analysis. Cancer Treatment Reports, 69(10): 1065–1069.
  24. Assessment and comparison of prognostic classification schemes for survival data. Statistics in Medicine, 18(17-18): 2529–2545.
  25. Evaluating the Yield of Medical Tests. Jama, 247(18): 2543–2546.
  26. Unbiased Recursive Partitioning: A Conditional Inference Framework. Journal of Computational and Graphical Statistics, 15(3): 651–674.
  27. Learning Optimal Decision Trees with MaxSAT and its Integration in AdaBoost. In IJCAI-PRICAI 2020.
  28. Optimal Sparse Decision Trees. In Advances in NeurIPS-19, 7267–7275.
  29. Constructing optimal binary decision trees is NP-complete. Information processing letters, 5(1): 15–17.
  30. Random Survival Forests. The Annals of Applied Statistics, 2(3): 841–860.
  31. SAT-Based Encodings for Optimal Decision Trees with Explicit Paths. In Proceedings of the International Conference on Theory and Applications of Satisfiability Testing (SAT 2020), 501–518.
  32. Nonparametric Estimation from Incomplete Observations. Journal of the American Statistical Association, 53(282): 457–481.
  33. Relative Risk Trees for Censored Survival Data. Biometrics, 48(2): 411–425.
  34. Survival Trees by Goodness of Split. Journal of the American Statistical Association, 88(422): 457–467.
  35. Generalized and Scalable Optimal Sparse Decision Trees. In Proceedings of ICML-20, 6150–6160.
  36. Necessary and Sufficient Conditions for Optimal Decision Trees using Dynamic Programming. In Advances in NeurIPS-23.
  37. Tree-based multivariate regression and density estimation with right-censored data. Journal of Multivariate Analysis, 90(1): 154–177.
  38. Learning Optimal Decision Trees with SAT. In Proceedings of IJCAI-18, 1362–1368.
  39. Nelson, W. 1972. Theory and Applications of Hazard Plotting for Censored Failure Data. Technometrics, 14(4): 945–966.
  40. Mining Optimal Decision Trees from Itemset Lattices. In Proceedings of SIGKDD-07, 530–539.
  41. Optimal constraint-based decision tree induction from itemset lattices. Data Mining and Knowledge Discovery, 21(1): 9–51.
  42. What makes classification trees comprehensible? Expert Systems with Applications, 62: 333–346.
  43. Quinlan, J. R. 1993. C4.5: Programs for Machine Learning. San Francisco, CA: Morgan Kaufmann Publishers Inc.
  44. Rudin, C. 2019. Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead. Nature Machine Intelligence, 1(5): 206–215.
  45. Segal, M. R. 1988. Regression Trees for Censored Data. Biometrics, 44(1): 35–47.
  46. Selvin, S. 2008. Survival Analysis for Epidemiologic and Medical Research. Cambridge: Cambridge University Press.
  47. SAT-Based Approach for Learning Optimal Decision Trees with Non-Binary Features. In Proceedings of the International Conference on Principles and Practice of Constraint Programming (CP 2021).
  48. Multivariate Survival Trees: A Maximum Likelihood Approach Based on Frailty Models. Biometrics, 60(1): 93–99.
  49. Martingale-based residuals for survival models. Biometrika, 77(1): 147–160.
  50. Support vector methods for survival analysis: a comparison between ranking and regression approaches. Artificial Intelligence in Medicine, 53(2): 107–118.
  51. Learning Optimal Decision Trees using Constraint Programming. Constraints, 25(3): 226–250.
  52. Learning decision trees with flexible constraints and objectives using integer optimization. In Proceedings of CPAIOR-17, 94–103.
  53. Learning Optimal Classification Trees Using a Binary Linear Program Formulation. In Proceedings of AAAI-19, 1625–1632.
  54. Machine Learning for Survival Analysis: A Survey. ACM Computing Surveys (CSUR), 51(6): 1–36.
  55. A Scalable MIP-based Method for Learning Optimal Multivariate Decision Trees. In Advances in NeurIPS-20, 1771–1781.
Citations (4)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now
List To Do Tasks Checklist Streamline Icon: https://streamlinehq.com

Collections

Sign up for free to add this paper to one or more collections.

User Circle Single Streamline Icon: https://streamlinehq.com Sign Up
Dice Question Streamline Icon: https://streamlinehq.com

Follow-Up Questions

We haven't generated follow-up questions for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Generate Now
X Twitter Logo Streamline Icon: https://streamlinehq.com

Tweets

Don't miss out on important new AI/ML research

See which papers are being discussed right now on X, Reddit, and more:

Explore Trending Papers

“Emergent Mind helps me see which AI papers have caught fire online.”

Philip

Philip

Creator, AI Explained on YouTube