Active Causal Learning for Decoding Chemical Complexities with Targeted Interventions (2404.04224v1)
Abstract: Predicting and enhancing inherent properties based on molecular structures is paramount to design tasks in medicine, materials science, and environmental management. Most of the current machine learning and deep learning approaches have become standard for predictions, but they face challenges when applied across different datasets due to reliance on correlations between molecular representation and target properties. These approaches typically depend on large datasets to capture the diversity within the chemical space, facilitating a more accurate approximation, interpolation, or extrapolation of the chemical behavior of molecules. In our research, we introduce an active learning approach that discerns underlying cause-effect relationships through strategic sampling with the use of a graph loss function. This method identifies the smallest subset of the dataset capable of encoding the most information representative of a much larger chemical space. The identified causal relations are then leveraged to conduct systematic interventions, optimizing the design task within a chemical space that the models have not encountered previously. While our implementation focused on the QM9 quantum-chemical dataset for a specific design task-finding molecules with a large dipole moment-our active causal learning approach, driven by intelligent sampling and interventions, holds potential for broader applications in molecular, materials design and discovery.
- PubChem: a public information system for analyzing bioactivities of small molecules.
- ZINC20—A Free Ultralarge-Scale Chemical Database for Ligand Discovery. Journal of Chemical Information and Modeling, 60(12):6065–6073, December 2020. Publisher: American Chemical Society.
- ChEMBL: a large-scale bioactivity database for drug discovery. Nucleic Acids Research, 40(Database issue):D1100–D1107, January 2012.
- Enumeration of 166 Billion Organic Small Molecules in the Chemical Universe Database GDB-17. Journal of Chemical Information and Modeling, 52(11):2864–2875, November 2012. Publisher: American Chemical Society.
- Pairwise likelihood ratios for estimation of non-gaussian structural equation models. The Journal of Machine Learning Research, 14(1):111–152, 2013.
- The ANI-1ccx and ANI-1x data sets, coupled-cluster and density functional theory properties for molecules. Scientific Data, 7(1):134, May 2020. Number: 1 Publisher: Nature Publishing Group.
- QM7-X, a comprehensive dataset of quantum-mechanical properties spanning the chemical space of small organic molecules. Scientific Data, 8(1):43, February 2021. Number: 1 Publisher: Nature Publishing Group.
- A review on machine learning approaches and trends in drug discovery. Computational and Structural Biotechnology Journal, 19:4538–4558, January 2021.
- Application of Combinatorial Chemistry Science on Modern Drug Discovery. Journal of Combinatorial Chemistry, 10(3):345–354, May 2008. Publisher: American Chemical Society.
- Molecular representations in AI-driven drug discovery: a review and practical guide. Journal of Cheminformatics, 12(1):56, September 2020.
- QSAR without borders. Chemical Society Reviews, 49(11):3525–3564, June 2020. Publisher: The Royal Society of Chemistry.
- A Deep Learning Approach to Antibiotic Discovery. Cell, 180(4):688–702.e13, February 2020.
- Machine Learning for Catalysis Informatics: Recent Applications and Prospects. ACS Catalysis, 10(3):2260–2297, February 2020. Publisher: American Chemical Society.
- Machine Learning in Catalysis, From Proposal to Practicing. ACS Omega, 5(1):83–88, January 2020. Publisher: American Chemical Society.
- Machine learning–assisted molecular design and efficiency prediction for high-performance organic photovoltaic materials. Science Advances, 5(11):eaay4275, November 2019. Publisher: American Association for the Advancement of Science.
- R. et al. Gómez-Bombarelli. Design of efficient molecular organic light- emitting diodes by a high-throughput virtual screening and experimental approach. Nature Materials, 15, 2016.
- Computational design of molecules for an all-quinone redox flow battery. Chemical Science, 6(2):885–893, January 2015. Publisher: The Royal Society of Chemistry.
- R. P. Sheridan. The relative importance of domain applicability metrics for estimating prediction errors in qsar varies with training set diversity. J. Chem. Inf. Model, pages 1098–1107, 2015.
- Dennis P Trujillo Monirul Shaikh Saurabh Ghosh Ayana Ghosh, Gayathri Palanichamy. Insights into cation ordering of double perovskite oxides from machine learning and causal relations. Chemistry of Materials, 34(16):7563–7578, 2022.
- Rama Vasudevan Maxim Ziatdinov Sergei V Kalinin, Ayana Ghosh. From atomically resolved imaging to generative and causal models. Nature Physics, 18(10):1152–1160, 2022.
- Xiaohang Zhang Rama K. Vasudevan Eugene Eliseev Anna N. Morozovska Ichiro Takeuchi Sergei V. Kalinin Maxim Ziatdinov, Christopher T. Nelson. Causal analysis of competing atomistic mechanisms in ferroelectric materials from high-resolution scanning transmission electron microscopy data. npj Computational Materials, 6(127), 2020.
- Exploring causal physical mechanisms via non-gaussian linear models and deep kernel learning: Applications for ferroelectric domain structures. ACS nano, 16(1):9, 2021.
- Sookyung Kim Anna Hiszpanski T. Yong-Jin Han Bhavya Kailkhura, Brian Gallagher. Reliable and explainable machine-learning methods for accelerated material discovery. npj Computational Materials, 5, 2019.
- Tonio Buonassisi Felipe Oviedo, Juan Lavista Ferres and Keith T. Butler. Interpretable and explainable machine learning for materials science and chemistry. Acc. Mater. Res., 3(6):597–607, 2022.
- Francesca Grisoni José Jiménez-Luna and Gisbert Schneider. Drug discovery with explainable artificial intelligence. Nature Machine Intelligence, 2:573–584, 2020.
- Shusen Liu Bhavya Kailkhura Anna Hiszpanski T. Yong-Jin Han Xiaoting Zhong, Brian Gallagher. Explainable machine learning in materials science. npj Computational Materials, 8, 2022.
- S Kotsiantis P Linardatos, V Papastefanopoulos. Explainable ai: A review of machine learning interpretability methods. Entropy, 23(1), 2020.
- A perspective on explanations of molecular prediction models. Journal of Chemical Theory and Computation, 19(8):2149–2160, 2023.
- Model agnostic generation of counterfactual explanations for molecules. Chemical science, 13(13):3697–3705, 2022.
- Discovery of structure-property relations for molecules via hypothesis-driven active learning over the chemical space, May 2023. arXiv:2301.02665 [cs, q-bio].
- A linear non-gaussian acyclic model for causal discovery. Journal of Machine Learning Research, 7(10), 2006.
- Kenneth A Bollen. Structural equations with latent variables, volume 210. John Wiley & Sons, 1989.
- Heterogeneous uncertainty sampling for supervised learning. In Machine learning proceedings 1994, pages 148–156. Elsevier, 1994.
- Pedro M. Ferreira. Unsupervised entropy-based selection of data sets for improved model fitting. pages 3330–3337, July 2016. ISSN: 2161-4407.
- Deep batch active learning by diverse, uncertain gradient lower bounds. arXiv preprint arXiv:1906.03671, 2019.
- Two optimal strategies for active learning of causal models from interventional data. International Journal of Approximate Reasoning, 55(4):926–939, 2014.
- Active learning of causal networks with intervention experiments and optimal designs. Journal of Machine Learning Research, 9(Nov):2523–2547, 2008.
- Reconstructing causal biological networks through active learning. PloS one, 11(3):e0150611, 2016.
- Metrics for graph comparison: a practitioner’s guide. Plos one, 15(2):e0228728, 2020.
- Extended-Connectivity Fingerprints. Journal of Chemical Information and Modeling, 50(5):742–754, May 2010. Publisher: American Chemical Society.
- Vladimir Isaakovich Minkin. Dipole moments in organic chemistry. Springer Science & Business Media, 2012.
- Use of dipole moment as a parameter in drug–receptor interaction and quantitative structure–activity relationship studies. Journal of pharmaceutical sciences, 71(6):641–655, 1982.
- Scalable fragment-based 3d molecular design with reinforcement learning. arXiv preprint arXiv:2202.00658, 2022.
- A deep generative model for molecule optimization via one fragment modification. Nature machine intelligence, 3(12):1040–1049, 2021.
- A pharmacophore-guided deep learning approach for bioactive molecular generation. Nature Communications, 14(1):6234, 2023.
- Scaffold-based molecular design with a graph generative model. Chemical science, 11(4):1153–1164, 2020.
- De novo molecular design and generative models. Drug Discovery Today, 26(11):2707–2715, 2021.
- Guided diffusion for inverse molecular design. Nature Computational Science, 3(10):873–882, 2023.
- Florbela Pereira and João Aires-de Sousa. Machine learning for the prediction of molecular dipole moments obtained by density functional theory. Journal of cheminformatics, 10:1–11, 2018.
- Zachary R. Fox (2 papers)
- Ayana Ghosh (27 papers)