Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
175 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
42 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Enhancing Peak Assignment in 13C NMR Spectroscopy: A Novel Approach Using Multimodal Alignment (2311.13817v4)

Published 23 Nov 2023 in cs.LG, physics.chem-ph, and q-bio.QM

Abstract: Nuclear magnetic resonance (NMR) spectroscopy plays an essential role in deciphering molecular structure and dynamic behaviors. While AI-enhanced NMR prediction models hold promise, challenges still persist in tasks such as molecular retrieval, isomer recognition, and peak assignment. In response, this paper introduces a novel solution, Multi-Level Multimodal Alignment with Knowledge-Guided Instance-Wise Discrimination (K-M3AID), which establishes correspondences between two heterogeneous modalities: molecular graphs and NMR spectra. K-M3AID employs a dual-coordinated contrastive learning architecture with three key modules: a graph-level alignment module, a node-level alignment module, and a communication channel. Notably, K-M3AID introduces knowledge-guided instance-wise discrimination into contrastive learning within the node-level alignment module. In addition, K-M3AID demonstrates that skills acquired during node-level alignment have a positive impact on graph-level alignment, acknowledging meta-learning as an inherent property. Empirical validation underscores K-M3AID's effectiveness in multiple zero-shot tasks.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (53)
  1. Multimodal deep learning, 2023.
  2. Multimodal machine learning: A survey and taxonomy, 2017.
  3. Review and prospect: deep learning in nuclear magnetic resonance spectroscopy. Chemistry–A European Journal, 26(46):10391–10401, 2020.
  4. Deep cross-modal audio-visual generation. In Proceedings of the on Thematic Workshops of ACM Multimedia 2017, pp.  349–357, 2017.
  5. Recent trends in the structural revision of natural products. Natural product reports, 35(6):514–531, 2018.
  6. Claridge, T. D. High-resolution NMR techniques in organic chemistry, volume 27. Elsevier, 2016.
  7. Dice, L. R. Measures of the amount of ecologic association between species. Ecology, 26(3):297–302, 1945.
  8. Meta-learning as a promising approach for few-shot cross-domain fault diagnosis: Algorithms, applications, and prospects. Knowledge-Based Systems, 235:107646, 2022.
  9. Model-agnostic meta-learning for fast adaptation of deep networks. In International conference on machine learning, pp.  1126–1135. PMLR, 2017.
  10. Analyzing and improving representations with the soft nearest neighbor loss, 2019.
  11. Real-time prediction of 1 h and 13 c chemical shifts with dft accuracy using a 3d graph neural network. Chemical Science, 12(36):12012–12026, 2021.
  12. NMR spectroscopy: basic principles, concepts, and applications in chemistry. John Wiley & Sons Chichester, UK, 1994.
  13. A survey of deep meta-learning. Artificial Intelligence Review, 54(6):4483–4541, 2021.
  14. A review on methods and applications in multimodal deep learning. ACM Transactions on Multimedia Computing, Communications and Applications, 19(2s):1–41, 2023.
  15. A survey on contrastive self-supervised learning. Technologies, 9(1), 2021. ISSN 2227-7080. doi: 10.3390/technologies9010002. URL https://www.mdpi.com/2227-7080/9/1/2.
  16. Prediction of chemical shift in nmr: A review. Magnetic Resonance in Chemistry, 60(11):1021–1031, 2022.
  17. Deep visual-semantic alignments for generating image descriptions. In Proceedings of the IEEE conference on computer vision and pattern recognition, pp.  3128–3137, 2015.
  18. Pubchem 2023 update. Nucleic acids research, 51(D1):D1373–D1380, 2023.
  19. Kuhn, S. Applications of machine learning and artificial intelligence in nmr, 2022.
  20. Building machines that learn and think like people. Behavioral and brain sciences, 40:e253, 2017.
  21. Contrastive representation learning: A framework and review. IEEE Access, 8:193907–193934, 2020a. doi: 10.1109/ACCESS.2020.3031549.
  22. Contrastive representation learning: A framework and review. Ieee Access, 8:193907–193934, 2020b.
  23. Unimo: Towards unified-modal understanding and generation via cross-modal contrastive learning. arXiv preprint arXiv:2012.15409, 2020.
  24. Supervision exists everywhere: A data efficient contrastive language-image pre-training paradigm. arXiv preprint arXiv:2110.05208, 2021.
  25. Cross-modal generalization: Learning in low resource modalities via meta-alignment. In Proceedings of the 29th ACM International Conference on Multimedia, New York, NY, USA, 2021. Association for Computing Machinery. ISBN 9781450386517. doi: 10.1145/3474085.3475247. URL https://doi.org/10.1145/3474085.3475247.
  26. Foundations and trends in multimodal machine learning: Principles, challenges, and open questions, 2023.
  27. Self-supervised learning: Generative or contrastive. IEEE transactions on knowledge and data engineering, 35(1):857–876, 2021.
  28. Self-supervised learning: Generative or contrastive. IEEE Transactions on Knowledge and Data Engineering, 35(1):857–876, 2023. doi: 10.1109/TKDE.2021.3090866.
  29. Multimodality in meta-learning: A comprehensive survey. Knowledge-Based Systems, 250:108976, 2022.
  30. Audio-visual instance discrimination with cross-modal agreement. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp.  12475–12486, 2021.
  31. Chasing molecules that were never there: misassigned natural products and the role of chemical synthesis in modern structure elucidation. Angewandte Chemie International Edition, 44(7):1012–1044, 2005.
  32. Learning transferable visual models from natural language supervision. In International conference on machine learning, pp.  8748–8763. PMLR, 2021.
  33. Russel, J. A. A circumplex model of affect. Journal of Personality and Social Psychology, 39(6):1161–1178, 1980.
  34. Learning a nonlinear embedding by preserving class neighbourhood structure. In Meila, M. and Shen, X. (eds.), Proceedings of the Eleventh International Conference on Artificial Intelligence and Statistics, volume 2 of Proceedings of Machine Learning Research, pp.  412–419, San Juan, Puerto Rico, 21–24 Mar 2007. PMLR. URL https://proceedings.mlr.press/v2/salakhutdinov07a.html.
  35. Introduction to Modern Information Retrieval. McGraw-Hill, Inc., 1986.
  36. Towards a universal neural network encoder for time series. In CCIA, pp.  120–129, 2018.
  37. Principles of Numerical Taxonomy. W. H. Freeman and Company, 1963.
  38. Nmrshiftdb constructing a free chemical information system with open-source components. Journal of chemical information and computer sciences, 43(6):1733–1739, 2003.
  39. Recent advances and trends in multimodal deep learning: A review, 2021.
  40. Tanimoto, T. T. An elementary mathematical theory of classification and prediction. Internal Report 17, IBM, 1957.
  41. Representation learning with contrastive predictive coding, 2019.
  42. Vanschoren, J. Meta-learning: A survey. arXiv preprint arXiv:1810.03548, 2018.
  43. Advances and challenges in meta-learning: A technical review. arXiv preprint arXiv:2307.04722, 2023.
  44. A perspective view and survey of meta-learning. Artificial intelligence review, 18:77–95, 2002.
  45. Elucidating structures of complex organic compounds using a machine learning model based on the 13c nmr chemical shifts. Precision Chemistry, 1(1):57–68, 2023.
  46. Graph neural networks in recommender systems: a survey. ACM Computing Surveys, 55(5):1–37, 2022.
  47. Unsupervised feature learning via non-parametric instance discrimination. In Proceedings of the IEEE conference on computer vision and pattern recognition, pp.  3733–3742, 2018.
  48. How powerful are graph neural networks? arXiv preprint arXiv:1810.00826, 2018.
  49. Cross-view semantic alignment for livestreaming product recognition, 2023.
  50. Cross-modal retrieval between 13c nmr spectra and structures for compound identification using deep contrastive learning. Analytical Chemistry, 93(50):16947–16955, 2021.
  51. Recent applications of benchtop nuclear magnetic resonance spectroscopy. Magnetochemistry, 7(9):121, 2021.
  52. Cross-modal contrastive learning for text-to-image generation. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp.  833–842, 2021.
  53. Crossclr: Cross-modal contrastive learning for multi-modal video representations. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pp.  1450–1459, 2021.
Citations (1)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now
X Twitter Logo Streamline Icon: https://streamlinehq.com

Tweets