2000 character limit reached
Multi-modal Deep Learning (2403.03385v1)
Published 6 Mar 2024 in eess.IV, cs.AI, and cs.CV
Abstract: This article investigates deep learning methodologies for single-modality clinical data analysis, as a crucial precursor to multi-modal medical research. Building on Guo JingYuan's work, the study refines clinical data processing through Compact Convolutional Transformer (CCT), Patch Up, and the innovative CamCenterLoss technique, establishing a foundation for future multimodal investigations. The proposed methodology demonstrates improved prediction accuracy and at tentiveness to critically ill patients compared to Guo JingYuan's ResNet and StageNet approaches. Novelty that using image-pretrained vision transformer backbone to perform transfer learning time-series clinical data.The study highlights the potential of CCT, Patch Up, and novel CamCenterLoss in processing single modality clinical data within deep learning frameworks, paving the way for future multimodal medical research and promoting precision and personalized healthcare
- Stroke epidemiology: a review of population-based studies of incidence, prevalence, and case-fatality in the late 20th century. The lancet neurology, 2(1):43–53, 2003.
- Intracerebral haemorrhage: current approaches to acute management. The Lancet, 392(10154):1257–1268, 2018.
- Incidence, case fatality, and functional outcome of intracerebral haemorrhage over time, according to age, sex, and ethnic origin: a systematic review and meta-analysis. The Lancet Neurology, 9(2):167–176, 2010.
- High stroke incidence in the prospective community-based l’aquila registry (1994–1998) first year’s results. Stroke, 28(12):2500–2506, 1997.
- Using machine learning to improve the prediction of functional outcome in ischemic stroke patients. IEEE/ACM transactions on computational biology and bioinformatics, 15(6):1953–1959, 2018.
- Mortality prediction in cerebral hemorrhage patients using machine learning algorithms in intensive care units. Frontiers in Neurology, 11:610531, 2021.
- Estimation of equivalent circuit parameters of single-phase transformer by using chaotic optimization approach. Energies, 12(9):1697, 2019.
- Zvs analysis of a gan-based series-parallel dual transformer llc resonant converter. In 2019 IEEE 7th Workshop on Wide Bandgap Power Devices and Applications (WiPDA), pages 398–404, 2019.
- Data-driven risk analysis of joint electric vehicle and solar operation in distribution networks. IEEE Open Access Journal of Power and Energy, 7:141–150, 2020.
- Scaling end-to-end models for large-scale multilingual asr. In 2021 IEEE Automatic Speech Recognition and Understanding Workshop (ASRU), pages 1011–1018. IEEE, 2021.
- Vision transformer for covid-19 cxr diagnosis using chest x-ray feature corpus, 2021.
- Covid-vit: Classification of covid-19 from ct chest images based on vision transformer models, 2021.
- Multi-domain integrative swin transformer network for sparse-view tomographic reconstruction. Patterns, 3(6):100498, 2022.
- Task-oriented multi-user semantic communications. IEEE Journal on Selected Areas in Communications, 40(9):2584–2597, 2022.
- Transformer fault diagnosis method based on ifcm-dnn adjudication network. In International Conference on Intelligent Traffic Systems and Smart City (ITSSC 2021), volume 12165, pages 640–652. SPIE, 2022.
- Lightning caused overvoltages on power transformers recorded by on-line transient overvoltage monitoring system. Journal of Energy: Energija, 67(2):0–0, 2018.
- Multitask learning and benchmarking with clinical time series data. Scientific data, 6(1):96, 2019.
- Stagenet: Stage-aware neural networks for health risk prediction. In Yennun Huang, Irwin King, Tie-Yan Liu, and Maarten van Steen, editors, WWW ’20: The Web Conference 2020, Taipei, Taiwan, April 20-24, 2020, pages 530–540. ACM / IW3C2, 2020.
- JingYuan Guo. Deep learning for analysing brain medical data. Master’s thesis, National University of Singapore, 2022.
- Escaping the big data paradigm with compact transformers. ArXiv preprint, abs/2104.05704, 2021.
- An image is worth 16x16 words: Transformers for image recognition at scale. In 9th International Conference on Learning Representations, ICLR 2021, Virtual Event, Austria, May 3-7, 2021. OpenReview.net, 2021.
- Patchup: A regularization technique for convolutional neural networks. ArXiv preprint, abs/2006.07794, 2020.
- Grad-cam: Visual explanations from deep networks via gradient-based localization. In IEEE International Conference on Computer Vision, ICCV 2017, Venice, Italy, October 22-29, 2017, pages 618–626. IEEE Computer Society, 2017.
- Attention is all you need. In Isabelle Guyon, Ulrike von Luxburg, Samy Bengio, Hanna M. Wallach, Rob Fergus, S. V. N. Vishwanathan, and Roman Garnett, editors, Advances in Neural Information Processing Systems 30: Annual Conference on Neural Information Processing Systems 2017, December 4-9, 2017, Long Beach, CA, USA, pages 5998–6008, 2017.
- Tabtransformer: Tabular data modeling using contextual embeddings. ArXiv preprint, abs/2012.06678, 2020.
- Revisiting deep learning models for tabular data. In Marc’Aurelio Ranzato, Alina Beygelzimer, Yann N. Dauphin, Percy Liang, and Jennifer Wortman Vaughan, editors, Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, NeurIPS 2021, December 6-14, 2021, virtual, pages 18932–18943, 2021.
- Is it time to replace cnns with transformers for medical images? ArXiv preprint, abs/2108.09038, 2021.
- mixup: Beyond empirical risk minimization. In 6th International Conference on Learning Representations, ICLR 2018, Vancouver, BC, Canada, April 30 - May 3, 2018, Conference Track Proceedings. OpenReview.net, 2018.
- Manifold mixup: Better representations by interpolating hidden states. In International conference on machine learning, pages 6438–6447. PMLR, 2019.
Sponsor
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.
