Papers
Topics
Authors
Recent
Search
2000 character limit reached

Local-Global Temporal Fusion Network with an Attention Mechanism for Multiple and Multiclass Arrhythmia Classification

Published 3 Aug 2023 in eess.SP and cs.LG | (2308.02416v2)

Abstract: Clinical decision support systems (CDSSs) have been widely utilized to support the decisions made by cardiologists when detecting and classifying arrhythmia from electrocardiograms (ECGs). However, forming a CDSS for the arrhythmia classification task is challenging due to the varying lengths of arrhythmias. Although the onset time of arrhythmia varies, previously developed methods have not considered such conditions. Thus, we propose a framework that consists of (i) local temporal information extraction, (ii) global pattern extraction, and (iii) local-global information fusion with attention to perform arrhythmia detection and classification with a constrained input length. The 10-class and 4-class performances of our approach were assessed by detecting the onset and offset of arrhythmia as an episode and the duration of arrhythmia based on the MIT-BIH arrhythmia database (MITDB) and MIT-BIH atrial fibrillation database (AFDB), respectively. The results were statistically superior to those achieved by the comparison models. To check the generalization ability of the proposed method, an AFDB-trained model was tested on the MITDB, and superior performance was attained compared with that of a state-of-the-art model. The proposed method can capture local-global information and dynamics without incurring information losses. Therefore, arrhythmias can be recognized more accurately, and their occurrence times can be calculated; thus, the clinical field can create more accurate treatment plans by using the proposed method.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (59)
  1. Z. Xu, J. Zhang, Q. Zhang, Q. Xuan, and P. S. F. Yip, “A comorbidity knowledge-aware model for disease prognostic prediction,” IEEE Trans. Cybern., 2021.
  2. J.-H. Jeong, J.-H. Cho, B.-H. Lee, and S.-W. Lee, “Real-time deep neurolinguistic learning enhances noninvasive neural language decoding for brain-machine interaction,” IEEE Trans. Cybern., 2022.
  3. R. T. Sutton, D. Pincock, D. C. Baumgart, D. C. Sadowski, R. N. Fedorak, and K. I. Kroeker, “An overview of clinical decision support systems: benefits, risks, and strategies for success,” NPJ Digit., vol. 3, no. 1, pp. 1–10, 2020.
  4. K. A. Sidek, I. Khalil, and H. F. Jelinek, “ECG biometric with abnormal cardiac conditions in remote monitoring system,” IEEE Trans. Syst. Man Cybern. Syst., vol. 44, no. 11, pp. 1498–1509, 2014.
  5. H. Kamel, M. S. Elkind, P. D. Bhave, B. B. Navi, P. M. Okin, C. Iadecola, R. B. Devereux, and M. E. Fink, “Paroxysmal supraventricular tachycardia and the risk of ischemic stroke,” Stroke, vol. 44, no. 6, pp. 1550–1554, 2013.
  6. G. Sannino and G. De Pietro, “A deep learning approach for ECG-based heartbeat classification for arrhythmia detection,” Future Gener. Comp. Syst., vol. 86, pp. 446–455, 2018.
  7. Y. K. Kim, M. Lee, H. S. Song, and S.-W. Lee, “Automatic cardiac arrhythmia classification using residual network combined with long short-term memory,” IEEE Trans. Instrum. Meas., 2022.
  8. H. Huang, J. Liu, Q. Zhu, R. Wang, and G. Hu, “A new hierarchical method for inter-patient heartbeat classification using random projections and RR intervals,” Biomed. Eng. Online, vol. 13, no. 1, pp. 1–26, 2014.
  9. B. Pourbabaee, M. J. Roshtkhari, and K. Khorasani, “Deep convolutional neural networks and learning ECG features for screening paroxysmal atrial fibrillation patients,” IEEE Trans. Syst. Man Cybern. Syst., vol. 48, no. 12, pp. 2095–2104, 2018.
  10. U. R. Acharya, H. Fujita, O. S. Lih, Y. Hagiwara, J. H. Tan, and M. Adam, “Automated detection of arrhythmias using different intervals of tachycardia ECG segments with convolutional neural network,” Inf. Sci., vol. 405, pp. 81–90, 2017.
  11. O. Faust, A. Shenfield, M. Kareem, T. R. San, H. Fujita, and U. R. Acharya, “Automated detection of atrial fibrillation using long short-term memory network with RR interval signals,” Comput. Biol. Med., vol. 102, pp. 327–335, 2018.
  12. C. Chen, Z. Hua, R. Zhang, G. Liu, and W. Wen, “Automated arrhythmia classification based on a combination network of CNN and LSTM,” Biomed. Signal. Process., vol. 57, p. 101819, 2020.
  13. B. A. Teplitzky, M. McRoberts, and H. Ghanbari, “Deep learning for comprehensive ECG annotation,” Heart rhythm, vol. 17, no. 5, pp. 881–888, 2020.
  14. L. Zhang, J. Zhao, and W. Li, “Online and unsupervised anomaly detection for streaming data using an array of sliding windows and pdds,” IEEE Trans. Cybern., vol. 51, no. 4, pp. 2284–2289, 2019.
  15. M. Aly, “Survey on multiclass classification methods,” Neural Netw., vol. 19, no. 1-9, p. 2, 2005.
  16. S. Parvaneh, J. Rubin, S. Babaeizadeh, and M. Xu-Wilson, “Cardiac arrhythmia detection using deep learning: A review,” J. Electrocardiol., vol. 57, pp. S70–S74, 2019.
  17. Miyasaka, “Secular trends in incidence of atrial fibrillation in olmsted county, minnesota, 1980 to 2000, and implications on the projections for future prevalence,” Circulation, vol. 114, no. 11, pp. E498–E498, 2006.
  18. S. Khurshid, S. H. Choi, L.-C. Weng, E. Y. Wang, L. Trinquart, E. J. Benjamin, P. T. Ellinor, and S. A. Lubitz, “Frequency of cardiac rhythm abnormalities in a half million adults,” Circ. Arrhythm. Electrophysiol., vol. 11, no. 7, p. e006273, 2018.
  19. E. P. Walsh and F. Cecchin, “Arrhythmias in adult patients with congenital heart disease,” Circulation, vol. 115, no. 4, pp. 534–545, 2007.
  20. A. Chaurasia and E. Culurciello, “Linknet: Exploiting encoder representations for efficient semantic segmentation,” in IEEE Visual Communications and Image Processing.   IEEE, 2017, pp. 1–4.
  21. C. Lea, M. D. Flynn, R. Vidal, A. Reiter, and G. D. Hager, “Temporal convolutional networks for action segmentation and detection,” in IEEE Conference on Computer Vision and Pattern Recognition, 2017, pp. 156–165.
  22. F. Yu and V. Koltun, “Multi-scale context aggregation by dilated convolutions,” arXiv preprint arXiv:1511.07122, 2015.
  23. A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, Ł. Kaiser, and I. Polosukhin, “Attention is all you need,” Adv. Neural Inf. Process. Syst., vol. 30, 2017.
  24. G. B. Moody and R. G. Mark, “The impact of the MIT-BIH arrhythmia database,” IEEE Eng. Med. Biol., vol. 20, no. 3, pp. 45–50, 2001.
  25. M. Khalifa and K. Shaalan, “Character convolutions for arabic named entity recognition with long short-term memory networks,” Comput. Speech Lang., vol. 58, pp. 335–346, 2019.
  26. R. He, Y. Liu, K. Wang, N. Zhao, Y. Yuan, Q. Li, and H. Zhang, “Automatic cardiac arrhythmia classification using combination of deep residual network and bidirectional LSTM,” IEEE Access, vol. 7, pp. 102 119–102 135, 2019.
  27. B. Petryshak, I. Kachko, M. Maksymenko, and O. Dobosevych, “Robust deep learning pipeline for PVC beats localization,” Technol. Health Care, vol. 29, no. S1, pp. 475–486, 2021.
  28. M. Johnson, M. Schuster, Q. V. Le, M. Krikun, Y. Wu, Z. Chen, N. Thorat, F. Viégas, M. Wattenberg, G. Corrado et al., “Google’s multilingual neural machine translation system: Enabling zero-shot translation,” Trans. Assoc. Comput., vol. 5, pp. 339–351, 2017.
  29. T. Pokaprakarn, R. R. Kitzmiller, R. Moorman, D. E. Lake, A. K. Krishnamurthy, and M. R. Kosorok, “Sequence to sequence ecg cardiac rhythm classification using convolutional recurrent neural networks,” IEEE J. Biomed. Health Inform., vol. 26, no. 2, pp. 572–580, 2021.
  30. S. Bai, J. Z. Kolter, and V. Koltun, “An empirical evaluation of generic convolutional and recurrent networks for sequence modeling,” arXiv preprint arXiv:1803.01271, 2018.
  31. H. Ma, C. Chen, Q. Zhu, H. Yuan, L. Chen, and M. Shu, “An ECG signal classification method based on dilated causal convolution,” Comput. Math. Methods Med., vol. 2021, 2021.
  32. T. M. Ingolfsson, X. Wang, M. Hersche, A. Burrello, L. Cavigelli, and L. Benini, “ECG-TCN: Wearable cardiac arrhythmia detection with a temporal convolutional network,” in Artificial Intelligence Circuits and Systems.   IEEE, 2021, pp. 1–4.
  33. N. Ibtehaz and M. S. Rahman, “Multiresunet: Rethinking the U-Net architecture for multimodal biomedical image segmentation,” Neural Netw., vol. 121, pp. 74–87, 2020.
  34. C. Peng, X. Zhang, G. Yu, G. Luo, and J. Sun, “Large kernel matters–improve semantic segmentation by global convolutional network,” in IEEE Conference on Computer Vision and Pattern Recognition, 2017, pp. 4353–4361.
  35. S. Ioffe and C. Szegedy, “Batch normalization: Accelerating deep network training by reducing internal covariate shift,” in International Conference on Machine Learning.   PMLR, 2015, pp. 448–456.
  36. B. Xu, N. Wang, T. Chen, and M. Li, “Empirical evaluation of rectified activations in convolutional network,” arXiv preprint arXiv:1505.00853, 2015.
  37. N. Srivastava, G. Hinton, A. Krizhevsky, I. Sutskever, and R. Salakhutdinov, “Dropout: a simple way to prevent neural networks from overfitting,” J. Mach. Learn. Res., vol. 15, no. 1, pp. 1929–1958, 2014.
  38. J. Phyo, W. Ko, E. Jeon, and H.-I. Suk, “Transsleep: Transitioning-aware attention-based deep neural network for sleep staging,” IEEE Trans. Cybern., 2022.
  39. L. Zhou, C. Zhang, and M. Wu, “D-LinkNet: LinkNet with pretrained encoder and dilated convolution for high resolution satellite imagery road extraction,” in IEEE Conference on Computer Vision and Pattern Recognition, 2018, pp. 182–186.
  40. M. Wu, C. Zhang, J. Liu, L. Zhou, and X. Li, “Towards accurate high resolution satellite image semantic segmentation,” IEEE Access, vol. 7, pp. 55 609–55 619, 2019.
  41. V. Dumoulin and F. Visin, “A guide to convolution arithmetic for deep learning,” arXiv preprint arXiv:1603.07285, 2016.
  42. C. H. Sudre, W. Li, T. Vercauteren, S. Ourselin, and M. Jorge Cardoso, “Generalised dice overlap as a deep learning loss function for highly unbalanced segmentations,” in Deep Learning in Medical Image Analysis and Multimodal Learning for Clinical Decision Support.   Springer, 2017, pp. 240–248.
  43. Y.-J. Huang, Q. Dou, Z.-X. Wang, L.-Z. Liu, Y. Jin, C.-F. Li, L. Wang, H. Chen, and R.-H. Xu, “3-D RoI-aware U-Net for accurate and efficient colorectal tumor segmentation,” IEEE Trans. Cybern., vol. 51, no. 11, pp. 5397–5408, 2020.
  44. D. P. Kingma and J. Ba, “Adam: A method for stochastic optimization,” arXiv preprint arXiv:1412.6980, 2014.
  45. R. R. Selvaraju, M. Cogswell, A. Das, R. Vedantam, D. Parikh, and D. Batra, “Grad-CAM: Visual explanations from deep networks via gradient-based localization,” in International Conference on Computer Vision, 2017, pp. 618–626.
  46. A. J. DeGrave, J. D. Janizek, and S.-I. Lee, “AI for radiographic COVID-19 detection selects shortcuts over signal,” Nat. Mach. Intell., vol. 3, no. 7, pp. 610–619, 2021.
  47. A. L. Goldberger, L. A. Amaral, L. Glass, J. M. Hausdorff, P. C. Ivanov, R. G. Mark, J. E. Mietus, G. B. Moody, C.-K. Peng, and H. E. Stanley, “Physiobank, physiotoolkit, and physionet: components of a new research resource for complex physiologic signals,” Circulation, vol. 101, no. 23, pp. e215–e220, 2000.
  48. P. Bugata and P. Drotar, “Feature selection based on a sparse neural-network layer with normalizing constraints,” IEEE Trans. Cybern., 2021.
  49. S. L. Oh, E. Y. Ng, R. San Tan, and U. R. Acharya, “Automated beat-wise arrhythmia diagnosis using modified U-Net on extended electrocardiographic recordings with heterogeneous arrhythmia types,” Comput. Biol. Med., vol. 105, pp. 92–101, 2019.
  50. J. Chen, H. Deng, S. Li, W. Li, H. Chen, Y. Chen, and B. Luo, “RU-Net: A residual U-Net for automatic interplanetary coronal mass ejection detection,” Astrophys. J., Suppl. Ser., vol. 259, no. 1, p. 8, 2022.
  51. R. Salinas-Martínez, J. De Bie, N. Marzocchi, and F. Sandberg, “Detection of brief episodes of atrial fibrillation based on electrocardiomatrix and convolutional neural network,” Front. Physiol., vol. 12, 2021.
  52. M. Perslev, M. Jensen, S. Darkner, P. J. Jennum, and C. Igel, “U-time: A fully convolutional network for time series segmentation applied to sleep staging,” Adv. Neural Inf. Process. Syst., vol. 32, 2019.
  53. P. Sanders, H. Pürerfellner, E. Pokushalov, S. Sarkar, M. Di Bacco, B. Maus, L. R. Dekker, R. L. U. Investigators et al., “Performance of a new atrial fibrillation detection algorithm in a miniaturized insertable cardiac monitor: Results from the reveal LINQ usability study,” Heart Rhythm, vol. 13, no. 7, pp. 1425–1430, 2016.
  54. M. Lee, L. R. Sanz, A. Barra, A. Wolff, J. O. Nieminen, M. Boly, M. Rosanova, S. Casarotto, O. Bodart, J. Annen et al., “Quantifying arousal and awareness in altered states of consciousness using interpretable deep learning,” Nat. Commun., vol. 13, no. 1, p. 1064, 2022.
  55. M. J. Marino, “Statistical analysis in preclinical biomedical research,” in Research in the Biomedical Sciences.   Elsevier, 2018, pp. 107–144.
  56. C. Szegedy, V. Vanhoucke, S. Ioffe, J. Shlens, and Z. Wojna, “Rethinking the inception architecture for computer vision,” in IEEE Conference on Computer Vision and Pattern Recognition, 2016, pp. 2818–2826.
  57. Y. Cai and Y. Wang, “MA-UNet: An improved version of UNet based on multi-scale and attention mechanism for medical image segmentation,” in International Conference on Electronics and Communication; Network and Computer Technology, vol. 12167.   SPIE, 2022, pp. 205–211.
  58. S. Petrutiu, A. V. Sahakian, and S. Swiryn, “Abrupt changes in fibrillatory wave characteristics at the termination of paroxysmal atrial fibrillation in humans,” Europace, vol. 9, no. 7, pp. 466–470, 2007.
  59. J. W. Hughes, J. E. Olgin, R. Avram, S. A. Abreau, T. Sittler, K. Radia, H. Hsia, T. Walters, B. Lee, J. E. Gonzalez et al., “Performance of a convolutional neural network and explainability technique for 12-lead electrocardiogram interpretation,” JAMA Cardiol., vol. 6, no. 11, pp. 1285–1295, 2021.

Summary

No one has generated a summary of this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Sign Up to Summarize

Paper to Video (Beta)

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Sign Up to Generate

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Generate Now

Continue Learning

We haven't generated follow-up questions for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Generate Now

Collections

Sign up for free to add this paper to one or more collections.

User Circle Single Streamline Icon: https://streamlinehq.com Sign Up