Online Transfer Learning for RSV Case Detection (2402.01987v2)
Abstract: Transfer learning has become a pivotal technique in machine learning and has proven to be effective in various real-world applications. However, utilizing this technique for classification tasks with sequential data often faces challenges, primarily attributed to the scarcity of class labels. To address this challenge, we introduce Multi-Source Adaptive Weighting (MSAW), an online multi-source transfer learning method. MSAW integrates a dynamic weighting mechanism into an ensemble framework, enabling automatic adjustment of weights based on the relevance and contribution of each source (representing historical knowledge) and target model (learning from newly acquired data). We demonstrate the effectiveness of MSAW by applying it to detect Respiratory Syncytial Virus cases within Emergency Department visits, utilizing multiple years of electronic health records from the University of Pittsburgh Medical Center. Our method demonstrates performance improvements over many baselines, including refining pre-trained models with online learning as well as three static weighting approaches, showing MSAW's capacity to integrate historical knowledge with progressively accumulated new data. This study indicates the potential of online transfer learning in healthcare, particularly for developing machine learning models that dynamically adapt to evolving situations where new data is incrementally accumulated.
- S. Sukhija, N. C. Krishnan, and G. Singh, “Supervised heterogeneous domain adaptation via random forests.” in IJCAI, 2016, pp. 2039–2045.
- H. Wu, Q. Wu, and M. K. Ng, “Knowledge preserving and distribution alignment for heterogeneous domain adaptation,” ACM Transactions on Information Systems (TOIS), vol. 40, no. 1, pp. 1–29, 2021.
- J. T. Zhou, I. W. Tsang, S. J. Pan, and M. Tan, “Multi-class heterogeneous domain adaptation,” Journal of Machine Learning Research, 2019.
- P. Zhao, S. C. Hoi, J. Wang, and B. Li, “Online transfer learning,” Artificial intelligence, vol. 216, pp. 76–102, 2014.
- Z. Kang, B. Yang, S. Yang, X. Fang, and C. Zhao, “Online transfer learning with multiple source domains for multi-class classification,” Knowledge-Based Systems, vol. 190, p. 105149, 2020.
- P. ZHAO and S. C. HOI, “Otl: A framework of online transfer learning.(2010),” in Proceedings of the 27th International Conference on Machine Learning (ICML 2010): Haifa, Israel, 21-24 June, pp. 219–1.
- G. Piedimonte and M. K. Perez, “Respiratory syncytial virus infection and bronchiolitis,” Pediatrics in review, vol. 35, no. 12, pp. 519–530, 2014.
- T. Shi, D. A. McAllister, K. L. O’Brien, E. A. Simoes, S. A. Madhi, B. D. Gessner, F. P. Polack, E. Balsells, S. Acacio, C. Aguayo et al., “Global, regional, and national disease burden estimates of acute lower respiratory infections due to respiratory syncytial virus in young children in 2015: a systematic review and modelling study,” The Lancet, vol. 390, no. 10098, pp. 946–958, 2017.
- C. B. Hall, G. A. Weinberg, M. K. Iwane, A. K. Blumkin, K. M. Edwards, M. A. Staat, P. Auinger, M. R. Griffin, K. A. Poehling, D. Erdman, C. G. Grijalva, Y. Zhu, and P. Szilagyi, “The burden of respiratory syncytial virus infection in young children,” New England Journal of Medicine, vol. 360, no. 6, pp. 588–598, 2009.
- A. R. Falsey, P. A. Hennessey, M. A. Formica, C. Cox, and E. E. Walsh, “Respiratory syncytial virus infection in elderly and high-risk adults,” N Engl J Med, vol. 352, no. 17, pp. 1749–59, 2005, 1533-4406 Falsey, Ann R Hennessey, Patricia A Formica, Maria A Cox, Christopher Walsh, Edward E R01-AI-45969/AI/NIAID NIH HHS/United States Journal Article Research Support, U.S. Gov’t, P.H.S. United States 2005/04/29 N Engl J Med. 2005 Apr 28;352(17):1749-59. doi: 10.1056/NEJMoa043951.
- C. Griffiths, S. J. Drews, and D. J. Marchant, “Respiratory syncytial virus: infection, detection, and new options for prevention and treatment,” Clinical microbiology reviews, vol. 30, no. 1, pp. 277–319, 2017.
- F. Zhuang, Z. Qi, K. Duan, D. Xi, Y. Zhu, H. Zhu, H. Xiong, and Q. He, “A comprehensive survey on transfer learning,” Proceedings of the IEEE, vol. 109, no. 1, pp. 43–76, 2020.
- S. Niu, Y. Liu, J. Wang, and H. Song, “A decade survey of transfer learning (2010–2020),” IEEE Transactions on Artificial Intelligence, vol. 1, no. 2, pp. 151–166, 2020.
- K. Weiss, T. M. Khoshgoftaar, and D. Wang, “A survey of transfer learning,” Journal of Big data, vol. 3, no. 1, pp. 1–40, 2016.
- L. Zhang and X. Gao, “Transfer adaptation learning: A decade survey,” IEEE Transactions on Neural Networks and Learning Systems, 2022.
- N. Agarwal, A. Sondhi, K. Chopra, and G. Singh, “Transfer learning: Survey and classification,” in Smart Innovations in Communication and Computational Sciences, S. Tiwari, M. C. Trivedi, K. K. Mishra, A. Misra, K. K. Kumar, and E. Suryani, Eds. Singapore: Springer Singapore, 2021, pp. 145–155.
- R. Bao, Y. Sun, Y. Gao, J. Wang, Q. Yang, H. Chen, Z.-H. Mao, and Y. Ye, “A survey of heterogeneous transfer learning,” arXiv preprint arXiv:2310.08459, 2023.
- C. Tan, F. Sun, T. Kong, W. Zhang, C. Yang, and C. Liu, “A survey on deep transfer learning,” in Artificial Neural Networks and Machine Learning–ICANN 2018: 27th International Conference on Artificial Neural Networks, Rhodes, Greece, October 4-7, 2018, Proceedings, Part III 27. Springer, 2018, pp. 270–279.
- M. Iman, H. R. Arabnia, and K. Rasheed, “A review of deep transfer learning and recent advancements,” Technologies, vol. 11, no. 2, p. 40, 2023.
- H. Liang, W. Fu, and F. Yi, “A survey of recent advances in transfer learning,” in 2019 IEEE 19th international conference on communication technology (ICCT). IEEE, 2019, pp. 1516–1523.
- M. E. Taylor and P. Stone, “Transfer learning for reinforcement learning domains: A survey.” Journal of Machine Learning Research, vol. 10, no. 7, 2009.
- Z. Zhu, K. Lin, A. K. Jain, and J. Zhou, “Transfer learning in deep reinforcement learning: A survey,” IEEE Transactions on Pattern Analysis and Machine Intelligence, pp. 1–20, 2023.
- S. Saha and T. Ahmad, “Federated transfer learning: Concept and applications,” Intelligenza Artificiale, vol. 15, no. 1, pp. 35–44, 2021.
- E. Hallaji, R. Razavi-Far, and M. Saif, “Federated and transfer learning: A survey on adversaries and defense mechanisms,” in Federated and Transfer Learning. Springer, 2022, pp. 29–55.
- L. Shao, F. Zhu, and X. Li, “Transfer learning for visual categorization: A survey,” IEEE transactions on neural networks and learning systems, vol. 26, no. 5, pp. 1019–1034, 2014.
- V. M. Patel, R. Gopalan, R. Li, and R. Chellappa, “Visual domain adaptation: A survey of recent advances,” IEEE signal processing magazine, vol. 32, no. 3, pp. 53–69, 2015.
- M. Wang and W. Deng, “Deep visual domain adaptation: A survey,” Neurocomputing, vol. 312, pp. 135–153, 2018.
- D. Cook, K. D. Feuz, and N. C. Krishnan, “Transfer learning for activity recognition: A survey,” Knowledge and information systems, vol. 36, pp. 537–556, 2013.
- Z. Alyafeai, M. S. AlShaibani, and I. Ahmad, “A survey on transfer learning in natural language processing,” arXiv preprint arXiv:2007.04239, 2020.
- R. Liu, Y. Shi, C. Ji, and M. Jia, “A survey of sentiment analysis based on transfer learning,” IEEE access, vol. 7, pp. 85 401–85 412, 2019.
- S. Ruder, M. E. Peters, S. Swayamdipta, and T. Wolf, “Transfer learning in natural language processing,” in Proceedings of the 2019 conference of the North American chapter of the association for computational linguistics: Tutorials, 2019, pp. 15–18.
- X. Yu, J. Wang, Q.-Q. Hong, R. Teku, S.-H. Wang, and Y.-D. Zhang, “Transfer learning for medical images analyses: A survey,” Neurocomputing, vol. 489, pp. 230–254, 2022.
- A. Sufian, A. Ghosh, A. S. Sadiq, and F. Smarandache, “A survey on deep transfer learning to edge computing for mitigating the COVID-19 pandemic,” Journal of Systems Architecture, vol. 108, p. 101830, 2020.
- C. T. Nguyen, N. Van Huynh, N. H. Chu, Y. M. Saputra, D. T. Hoang, D. N. Nguyen, Q.-V. Pham, D. Niyato, E. Dutkiewicz, and W.-J. Hwang, “Transfer learning for future wireless networks: A comprehensive survey,” arXiv preprint arXiv:2102.07572, 2021.
- L. J. Wong and A. J. Michaels, “Transfer learning for radio frequency machine learning: A taxonomy and survey,” Sensors, vol. 22, no. 4, p. 1416, 2022.
- H. Wu, Y. Yan, Y. Ye, H. Min, M. K. Ng, and Q. Wu, “Online heterogeneous transfer learning by knowledge transition,” ACM Transactions on Intelligent Systems and Technology (TIST), vol. 10, no. 3, pp. 1–19, 2019.
- Y. Yan, Q. Wu, M. Tan, M. K. Ng, H. Min, and I. W. Tsang, “Online heterogeneous transfer by hedge ensemble of offline and online decisions,” IEEE transactions on neural networks and learning systems, vol. 29, no. 7, pp. 3252–3263, 2017.
- C. F. Tso, C. Lam, J. Calvert, and Q. Mao, “Machine learning early prediction of respiratory syncytial virus in pediatric hospitalized patients,” Frontiers in Pediatrics, vol. 10, p. 886212, 2022.
- M. Cord—De Iaco, A. Kimberly, F. Gesualdo, E. Pandolfi, I. Croci, and A. E. Tozzi, “Machine learning clinical decision support systems for surveillance: a case study on pertussis and rsv in children,” Frontiers in Pediatrics, vol. 11, p. 1112074, 2023.
- S. Visweswaran, B. McLay, N. Cappella, M. Morris, J. T. Milnes, S. E. Reis, J. C. Silverstein, and M. J. Becich, “An atomic approach to the design and implementation of a research data warehouse,” Journal of the American Medical Informatics Association, vol. 29, no. 4, pp. 601–608, 2022.
- A. R. Aronson and F.-M. Lang, “An overview of metamap: historical perspective and recent advances,” Journal of the American Medical Informatics Association, vol. 17, no. 3, pp. 229–236, 2010.