Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
110 tokens/sec
GPT-4o
56 tokens/sec
Gemini 2.5 Pro Pro
44 tokens/sec
o3 Pro
6 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

A Cyber Manufacturing IoT System for Adaptive Machine Learning Model Deployment by Interactive Causality Enabled Self-Labeling (2404.05976v1)

Published 9 Apr 2024 in cs.LG, cs.SY, eess.SY, and stat.ME

Abstract: Machine Learning (ML) has been demonstrated to improve productivity in many manufacturing applications. To host these ML applications, several software and Industrial Internet of Things (IIoT) systems have been proposed for manufacturing applications to deploy ML applications and provide real-time intelligence. Recently, an interactive causality enabled self-labeling method has been proposed to advance adaptive ML applications in cyber-physical systems, especially manufacturing, by automatically adapting and personalizing ML models after deployment to counter data distribution shifts. The unique features of the self-labeling method require a novel software system to support dynamism at various levels. This paper proposes the AdaptIoT system, comprised of an end-to-end data streaming pipeline, ML service integration, and an automated self-labeling service. The self-labeling service consists of causal knowledge bases and automated full-cycle self-labeling workflows to adapt multiple ML models simultaneously. AdaptIoT employs a containerized microservice architecture to deliver a scalable and portable solution for small and medium-sized manufacturers. A field demonstration of a self-labeling adaptive ML application is conducted with a makerspace and shows reliable performance.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (37)
  1. Y. Lu and J. Cecil, “An internet of things (iot)-based collaborative framework for advanced manufacturing,” The International Journal of Advanced Manufacturing Technology, vol. 84, pp. 1141–1152, 2016.
  2. F. Tao and Q. Qi, “New it driven service-oriented smart manufacturing: Framework and characteristics,” IEEE Transactions on Systems, Man, and Cybernetics: Systems, vol. 49, no. 1, pp. 81–91, 2019.
  3. K. Thramboulidis, D. C. Vachtsevanou, and I. Kontou, “Cpus-iot: A cyber-physical microservice and iot-based framework for manufacturing assembly systems,” Annual Reviews in Control, vol. 47, pp. 237–248, 2019.
  4. M. Rudack, M. Rath, U. Vroomen, and A. Bührig-Polaczek, “Towards a data lake for high pressure die casting,” Metals, vol. 12, no. 2, p. 349, 2022.
  5. I.-L. Yen, S. Zhang, F. Bastani, and Y. Zhang, “A framework for iot-based monitoring and diagnosis of manufacturing systems,” in 2017 IEEE Symposium on Service-Oriented System Engineering (SOSE), 2017, pp. 1–8.
  6. D. Mourtzis, E. Vlachou, and N. Milas, “Industrial big data as a result of iot adoption in manufacturing,” Procedia CIRP, vol. 55, pp. 290–295, 2016, 5th CIRP Global Web Conference - Research and Innovation for Future Production (CIRPe 2016).
  7. C. Liu, Z. Su, X. Xu, and Y. Lu, “Service-oriented industrial internet of things gateway for cloud manufacturing,” Robotics and Computer-Integrated Manufacturing, vol. 73, p. 102217, 2022.
  8. Y. Sheng, G. Zhang, Y. Zhang, M. Luo, Y. Pang, and Q. Wang, “A multimodal data sensing and feature learning-based self-adaptive hybrid approach for machining quality prediction,” Advanced Engineering Informatics, vol. 59, p. 102324, 2024.
  9. C. Morariu, O. Morariu, S. Răileanu, and T. Borangiu, “Machine learning for predictive scheduling and resource allocation in large scale manufacturing systems,” Computers in Industry, vol. 120, p. 103244, 2020.
  10. A. Paleyes, R.-G. Urma, and N. D. Lawrence, “Challenges in deploying machine learning: A survey of case studies,” ACM Comput. Surv., vol. 55, no. 6, dec 2022.
  11. J. Davis, H. Malkani, J. Dyck, P. Korambath, and J. Wise, “Cyberinfrastructure for the democratization of smart manufacturing,” in Smart Manufacturing.   Elsevier, 2020, pp. 83–116.
  12. H. Yan, Y. Guo, and C. Yang, “Augmented self-labeling for source-free unsupervised domain adaptation,” in NeurIPS 2021 Workshop on Distribution Shifts: Connecting Methods and Applications, 2021.
  13. P. Zhou, C. Xiong, X. Yuan, and S. C. H. Hoi, “A theory-driven self-labeling refinement method for contrastive representation learning,” in Advances in Neural Information Processing Systems, vol. 34, 2021, pp. 6183–6197.
  14. M. Grzenda, H. M. Gomes, and A. Bifet, “Performance measures for evolving predictions under delayed labelling classification,” in 2020 International Joint Conference on Neural Networks (IJCNN), 2020, pp. 1–8.
  15. H. M. Gomes, M. Grzenda, R. Mello, J. Read, M. H. Le Nguyen, and A. Bifet, “A survey on semi-supervised learning for delayed partially labelled data streams,” ACM Comput. Surv., feb 2022.
  16. A. J. Ratner, C. M. De Sa, S. Wu, D. Selsam, and C. Ré, “Data programming: Creating large training sets, quickly,” in Advances in Neural Information Processing Systems, vol. 29, 2016.
  17. R. Stewart and S. Ermon, “Label-free supervision of neural networks with physics and domain knowledge,” in Thirty-First AAAI Conference on Artificial Intelligence, 2017.
  18. Y. Ren, A. H. Yen, and G.-P. Li, “A self-labeling method for adaptive machine learning by interactive causality,” IEEE Transactions on Artificial Intelligence, 2023.
  19. Y. Ren and G.-P. Li, “An interactive and adaptive learning cyber physical human system for manufacturing with a case study in worker machine interactions,” IEEE Transactions on Industrial Informatics, vol. 18, no. 10, pp. 6723–6732, 2022.
  20. J. Lu, A. Liu, F. Dong, F. Gu, J. Gama, and G. Zhang, “Learning under concept drift: A review,” IEEE transactions on knowledge and data engineering, vol. 31, no. 12, pp. 2346–2363, 2018.
  21. H. Huang, “Causal relationship over knowledge graphs,” in Proceedings of the 31st ACM International Conference on Information & Knowledge Management, ser. CIKM ’22.   New York, NY, USA: Association for Computing Machinery, 2022, p. 5116–5119.
  22. H. F. Gollob and C. S. Reichardt, “Taking account of time lags in causal models,” Child Development, vol. 58, no. 1, pp. 80–92, 1987.
  23. D. Kreuzberger, N. Kühl, and S. Hirschl, “Machine learning operations (mlops): Overview, definition, and architecture,” IEEE access, 2023.
  24. D. Merkel et al., “Docker: lightweight linux containers for consistent development and deployment,” Linux j, vol. 239, no. 2, p. 2, 2014.
  25. P. Dobbelaere and K. S. Esmaili, “Kafka versus rabbitmq: A comparative study of two industry reference publish/subscribe implementations: Industry paper,” in Proceedings of the 11th ACM international conference on distributed and event-based systems, 2017, pp. 227–238.
  26. G. Fu, Y. Zhang, and G. Yu, “A fair comparison of message queuing systems,” IEEE Access, vol. 9, pp. 421–432, 2020.
  27. S. Rinaldi, F. Bonafini, P. Ferrari, A. Flammini, E. Sisinni, and D. Bianchini, “Impact of data model on performance of time series database for internet of things applications,” in 2019 IEEE International Instrumentation and Measurement Technology Conference (I2MTC).   IEEE, 2019, pp. 1–6.
  28. D. Fernandes, J. Bernardino et al., “Graph databases comparison: Allegrograph, arangodb, infinitegraph, neo4j, and orientdb.” Data, vol. 10, 2018.
  29. S. Vinoski, “Server-sent events with yaws,” IEEE internet computing, vol. 16, no. 5, pp. 98–102, 2012.
  30. P. Covington, J. Adams, and E. Sargin, “Deep neural networks for youtube recommendations,” in Proceedings of the 10th ACM conference on recommender systems, 2016, pp. 191–198.
  31. Z. Cao, T. Simon, S.-E. Wei, and Y. Sheikh, “Realtime multi-person 2d pose estimation using part affinity fields,” in CVPR, 2017.
  32. Y. Ren and G. P. Li, “A contextual sensor system for non-intrusive machine status and energy monitoring,” Journal of Manufacturing Systems, vol. 62, pp. 87–101, 2022.
  33. D.-H. Lee et al., “Pseudo-label: The simple and efficient semi-supervised learning method for deep neural networks,” in Workshop on challenges in representation learning, ICML, vol. 3, no. 2, 2013, p. 896.
  34. M. Zheng, S. You, L. Huang, F. Wang, C. Qian, and C. Xu, “Simmatch: Semi-supervised learning with similarity matching,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), June 2022, pp. 14 471–14 481.
  35. H. Chen, R. Tao, Y. Fan, Y. Wang, J. Wang, B. Schiele, X. Xie, B. Raj, and M. Savvides, “Softmatch: Addressing the quantity-quality trade-off in semi-supervised learning,” 2023.
  36. Y. Wang, H. Chen, Q. Heng, W. Hou, Y. Fan, , Z. Wu, J. Wang, M. Savvides, T. Shinozaki, B. Raj, B. Schiele, and X. Xie, “Freematch: Self-adaptive thresholding for semi-supervised learning,” 2023.
  37. Y. Ren, A. Yen, S. Saraj, and G. P. Li, “Interactive causality-enabled adaptive machine learning in cyber-physical systems: Technology and applications in manufacturing and beyond,” in Principles and Applications of Adaptive Artificial Intelligence.   IGI Global, 2024, pp. 179–206.
User Edit Pencil Streamline Icon: https://streamlinehq.com
Authors (5)
  1. Yutian Ren (3 papers)
  2. Yuqi He (3 papers)
  3. Xuyin Zhang (1 paper)
  4. Aaron Yen (1 paper)
  5. G. P. Li (3 papers)

Summary

We haven't generated a summary for this paper yet.

X Twitter Logo Streamline Icon: https://streamlinehq.com