AI-Powered Interfaces for Extended Reality to support Remote Maintenance (2306.16961v1)
Abstract: High-end components that conduct complicated tasks automatically are a part of modern industrial systems. However, in order for these parts to function at the desired level, they need to be maintained by qualified experts. Solutions based on Augmented Reality (AR) have been established with the goal of raising production rates and quality while lowering maintenance costs. With the introduction of two unique interaction interfaces based on wearable targets and human face orientation, we are proposing hands-free advanced interactive solutions in this study with the goal of reducing the bias towards certain users. Using traditional devices in real time, a comparison investigation using alternative interaction interfaces is conducted. The suggested solutions are supported by various AI powered methods such as novel gravity-map based motion adjustment that is made possible by predictive deep models that reduce the bias of traditional hand- or finger-based interaction interfaces
- P. Wang, Ananya, R. Yan, and R.X. Gao, “Virtualization and deep recognition for system fault classification,” Int. J. Ind. Manuf. Syst. Eng., vol. 44, pp. 310–316, 2017.
- L. Liu, X. Liang, M. Zuo, “A dependence-based feature vector and its application on planetary gearbox fault classification,” J. Sound Vib., vol. 431, pp. 192–211, 2018.
- A. Malta, M. Mendes, and T. Farinha, “Augmented reality maintenance assistant using yolov5,” Applied Sciences, vol. 11, no. 11, p. 4758, 2021.
- M. Ortega, E. Ivorra, A. Juan, P. Venegas, J. Martínez, and M. Alcañiz, “Mantra: An effective system based on augmented reality and infrared thermography for industrial maintenance,” Applied Sciences, vol. 11, no. 1, p. 385, 2021.
- V. Reljić, I. Milenković, S. Dudić, J. Šulc, and B. Bajči, “Augmented reality applications in industry 4.0 environment,” Applied Sciences, vol. 11, no. 12, p. 5592, 2021.
- Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner, “Gradient-based learning applied to document recognition,” Proc. IEEE, vol. 86, pp. 2278–2324, 1998.
- S. Ren, K. He, R. Girshick, and J. Sun, “Faster r-cnn: towards real-time object detection with region proposal networks,” in Advances in Neural Information Processing Systems, 2015, pp. 91–99.
- L. Chen, G. Xu, Y. Wang, and J. Wang, “Detection of weak transient signals based on unsupervised learning for bearing fault diagnosis,” Neurocomputing, vol. 314, pp. 445–457, 2018.
- V. Argyriou and T. Vlachos, “Performance study of gradient correlation for sub-pixel motion estimation in the frequency domain,” IEE Proceedings-Vision, Image & Signal Processing, vol. 152, no. 1, pp. 107–114, 2005.
- Y. Wu, M. Yuan, S. Dong, L. Lin, and Y. Liu, “Remaining useful life estimation of engineered systems using vanilla LSTM neural networks,” Neurocomputing, vol. 275, pp. 167–179, 2018.
- V. Argyriou and T. Vlachos, “On the estimation of subpixel motion using phase correlation,” Journal of Electronic Imaging, vol. 16, no. 3, p. 033018, 2007.
- Biao Wang, Yaguo Lei, Tao Yan, Naipeng Li, Liang Guo, “Recurrent convolutional neural network: A new framework for remaining useful life prediction of machinery,” Neurocomputing, vol. 379, pp. 117-129, 2020.
- S. Molaei, M.E.S.A. Abadi, “Maintaining filter structure: A Gabor-based convolutional neural network for image analysis,” Applied Soft Computing, vol. 88, 105960, 2020.
- F.J. Toledo, J.J. Martínez, F.J. Garrigós, J.M. Ferrández, “Image Processing with CNN in a FPGA-Based Augmented Reality System for Visually Impaired People,” in Computational Intelligence and Bioinspired Systems, J. Cabestany, A. Prieto, F. Sandoval (eds.), Lecture Notes in Computer Science, vol. 3512, Springer, Berlin, Heidelberg, 2005.