Measurement Uncertainty: Relating the uncertainties of physical and virtual measurements (2402.13666v1)
Abstract: In the context of industrially mass-manufactured products, quality management is based on physically inspecting a small sample from a large batch and reasoning about the batch's quality conformance. When complementing physical inspections with predictions from machine learning models, it is crucial that the uncertainty of the prediction is known. Otherwise, the application of established quality management concepts is not legitimate. Deterministic (machine learning) models lack quantification of their predictive uncertainty and are therefore unsuitable. Probabilistic (machine learning) models provide a predictive uncertainty along with the prediction. However, a concise relationship is missing between the measurement uncertainty of physical inspections and the predictive uncertainty of probabilistic models in their application in quality management. Here, we show how the predictive uncertainty of probabilistic (machine learning) models is related to the measurement uncertainty of physical inspections. This enables the use of probabilistic models for virtual inspections and integrates them into existing quality management concepts. Thus, we can provide a virtual measurement for any quality characteristic based on the process data and achieve a 100 percent inspection rate. In the field of Predictive Quality, the virtual measurement is of great interest. Based on our results, physical inspections with a low sampling rate can be accompanied by virtual measurements that allow an inspection rate of 100 percent. We add substantial value, especially to complex process chains, as faulty products/parts are identified promptly and upcoming process steps can be aborted.
- “Zero defect manufacturing: state-of-the-art review, shortcomings and future directions in research” In International Journal of Production Research 58.1, 2020, pp. 1–17 DOI: 10.1080/00207543.2019.1605228
- ISO 9001 “Quality management systems - Requirements”, 2015 DOI: 10.31030/2325651
- Tobias Müller “Modellbildung mittels Symbolischer Regression zur Messunsicherheitsbestimmung komplexer Messprozesse”, 2023 DOI: 10.18154/RWTH-2023-01146
- JCGM 100 (GUM) “Evaluation of measurement data — Guide to the expression of uncertainty in measurement”, 2008 URL: https://www.bipm.org/documents/20126/2071204/JCGM_100_2008_E.pdf/cb0ef43f-baa5-11cf-3f85-4dcd86f77bd6
- ISO 14253-1 “Geometrical product specifications (GPS) - Inspection by measurement of workpieces and measuring equipment - Part 1: Decision rules for verifying conformity or nonconformity with specifications”, 2017 DOI: 10.31030/2693140
- VDA5 “Prüfprozesseignung, Eignung von Messsystemen, Mess- und Prüfprozessen, Erweiterte Messunsicherheit, Konformitätsbewertung”, 2011
- “Virtual metrology as an approach for product quality estimation in Industry 4.0: a systematic review and integrative conceptual framework” In International Journal of Production Research 60.2, 2022, pp. 742–765 DOI: 10.1080/00207543.2021.1976433
- “Machine learning and deep learning based predictive quality in manufacturing: A systematic review” In Journal of Intelligent Manufacturing, 2022 DOI: 10.1007/s10845-022-01963-8
- Simon Cramer, Meike Huber and Robert H. Schmitt “Uncertainty Quantification Based on Bayesian Neural Networks for Predictive Quality” In Artificial Intelligence, Big Data and Data Science in Statistics Cham: Springer International Publishing, 2022, pp. 253–268 DOI: 10.1007/978-3-031-07155-3_10
- “Industrial Virtual Sensing for Big Process Data Based on Parallelized Nonlinear Variational Bayesian Factor Regression” In IEEE Transactions on Instrumentation and Measurement 69.10, 2020, pp. 8128–8136 DOI: 10.1109/TIM.2020.2993980
- JCGM 101 “Evaluation of measurement data — Supplement 1 to the “Guide to the expression of uncertainty in measurement” — Propagation of distributions using a Monte Carlo method”, 2008 URL: https://www.bipm.org/documents/20126/2071204/JCGM_101_2008_E.pdf/325dcaad-c15a-407c-1105-8b7f322d651c
- JCGM 200 (VIM) “International vocabulary of metrology — Basic and general concepts and associated terms (VIM)”, 2012 URL: https://www.bipm.org/documents/20126/2071204/JCGM_200_2012.pdf/f0e1ad45-d337-bbeb-53a6-15fe649d0ff1
- Tobias Mueller, Meike Huber and Robert Schmitt “Modelling complex measurement processes for measurement uncertainty determination” In International Journal of Quality & Reliability Management 37.3, 2020, pp. 494–516 DOI: 10.1108/IJQRM-07-2019-0232
- JCGM 104 “Evaluation of measurement data — An introduction to the “Guide to the expression of uncertainty in measurement” and related documents”, 2009 URL: https://www.bipm.org/documents/20126/2071204/JCGM_104_2009.pdf/19e0a96c-6cf3-a056-4634-4465c576e513
- “Force and temperature modelling of bone milling using artificial neural networks” In Measurement 116, 2018, pp. 25–37 DOI: 10.1016/j.measurement.2017.10.051
- T.J. Sullivan “Introduction to Uncertainty Quantification” 63, Texts in Applied Mathematics Cham: Springer International Publishing, 2015 DOI: 10.1007/978-3-319-23395-6
- “Hands-on Bayesian neural networks - A tutorial for deep learning users” In arXiv, 2021 DOI: 10.48550/arXiv.2007.06823
- JCGM 102 “Evaluation of measurement data — Supplement 2 to the “Guide to the expression of uncertainty in measurement” — Extension to any number of output quantities”, 2011 URL: https://www.bipm.org/documents/20126/2071204/JCGM_102_2011_E.pdf/6a3281aa-1397-d703-d7a1-a8d58c9bf2a5
- “Gaussian processes for machine learning” MIT Press, 2006 DOI: 10.7551/mitpress/3206.001.0001
- Yarin Gal “Uncertainty in deep learning”, 2016 URL: http://mlg.eng.cam.ac.uk/yarin/thesis/thesis.pdf
- Stefan Depeweg “Modeling Epistemic and Aleatoric Uncertainty with Bayesian Neural Networks and Latent Variables”, 2019 URL: https://mediatum.ub.tum.de/doc/1482483/1482483.pdf
- Michael Betancourt “A conceptual introduction to Hamiltonian Monte Carlo” In arXiv, 2018 DOI: 10.48550/arXiv.1701.02434
- “Automatic differentiation variational inference” In arXiv, 2016 DOI: 10.48550/arXiv.1603.00788
- Ian Goodfellow, Yoshua Bengio and Aaron Courville “Deep Learning” MIT Press, 2016 URL: http://www.deeplearningbook.org
- “Weight uncertainty in neural networks” In arXiv, 2015 DOI: 10.48550/arXiv.1505.05424
- Firas Bayram, Bestoun S. Ahmed and Andreas Kassler “From concept drift to model degradation: An overview on performance-aware drift detectors” In Knowledge-Based Systems 245, 2022, pp. 108632 DOI: 10.1016/j.knosys.2022.108632
- Daniel Kurz, Cristina De Luca and Jurgen Pilz “Monitoring virtual metrology reliability in a sampling decision system” In 2013 IEEE International Conference on Automation Science and Engineering (CASE) Madison, WI, USA: IEEE, 2013, pp. 20–25 DOI: 10.1109/CoASE.2013.6653949
- Franko Schmähling, Jörg Martin and Clemens Elster “A framework for benchmarking uncertainty in deep regression” In Applied Intelligence 53.8, 2023, pp. 9499–9512 DOI: 10.1007/s10489-022-03908-3
- Anastasios N. Angelopoulos and Stephen Bates “A Gentle Introduction to Conformal Prediction and Distribution-Free Uncertainty Quantification” arXiv:2107.07511 [cs, math, stat] arXiv, 2022 DOI: 10.48550/arXiv.2107.07511
- “Metrologically interpretable feature extraction for industrial machine vision using generative deep learning” In CIRP Annals 71.1, 2022, pp. 433–436 DOI: 10.1016/j.cirp.2022.03.016
- ISO 9000 “Quality management systems - Fundamentals and vocabulary”, 2015 DOI: 10.31030/2325650
- “Uncertainty quantification using Bayesian neural networks in classification: Application to ischemic stroke lesion segmentation” In Medical Imaging with Deep Learning, 2018, pp. 13 URL: https://openreview.net/forum?id=Sk_P2Q9sG
- Christopher Bishop “Pattern recognition and machine learning” Springer New York, 2006