Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
166 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
42 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Measurement Uncertainty: Relating the uncertainties of physical and virtual measurements (2402.13666v1)

Published 21 Feb 2024 in stat.AP, cs.LG, and math.PR

Abstract: In the context of industrially mass-manufactured products, quality management is based on physically inspecting a small sample from a large batch and reasoning about the batch's quality conformance. When complementing physical inspections with predictions from machine learning models, it is crucial that the uncertainty of the prediction is known. Otherwise, the application of established quality management concepts is not legitimate. Deterministic (machine learning) models lack quantification of their predictive uncertainty and are therefore unsuitable. Probabilistic (machine learning) models provide a predictive uncertainty along with the prediction. However, a concise relationship is missing between the measurement uncertainty of physical inspections and the predictive uncertainty of probabilistic models in their application in quality management. Here, we show how the predictive uncertainty of probabilistic (machine learning) models is related to the measurement uncertainty of physical inspections. This enables the use of probabilistic models for virtual inspections and integrates them into existing quality management concepts. Thus, we can provide a virtual measurement for any quality characteristic based on the process data and achieve a 100 percent inspection rate. In the field of Predictive Quality, the virtual measurement is of great interest. Based on our results, physical inspections with a low sampling rate can be accompanied by virtual measurements that allow an inspection rate of 100 percent. We add substantial value, especially to complex process chains, as faulty products/parts are identified promptly and upcoming process steps can be aborted.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (33)
  1. “Zero defect manufacturing: state-of-the-art review, shortcomings and future directions in research” In International Journal of Production Research 58.1, 2020, pp. 1–17 DOI: 10.1080/00207543.2019.1605228
  2. ISO 9001 “Quality management systems - Requirements”, 2015 DOI: 10.31030/2325651
  3. Tobias Müller “Modellbildung mittels Symbolischer Regression zur Messunsicherheitsbestimmung komplexer Messprozesse”, 2023 DOI: 10.18154/RWTH-2023-01146
  4. JCGM 100 (GUM) “Evaluation of measurement data — Guide to the expression of uncertainty in measurement”, 2008 URL: https://www.bipm.org/documents/20126/2071204/JCGM_100_2008_E.pdf/cb0ef43f-baa5-11cf-3f85-4dcd86f77bd6
  5. ISO 14253-1 “Geometrical product specifications (GPS) - Inspection by measurement of workpieces and measuring equipment - Part 1: Decision rules for verifying conformity or nonconformity with specifications”, 2017 DOI: 10.31030/2693140
  6. VDA5 “Prüfprozesseignung, Eignung von Messsystemen, Mess- und Prüfprozessen, Erweiterte Messunsicherheit, Konformitätsbewertung”, 2011
  7. “Virtual metrology as an approach for product quality estimation in Industry 4.0: a systematic review and integrative conceptual framework” In International Journal of Production Research 60.2, 2022, pp. 742–765 DOI: 10.1080/00207543.2021.1976433
  8. “Machine learning and deep learning based predictive quality in manufacturing: A systematic review” In Journal of Intelligent Manufacturing, 2022 DOI: 10.1007/s10845-022-01963-8
  9. Simon Cramer, Meike Huber and Robert H. Schmitt “Uncertainty Quantification Based on Bayesian Neural Networks for Predictive Quality” In Artificial Intelligence, Big Data and Data Science in Statistics Cham: Springer International Publishing, 2022, pp. 253–268 DOI: 10.1007/978-3-031-07155-3_10
  10. “Industrial Virtual Sensing for Big Process Data Based on Parallelized Nonlinear Variational Bayesian Factor Regression” In IEEE Transactions on Instrumentation and Measurement 69.10, 2020, pp. 8128–8136 DOI: 10.1109/TIM.2020.2993980
  11. JCGM 101 “Evaluation of measurement data — Supplement 1 to the “Guide to the expression of uncertainty in measurement” — Propagation of distributions using a Monte Carlo method”, 2008 URL: https://www.bipm.org/documents/20126/2071204/JCGM_101_2008_E.pdf/325dcaad-c15a-407c-1105-8b7f322d651c
  12. JCGM 200 (VIM) “International vocabulary of metrology — Basic and general concepts and associated terms (VIM)”, 2012 URL: https://www.bipm.org/documents/20126/2071204/JCGM_200_2012.pdf/f0e1ad45-d337-bbeb-53a6-15fe649d0ff1
  13. Tobias Mueller, Meike Huber and Robert Schmitt “Modelling complex measurement processes for measurement uncertainty determination” In International Journal of Quality & Reliability Management 37.3, 2020, pp. 494–516 DOI: 10.1108/IJQRM-07-2019-0232
  14. JCGM 104 “Evaluation of measurement data — An introduction to the “Guide to the expression of uncertainty in measurement” and related documents”, 2009 URL: https://www.bipm.org/documents/20126/2071204/JCGM_104_2009.pdf/19e0a96c-6cf3-a056-4634-4465c576e513
  15. “Force and temperature modelling of bone milling using artificial neural networks” In Measurement 116, 2018, pp. 25–37 DOI: 10.1016/j.measurement.2017.10.051
  16. T.J. Sullivan “Introduction to Uncertainty Quantification” 63, Texts in Applied Mathematics Cham: Springer International Publishing, 2015 DOI: 10.1007/978-3-319-23395-6
  17. “Hands-on Bayesian neural networks - A tutorial for deep learning users” In arXiv, 2021 DOI: 10.48550/arXiv.2007.06823
  18. JCGM 102 “Evaluation of measurement data — Supplement 2 to the “Guide to the expression of uncertainty in measurement” — Extension to any number of output quantities”, 2011 URL: https://www.bipm.org/documents/20126/2071204/JCGM_102_2011_E.pdf/6a3281aa-1397-d703-d7a1-a8d58c9bf2a5
  19. “Gaussian processes for machine learning” MIT Press, 2006 DOI: 10.7551/mitpress/3206.001.0001
  20. Yarin Gal “Uncertainty in deep learning”, 2016 URL: http://mlg.eng.cam.ac.uk/yarin/thesis/thesis.pdf
  21. Stefan Depeweg “Modeling Epistemic and Aleatoric Uncertainty with Bayesian Neural Networks and Latent Variables”, 2019 URL: https://mediatum.ub.tum.de/doc/1482483/1482483.pdf
  22. Michael Betancourt “A conceptual introduction to Hamiltonian Monte Carlo” In arXiv, 2018 DOI: 10.48550/arXiv.1701.02434
  23. “Automatic differentiation variational inference” In arXiv, 2016 DOI: 10.48550/arXiv.1603.00788
  24. Ian Goodfellow, Yoshua Bengio and Aaron Courville “Deep Learning” MIT Press, 2016 URL: http://www.deeplearningbook.org
  25. “Weight uncertainty in neural networks” In arXiv, 2015 DOI: 10.48550/arXiv.1505.05424
  26. Firas Bayram, Bestoun S. Ahmed and Andreas Kassler “From concept drift to model degradation: An overview on performance-aware drift detectors” In Knowledge-Based Systems 245, 2022, pp. 108632 DOI: 10.1016/j.knosys.2022.108632
  27. Daniel Kurz, Cristina De Luca and Jurgen Pilz “Monitoring virtual metrology reliability in a sampling decision system” In 2013 IEEE International Conference on Automation Science and Engineering (CASE) Madison, WI, USA: IEEE, 2013, pp. 20–25 DOI: 10.1109/CoASE.2013.6653949
  28. Franko Schmähling, Jörg Martin and Clemens Elster “A framework for benchmarking uncertainty in deep regression” In Applied Intelligence 53.8, 2023, pp. 9499–9512 DOI: 10.1007/s10489-022-03908-3
  29. Anastasios N. Angelopoulos and Stephen Bates “A Gentle Introduction to Conformal Prediction and Distribution-Free Uncertainty Quantification” arXiv:2107.07511 [cs, math, stat] arXiv, 2022 DOI: 10.48550/arXiv.2107.07511
  30. “Metrologically interpretable feature extraction for industrial machine vision using generative deep learning” In CIRP Annals 71.1, 2022, pp. 433–436 DOI: 10.1016/j.cirp.2022.03.016
  31. ISO 9000 “Quality management systems - Fundamentals and vocabulary”, 2015 DOI: 10.31030/2325650
  32. “Uncertainty quantification using Bayesian neural networks in classification: Application to ischemic stroke lesion segmentation” In Medical Imaging with Deep Learning, 2018, pp. 13 URL: https://openreview.net/forum?id=Sk_P2Q9sG
  33. Christopher Bishop “Pattern recognition and machine learning” Springer New York, 2006
Citations (1)

Summary

We haven't generated a summary for this paper yet.