2000 character limit reached
Uncertainty Quantification using Generative Approach
Published 13 Oct 2023 in cs.LG and cs.AI | (2310.09338v1)
Abstract: We present the Incremental Generative Monte Carlo (IGMC) method, designed to measure uncertainty in deep neural networks using deep generative approaches. IGMC iteratively trains generative models, adding their output to the dataset, to compute the posterior distribution of the expectation of a random variable. We provide a theoretical guarantee of the convergence rate of IGMC relative to the sample size and sampling depth. Due to its compatibility with deep generative approaches, IGMC is adaptable to both neural network classification and regression tasks. We empirically study the behavior of IGMC on the MNIST digit classification task.
- Test-time data augmentation for estimation of heteroscedastic aleatoric uncertainty in deep neural networks. In International conference on Medical Imaging with Deep Learning, 2018.
- Efficient exploration through bayesian deep q-networks. CoRR, abs/1802.04412, 2018.
- Unifying count-based exploration and intrinsic motivation. In Proceedings of the 30th International Conference on Neural Information Processing Systems, NIPS’16, page 1479–1487, Red Hook, NY, USA, 2016. Curran Associates Inc. ISBN 9781510838819.
- Weight uncertainty in neural networks. In Proceedings of the 32nd International Conference on International Conference on Machine Learning - Volume 37, ICML’15, page 1613–1622. JMLR.org, 2015.
- Gaussian yolov3: An accurate and fast object detector using localization uncertainty for autonomous driving. In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), October 2019.
- Emnist: an extension of mnist to handwritten letters, 2017.
- Li Deng. The mnist database of handwritten digit images for machine learning research. IEEE Signal Processing Magazine, 29(6):141–142, 2012.
- Towards safe autonomous driving: Capture uncertainty in the deep neural network for lidar 3d vehicle detection. In 2018 21st International Conference on Intelligent Transportation Systems (ITSC), pages 3266–3273, 2018.
- Dropout as a bayesian approximation: Representing model uncertainty in deep learning. Proceedings of The 33rd International Conference on Machine Learning, 06 2015.
- Deep bayesian active learning with image data. 03 2017.
- Generative adversarial networks, 2014.
- A baseline for detecting misclassified and out-of-distribution examples in neural networks. 10 2016.
- Denoising diffusion probabilistic models. arXiv preprint arxiv:2006.11239, 2020.
- Aleatoric and epistemic uncertainty in machine learning: an introduction to concepts and methods. Machine Learning, 110, 03 2021.
- Improving medical images classification with label noise using dual-uncertainty estimation. IEEE Transactions on Medical Imaging, PP:1–1, 01 2022.
- Auto-encoding variational bayes, 2022.
- Simple and scalable predictive uncertainty estimation using deep ensembles. In Proceedings of the 31st International Conference on Neural Information Processing Systems, NIPS’17, page 6405–6416, Red Hook, NY, USA, 2017. Curran Associates Inc. ISBN 9781510860964.
- Deep learning. Nature, 521:436–44, 05 2015.
- Training confidence-calibrated classifiers for detecting out-of-distribution samples. 11 2017.
- Uncertainty-aware self-training for few-shot text classification. In NeurIPS 2020 (Spotlight). ACM, December 2020.
- Exploring uncertainty measures in deep networks for multiple sclerosis lesion detection and segmentation. Medical Image Analysis, 59:101557, 2020. ISSN 1361-8415.
- Classification uncertainty of deep neural networks based on gradient information. In Luca Pancioni, Friedhelm Schwenker, and Edmondo Trentin, editors, Artificial Neural Networks in Pattern Recognition, pages 113–125, Cham, 2018. Springer International Publishing. ISBN 978-3-319-99978-4.
- Bayesian quicknat: Model uncertainty in deep whole-brain segmentation for structure-wise quality control. NeuroImage, 195:11–22, 2019. ISSN 1053-8119.
- Exploiting epistemic uncertainty of anatomy segmentation for anomaly detection in retinal oct. IEEE Transactions on Medical Imaging, PP:1–1, 05 2019.
- Evidential deep learning to quantify classification uncertainty. In Proceedings of the 32nd International Conference on Neural Information Processing Systems, NIPS’18, page 3183–3193, Red Hook, NY, USA, 2018. Curran Associates Inc.
- Dominik Seuß. Bridging the gap between explainable ai and uncertainty quantification to enhance trustability. 05 2021.
- Active learning for sequence tagging with deep pre-trained models and Bayesian uncertainty estimates. In Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Main Volume, pages 1698–1712, Online, April 2021. Association for Computational Linguistics.
- Matias Valdenegro-Toro. Deep sub-ensembles for fast uncertainty estimation in image classification. arXiv preprint arXiv:1910.08168, 2019.
- Aleatoric uncertainty estimation with test-time augmentation for medical image segmentation with convolutional neural networks. Neurocomputing, 338:34–45, 2019. ISSN 0925-2312.
- Uncertainty-aware few-shot image classification. In International Joint Conference on Artificial Intelligence (IJCAI 2021), June 2021.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.