Papers
Topics
Authors
Recent
Search
2000 character limit reached

Trusted Multi-view Learning with Label Noise

Published 18 Apr 2024 in cs.LG | (2404.11944v2)

Abstract: Multi-view learning methods often focus on improving decision accuracy while neglecting the decision uncertainty, which significantly restricts their applications in safety-critical applications. To address this issue, researchers propose trusted multi-view methods that learn the class distribution for each instance, enabling the estimation of classification probabilities and uncertainty. However, these methods heavily rely on high-quality ground-truth labels. This motivates us to delve into a new generalized trusted multi-view learning problem: how to develop a reliable multi-view learning model under the guidance of noisy labels? We propose a trusted multi-view noise refining method to solve this problem. We first construct view-opinions using evidential deep neural networks, which consist of belief mass vectors and uncertainty estimates. Subsequently, we design view-specific noise correlation matrices that transform the original opinions into noisy opinions aligned with the noisy labels. Considering label noises originating from low-quality data features and easily-confused classes, we ensure that the diagonal elements of these matrices are inversely proportional to the uncertainty, while incorporating class relations into the off-diagonal elements. Finally, we aggregate the noisy opinions and employ a generalized maximum likelihood loss on the aggregated opinion for model training, guided by the noisy labels. We empirically compare TMNR with state-of-the-art trusted multi-view learning and label noise learning baselines on 5 publicly available datasets. Experiment results show that TMNR outperforms baseline methods on accuracy, reliability and robustness. The code and appendix are released at https://github.com/YilinZhang107/TMNR.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (27)
  1. Confidence scores make instance-dependent label-noise learning possible. In International conference on machine learning, pages 825–836. PMLR, 2021.
  2. Learning with instance-dependent label noise: A sample sieve approach. In International Conference on Learning Representations, 2020.
  3. Instance-dependent label-noise learning with manifold-regularized transition matrix estimation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 16630–16639, 2022.
  4. Uncertainty estimation by fisher information-based evidential deep learning. In Proceedings of the 40th International Conference on Machine Learning, ICML’23. JMLR.org, 2023.
  5. Dropout as a bayesian approximation: Representing model uncertainty in deep learning. In Proceedings of the 33rd International Conference on International Conference on Machine Learning - Volume 48, ICML’16, page 1050–1059. JMLR.org, 2016.
  6. Brain functional connectivity analysis based on multi-graph fusion. Medical image analysis, 71:102057, 2021.
  7. Trusted multi-view classification. In International Conference on Learning Representations, 2020.
  8. Trusted multi-view classification with dynamic evidential fusion. IEEE transactions on pattern analysis and machine intelligence, 45(2):2551–2566, 2022.
  9. Using trusted data to train deep networks on labels corrupted by severe noise. Advances in neural information processing systems, 31, 2018.
  10. Multi-view subspace clustering by joint measuring of consistency and diversity. IEEE Transactions on Knowledge and Data Engineering, 2022.
  11. Multi-view clustering for fast intra mode decision in hevc. In 2020 IEEE International Conference on Consumer Electronics (ICCE), pages 1–4. IEEE, 2020.
  12. Audun Jøsang. Subjective logic: A formalism for reasoning under uncertainty. Springer, 2016.
  13. Af: An association-based fusion method for multi-modal classification. IEEE Transactions on Pattern Analysis and Machine Intelligence, 44(12):9236–9254, 2021.
  14. Dual contrastive prediction for incomplete multi-view representation learning. IEEE Transactions on Pattern Analysis and Machine Intelligence, 45(4):4447–4461, 2022.
  15. Contrastive intra-and inter-modality generation for enhancing incomplete multimedia recommendation. In Proceedings of the 31st ACM International Conference on Multimedia, pages 6234–6242, 2023.
  16. Trusted multi-view deep learning with opinion aggregation. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 36, pages 7585–7593, 2022.
  17. Recent advances in natural language processing via large pre-trained language models: A survey. ACM Computing Surveys, 56(2):1–40, 2023.
  18. Berters: Multimodal representation learning for expert recommendation system with transformer. arXiv preprint arXiv:2007.07229, 2020.
  19. Making deep neural networks robust to label noise: A loss correction approach. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 1944–1952, 2017.
  20. Deep evidential learning with noisy correspondence for cross-modal retrieval. In Proceedings of the 30th ACM International Conference on Multimedia, pages 4948–4956, 2022.
  21. Evidential deep learning to quantify classification uncertainty. Advances in neural information processing systems, 31, 2018.
  22. On deep multi-view representation learning. In International conference on machine learning, pages 1083–1092. PMLR, 2015.
  23. Exploring and exploiting uncertainty for incomplete multi-view classification. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 19873–19882, 2023.
  24. Multi-modal sequence learning for alzheimer’s disease progression prediction with incomplete variable-length longitudinal data. Medical Image Analysis, 82:102643, 2022.
  25. Untie: Clustering analysis with disentanglement in multi-view information fusion. Information Fusion, 100:101937, 2023.
  26. Reliable conflictive multi-view learning. In Proceedings of the AAAI Conference on Artificial Intelligence, 2024.
  27. Calm: An enhanced encoding and confidence evaluating framework for trustworthy multi-view learning. In Proceedings of the 31st ACM International Conference on Multimedia, pages 3108–3116, 2023.
Citations (1)

Summary

Paper to Video (Beta)

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Continue Learning

We haven't generated follow-up questions for this paper yet.

Authors (4)

Collections

Sign up for free to add this paper to one or more collections.

Tweets

Sign up for free to view the 1 tweet with 0 likes about this paper.