Papers
Topics
Authors
Recent
Search
2000 character limit reached

Uncertainty-guided Contrastive Learning for Single Source Domain Generalisation

Published 12 Mar 2024 in cs.CV | (2403.07514v2)

Abstract: In the context of single domain generalisation, the objective is for models that have been exclusively trained on data from a single domain to demonstrate strong performance when confronted with various unfamiliar domains. In this paper, we introduce a novel model referred to as Contrastive Uncertainty Domain Generalisation Network (CUDGNet). The key idea is to augment the source capacity in both input and label spaces through the fictitious domain generator and jointly learn the domain invariant representation of each class through contrastive learning. Extensive experiments on two Single Source Domain Generalisation (SSDG) datasets demonstrate the effectiveness of our approach, which surpasses the state-of-the-art single-DG methods by up to $7.08\%$. Our method also provides efficient uncertainty estimation at inference time from a single forward pass through the generator subnetwork.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (64)
  1. “Progressive domain expansion network for single domain generalization,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2021, pp. 224–233.
  2. “Learning to diversify for single domain generalization,” in Proceedings of the IEEE/CVF International Conference on Computer Vision, 2021, pp. 834–843.
  3. “Domain generalization by solving jigsaw puzzles,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2019, pp. 2229–2238.
  4. “Meta convolutional neural networks for single domain generalization,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022, pp. 4682–4691.
  5. “Learning to learn single domain generalization,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2020, pp. 12556–12565.
  6. “Robust and generalizable visual representation learning via random convolutions,” ICLR, 2021.
  7. “Out-of-domain generalization from a single source: An uncertainty quantification approach,” IEEE Transactions on Pattern Analysis and Machine Intelligence, 2022.
  8. “Pre-training without natural images,” International Journal of Computer Vision, vol. 130, no. 4, pp. 990–1007, 2022.
  9. “Exact histogram specification,” IEEE Transactions on Image processing, vol. 15, no. 5, pp. 1143–1152, 2006.
  10. “Fast algorithms for histogram matching: Application to texture synthesis,” Journal of Electronic Imaging, vol. 9, no. 1, pp. 39–45, 2000.
  11. “Exact feature distribution matching for arbitrary style transfer and domain generalization,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022, pp. 8035–8045.
  12. “Exploring simple siamese representation learning,” in Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2021, pp. 15750–15758.
  13. “mixup: Beyond empirical risk minimization,” arXiv preprint arXiv:1710.09412, 2017.
  14. “Generalizing to unseen domains via adversarial data augmentation,” Advances in neural information processing systems, vol. 31, 2018.
  15. Fengchun Qiao and Xi Peng, “Uncertainty-guided model generalization to unseen domains,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), June 2021, pp. 6790–6800.
  16. “Weight uncertainty in neural network,” in International conference on machine learning. PMLR, 2015, pp. 1613–1622.
  17. “Representation learning with contrastive predictive coding,” arXiv preprint arXiv:1807.03748, 2018.
  18. “Benchmarking neural network robustness to common corruptions and perturbations,” ICLR, 2019.
  19. “Deeper, broader and artier domain generalization,” in Proceedings of the IEEE international conference on computer vision, 2017, pp. 5542–5550.
  20. “Ai-enabled analysis of 3-d ct scans for diagnosis of covid-19 & its severity,” in 2023 IEEE International Conference on Acoustics, Speech, and Signal Processing Workshops (ICASSPW). IEEE, 2023, p. 1–5.
  21. “Btdnet: A multi-modal approach for brain tumor radiogenomic classification,” Applied Sciences, vol. 13, no. 21, pp. 11984, 2023.
  22. “Facernet: a facial expression intensity estimation network,” arXiv preprint arXiv:2303.00180, 2023.
  23. Dimitrios Kollias, “Multi-label compound expression recognition: C-expr database & network,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023, pp. 5589–5598.
  24. “A deep neural architecture for harmonizing 3-d input data analysis and decision making in medical imaging,” Neurocomputing, vol. 542, pp. 126244, 2023.
  25. “Ai-mia: Covid-19 detection & severity analysis through medical imaging,” arXiv preprint arXiv:2206.04732, 2022.
  26. “A large imaging database and novel deep neural architecture for covid-19 diagnosis,” in 2022 IEEE 14th Image, Video, and Multidimensional Signal Processing Workshop (IVMSP). IEEE, 2022, p. 1–5.
  27. “Mia-cov19d: Covid-19 detection through 3-d chest ct image analysis,” in Proceedings of the IEEE/CVF International Conference on Computer Vision, 2021, p. 537–544.
  28. “Deep transparent prediction through latent representation analysis,” arXiv preprint arXiv:2009.07044, 2020.
  29. “Transparent adaptation in deep medical image diagnosis.,” in TAILOR, 2020, p. 251–267.
  30. “Distribution matching for multi-task learning of classification tasks: a large-scale study on faces & beyond,” arXiv preprint arXiv:2401.01219, 2024.
  31. “Medical image segmentation: A review of modern architectures,” in Computer Vision–ECCV 2022 Workshops: Tel Aviv, Israel, October 23–27, 2022, Proceedings, Part VII. Springer, 2023, pp. 691–708.
  32. “Interweaving deep learning and semantic techniques for emotion analysis in human-machine interaction,” in 2015 10th International Workshop on Semantic and Social Media Adaptation and Personalization (SMAP). IEEE, 2015, pp. 1–6.
  33. “Va-stargan: Continuous affect generation,” in International Conference on Advanced Concepts for Intelligent Vision Systems. Springer, 2020, pp. 227–238.
  34. “On line emotion detection using retrainable deep neural networks,” in Computational Intelligence (SSCI), 2016 IEEE Symposium Series on. IEEE, 2016, pp. 1–8.
  35. “Photorealistic facial synthesis in the dimensional affect space,” in European Conference on Computer Vision. Springer, 2018, pp. 475–491.
  36. “A multi-task learning & generation framework: Valence-arousal, action units & primary expressions,” arXiv preprint arXiv:1811.07771, 2018.
  37. “Aff-wild2: Extending the aff-wild database for affect recognition,” arXiv preprint arXiv:1811.07770, 2018.
  38. “Training deep neural networks with different datasets in-the-wild: The emotion recognition paradigm,” in 2018 International Joint Conference on Neural Networks (IJCNN). IEEE, 2018, pp. 1–8.
  39. “Assessment of parkinson’s disease based on deep neural networks,” in International Conference on Engineering Applications of Neural Networks. Springer, 2017, pp. 391–403.
  40. “Machine learning for neurodegenerative disorder diagnosis—survey of practices and launch of benchmark dataset,” International Journal on Artificial Intelligence Tools, vol. 27, no. 03, pp. 1850011, 2018.
  41. “Adaptation and contextualization of deep neural network models,” in Computational Intelligence (SSCI), 2017 IEEE Symposium Series on. IEEE, 2017, pp. 1–8.
  42. “Deep neural network augmentation: Generating faces for affect analysis,” International Journal of Computer Vision, pp. 1–30, 2020.
  43. “Exploiting multi-cnn features in cnn-rnn based dimensional emotion recognition on the omg in-the-wild dataset,” IEEE Transactions on Affective Computing, 2020.
  44. “Aff-wild: Valence and arousal ‘in-the-wild’challenge,” in Computer Vision and Pattern Recognition Workshops (CVPRW), 2017 IEEE Conference on. IEEE, 2017, pp. 1980–1987.
  45. “Recognition of affect in the wild using deep neural networks,” in Computer Vision and Pattern Recognition Workshops (CVPRW), 2017 IEEE Conference on. IEEE, 2017, pp. 1972–1979.
  46. “Mixaugment & mixup: Augmentation methods for facial expression recognition,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022, pp. 2367–2375.
  47. “Expression, affect, action unit recognition: Aff-wild2, multi-task learning and arcface,” arXiv preprint arXiv:1910.04855, 2019.
  48. “Analysing affective behavior in the first abaw 2020 competition,” in 2020 15th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2020)(FG). IEEE Computer Society, 2020, pp. 794–800.
  49. “Analysing affective behavior in the second abaw2 competition,” in Proceedings of the IEEE/CVF International Conference on Computer Vision, 2021, pp. 3652–3660.
  50. “Affect analysis in-the-wild: Valence-arousal, expressions, action units and a unified framework,” arXiv preprint arXiv:2103.15792, 2021.
  51. “Distribution matching for heterogeneous multi-task learning: a large-scale face study,” arXiv preprint arXiv:2105.03790, 2021.
  52. Dimitrios Kollias, “Abaw: Valence-arousal estimation, expression recognition, action unit detection & multi-task learning challenges,” arXiv preprint arXiv:2202.10659, 2022.
  53. Dimitrios Kollias, “Abaw: Learning from synthetic data & multi-task learning challenges,” in European Conference on Computer Vision. Springer, 2023, pp. 157–172.
  54. “Face behavior a la carte: Expressions, affect and action units in a single network,” arXiv preprint arXiv:1910.11111, 2019.
  55. “Abaw: Valence-arousal estimation, expression recognition, action unit detection & emotional reaction intensity estimation challenges,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023, pp. 5888–5897.
  56. “Deep affect prediction in-the-wild: Aff-wild database and challenge, deep architectures, and beyond,” International Journal of Computer Vision, vol. 127, no. 6-7, pp. 907–929, 2019.
  57. “Domain adaptation, explainability & fairness in ai for medical image analysis: Diagnosis of covid-19 based on 3-d chest ct-scans,” arXiv preprint arXiv:2403.02192, 2024.
  58. “The 6th affective behavior analysis in-the-wild (abaw) competition,” arXiv preprint arXiv:2402.19344, 2024.
  59. “Deep neural architectures for prediction in healthcare,” Complex & Intelligent Systems, vol. 4, no. 2, pp. 119–131, 2018.
  60. “Data-driven covid-19 detection through medical imaging,” in 2023 IEEE International Conference on Acoustics, Speech, and Signal Processing Workshops (ICASSPW). IEEE, 2023, pp. 1–5.
  61. “Covid-19 computer-aided diagnosis through ai-assisted ct imaging analysis: Deploying a medical ai system,” 2024.
  62. “Wide residual networks,” arXiv preprint arXiv:1605.07146, 2016.
  63. “Imagenet classification with deep convolutional neural networks,” Advances in neural information processing systems, vol. 25, 2012.
  64. “Improving diversity with adversarially learned transformations for domain generalization,” in Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, 2023, pp. 434–443.
Citations (13)
View on Semantic Scholar

Summary

No one has generated a summary of this paper yet.

Sign Up to Summarize

Paper to Video (Beta)

No one has generated a video about this paper yet.

Sign Up to Generate All Videos Subscribe on YouTube

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Sign Up to Generate

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Generate Now

Continue Learning

We haven't generated follow-up questions for this paper yet.

Generate Now

Collections

Sign up for free to add this paper to one or more collections.

Sign Up