Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
194 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
46 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Privacy-preserving Optics for Enhancing Protection in Face De-identification (2404.00777v1)

Published 31 Mar 2024 in cs.CV, cs.AI, cs.CR, cs.LG, and eess.IV

Abstract: The modern surge in camera usage alongside widespread computer vision technology applications poses significant privacy and security concerns. Current AI technologies aid in recognizing relevant events and assisting in daily tasks in homes, offices, hospitals, etc. The need to access or process personal information for these purposes raises privacy concerns. While software-level solutions like face de-identification provide a good privacy/utility trade-off, they present vulnerabilities to sniffing attacks. In this paper, we propose a hardware-level face de-identification method to solve this vulnerability. Specifically, our approach first learns an optical encoder along with a regression model to obtain a face heatmap while hiding the face identity from the source image. We also propose an anonymization framework that generates a new face using the privacy-preserving image, face heatmap, and a reference face image from a public dataset as input. We validate our approach with extensive simulations and hardware experiments.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (52)
  1. Person re-identification without identification via event anonymization. In IEEE International Conference on Computer Vision (ICCV), 2023.
  2. Optics lens design for privacy-preserving scene captioning. In IEEE International Conference on Image Processing (ICIP). IEEE, 2022.
  3. Attribute-preserving face dataset anonymization via latent code optimization. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2023.
  4. Principles of optics: electromagnetic theory of propagation, interference and diffraction of light. Elsevier, 2013.
  5. How far are we from solving the 2d & 3d face alignment problem? (and a dataset of 230,000 3d facial landmarks). In IEEE International Conference on Computer Vision (ICCV), 2017.
  6. Personalized and invertible face de-identification by disentangled identity information manipulation. In IEEE International Conference on Computer Vision (ICCV), 2021.
  7. Vggface2: A dataset for recognising faces across pose and age. In 13th IEEE international conference on automatic face & gesture recognition. IEEE, 2018.
  8. Stargan v2: Diverse image synthesis for multiple domains. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2020.
  9. Adam Geitgey. Face recognition. https://github.com/ageitgey/face_recognition, 2018.
  10. Joseph W Goodman. Introduction to Fourier optics. Macmillan Learning, 4 edition, 2017.
  11. Password-conditioned anonymization and deanonymization with face identity transformers. In European Conference on Computer Vision (ECCV). Springer, 2020.
  12. Learning privacy-preserving optics for human pose estimation. In IEEE International Conference on Computer Vision (ICCV), 2021.
  13. Privhar: Recognizing human actions from privacy-preserving lens. In European Conference on Computer Vision (ECCV). Springer, 2022.
  14. Deepprivacy: A generative adversarial network for face anonymization. In International symposium on visual computing. Springer, 2019.
  15. Dartblur: Privacy preservation with detection artifact suppression. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2023.
  16. Progressive growing of gans for improved quality, stability, and variation. arXiv preprint arXiv:1710.10196, 2017.
  17. A style-based generator architecture for generative adversarial networks. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2019.
  18. Analyzing and improving the image quality of stylegan. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2020.
  19. Denoising diffusion restoration models. Advances in Neural Information Processing Systems (NeurIPS), 2022.
  20. One millisecond face alignment with an ensemble of regression trees. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2014.
  21. Privacy-preserving action recognition via motion difference quantization. In European Conference on Computer Vision (ECCV). Springer, 2022.
  22. Zernike polynomials: a guide. Journal of Modern Optics, 2011.
  23. Riddle: Reversible and diversified de-identification with latent encryptor. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2023.
  24. Privacy intelligence: A survey on image privacy in online social networks. ACM Computing Surveys, 2022.
  25. Few-shot unsupervised image-to-image translation. In IEEE International Conference on Computer Vision (ICCV), 2019.
  26. An intriguing failing of convolutional neural networks and the coordconv solution. Advances in neural information processing systems (NeurIPS), 2018.
  27. Styleface: Towards identity-disentangled face generation on megapixels. In European Conference on Computer Vision (ECCV). Springer, 2022.
  28. Mode seeking generative adversarial networks for diverse image synthesis. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2019.
  29. Ciagan: Conditional identity anonymization generative adversarial networks. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2020a.
  30. Ciagan: Conditional identity anonymization generative adversarial networks. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2020b.
  31. Which training methods for GANs do actually converge? In the 35th International Conference on Machine Learning. PMLR, 2018.
  32. Stacked hourglass networks for human pose estimation. In Computer Vision–ECCV 2016: 14th European Conference. Proceedings, Part VIII 14. Springer, 2016.
  33. Connecting pixels to privacy and utility: Automatic redaction of private information in images. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2018.
  34. Privacy preserving optics for miniature vision sensors. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015.
  35. Pre-capture privacy for small vision sensors. IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2016.
  36. A review on visual privacy preservation techniques for active and assisted living. Multimedia Tools and Applications, 2023.
  37. Privacy-preserving human activity recognition from extreme low resolution. In AAAI conference on artificial intelligence, 2017.
  38. Extreme low resolution activity recognition with multi-siamese embedding learning. In AAAI conference on artificial intelligence, 2018.
  39. Facenet: A unified embedding for face recognition and clustering. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015.
  40. End-to-end optimization of optics and image processing for achromatic extended depth of field and super-resolution imaging. ACM Transactions on Graphics (TOG), 2018.
  41. Human pose estimation on privacy-preserving low-resolution depth images. In International conference on medical image computing and computer-assisted intervention (MICCAI). Springer, 2019.
  42. Learning phase mask for privacy-preserving passive depth estimation. In European Conference on Computer Vision (ECCV). Springer, 2022.
  43. Razvan Viorescu et al. 2018 reform of eu data protection rules. European Journal of Law and Public Administration, 2017.
  44. Mots: Multi-object tracking and segmentation. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2019.
  45. Infoscrub: Towards attribute privacy by targeted obfuscation. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2021.
  46. Deep optics for video snapshot compressive imaging. In IEEE International Conference on Computer Vision (ICCV), 2023.
  47. Adaptive wing loss for robust face alignment via heatmap regression. In The IEEE International Conference on Computer Vision (ICCV), 2019.
  48. Divide and conquer: a two-step method for high quality face de-identification with model explainability. In IEEE International Conference on Computer Vision (ICCV), 2023.
  49. Learning face representation from scratch. arXiv preprint arXiv:1411.7923, 2014.
  50. Joint face detection and alignment using multitask cascaded convolutional networks. IEEE signal processing letters, 2016.
  51. The unreasonable effectiveness of deep features as a perceptual metric. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2018.
  52. Visual content privacy protection: A survey. arXiv preprint arXiv:2303.16552, 2023.
Citations (2)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now