Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
139 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
46 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Pre-capture Privacy via Adaptive Single-Pixel Imaging (2407.00991v1)

Published 1 Jul 2024 in eess.IV

Abstract: As cameras become ubiquitous in our living environment, invasion of privacy is becoming a growing concern. A common approach to privacy preservation is to remove personally identifiable information from a captured image, but there is a risk of the original image being leaked. In this paper, we propose a pre-capture privacy-aware imaging method that captures images from which the details of a pre-specified anonymized target have been eliminated. The proposed method applies a single-pixel imaging framework in which we introduce a feedback mechanism called an aperture pattern generator. The introduced aperture pattern generator adaptively outputs the next aperture pattern to avoid sampling the anonymized target by exploiting the data already acquired as a clue. Furthermore, the anonymized target can be set to any object without changing hardware. Except for detailed features which have been removed from the anonymized target, the captured images are of comparable quality to those captured by a general camera and can be used for various computer vision applications. In our work, we target faces and license plates and experimentally show that the proposed method can capture clear images in which detailed features of the anonymized target are eliminated to achieve both privacy and utility.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (40)
  1. Ntire 2017 challenge on single image super-resolution: Dataset and study. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 2017.
  2. Contour detection and hierarchical image segmentation. IEEE Transactions on pattern analysis and machine intelligence, 33(5):898–916, 2011.
  3. Flatcam: Thin, lensless cameras using coded aperture and computation. IEEE Transactions on Computational Imaging, 3(3):384–397, 2016.
  4. Learning rich optical embeddings for privacy-preserving lensless image classification. arXiv preprint arXiv:2206.01429, 2022.
  5. Distributed optimization and statistical learning via the alternating direction method of multipliers. Foundations and Trends® in Machine learning, 3(1):1–122, 2011.
  6. An introduction to compressive sampling. IEEE signal processing magazine, 25(2):21–30, 2008.
  7. Image denoising by sparse 3-d transform-domain collaborative filtering. IEEE Transactions on image processing, 16(8):2080–2095, 2007.
  8. Arcface: Additive angular margin loss for deep face recognition. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2019.
  9. Fine-grained face verification: Fglfw database, baselines, and human-dcmn partnership. Pattern Recognition, 66:63–73, 2017.
  10. Single-pixel imaging via compressive sampling. IEEE Signal Processing Magazine, 25(2):83–91, 2008.
  11. Simultaneous real-time visible and infrared video with single-pixel detectors. Scientific reports, 5(1):10669, 2015.
  12. The PASCAL Visual Object Classes Challenge 2007 (VOC2007) Results. http://www.pascal-network.org/challenges/VOC/voc2007/workshop/index.html.
  13. Lu Gan. Block compressed sensing of natural images. In 2007 15th International conference on digital signal processing, pages 403–406. IEEE, 2007.
  14. Learning privacy-preserving optics for human pose estimation. In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), pages 2573–2582, 2021.
  15. Labeled faces in the wild: A database for studying face recognition in unconstrained environments. Technical Report 07-49, University of Massachusetts, Amherst, 2007.
  16. 25,000 fps computational ghost imaging with ultrafast structured illumination. Electronic Materials, 3(1):93–100, 2022.
  17. Compressed ultrahigh-speed single-pixel imaging by swept aggregate patterns. Nature Communications, 13(1):7879, 2022.
  18. 3D object representations for fine-grained categorization. In Proceedings of the IEEE/CVF International Conference on Computer Vision Workshops (ICCVW), pages 554–561, 2013.
  19. Maskgan: Towards diverse and interactive facial image manipulation. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2020.
  20. Deep learning face attributes in the wild. In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), 2015.
  21. Coded aperture compressive temporal imaging. Opt. Express, 21(9):10526–10545, 2013.
  22. AgeDB: The first manually collected, in-the-wild age database. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pages 1997–2005, 2017.
  23. Deep compressive sensing for visual privacy protection in flatcam imaging. In Proceedings of the IEEE/CVF International Conference on Computer Vision Workshops (ICCVW), pages 3978–3986, 2019.
  24. Privacy preserving optics for miniature vision sensors. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 07-12-June:314–324, 2015.
  25. Sensor-level privacy for thermal cameras. In 2016 IEEE International Conference on Computational Photography (ICCP), pages 1–12. IEEE, 2016.
  26. Faster r-cnn: Towards real-time object detection with region proposal networks. Advances in neural information processing systems, 28, 2015.
  27. U-net: Convolutional networks for biomedical image segmentation. In Medical Image Computing and Computer-Assisted Intervention - MICCAI, pages 234–241. Springer, 2015.
  28. Nonlinear total variation based noise removal algorithms. Physica D: nonlinear phenomena, 60(1-4):259–268, 1992.
  29. Facenet: A unified embedding for face recognition and clustering. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 815–823, 2015.
  30. Frontal to profile face verification in the wild. In IEEE Conference on Applications of Computer Vision, 2016.
  31. Hyperextended lightface: A facial attribute analysis framework. In 2021 International Conference on Engineering and Emerging Technologies (ICEET), pages 1–4. IEEE, 2021.
  32. License plate detection and recognition in unconstrained scenarios. In Proceedings of the European conference on computer vision (ECCV), pages 580–596, 2018.
  33. Performance comparison between total variation TV-based compressed sensing and statistical iterative reconstruction algorithms. Physics in Medicine & Biology, 54(19):5781, 2009.
  34. Learning phase mask for privacy-preserving passive depth estimation. In Proceedings of the European conference on computer vision (ECCV), pages 504–521. Springer, 2022.
  35. Plug-and-play priors for model based reconstruction. In 2013 IEEE Global Conference on Signal and Information Processing, pages 945–948. IEEE, 2013.
  36. Panini-net: Gan prior based degradation-aware feature interpolation for face restoration. In Proceedings of the AAAI Conference on Artificial Intelligence (AAAI), 2022.
  37. Privacy-preserving action recognition using coded aperture videos. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 2019.
  38. Admm-csnet: A deep learning approach for image compressive sensing. IEEE Transactions on Pattern Analysis and Machine Intelligence, 42(3):521–538, 2020.
  39. ISTA-Net: Interpretable optimization-inspired deep network for image compressive sensing. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 1828–1837, 2018.
  40. Anonymous camera for privacy protection. Proceedings of International Conference on Pattern Recognition (ICPR), pages 4170–4175, 2014.

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now