Noise-NeRF: Hide Information in Neural Radiance Fields using Trainable Noise (2401.01216v2)
Abstract: Neural Radiance Field (NeRF) has been proposed as an innovative advancement in 3D reconstruction techniques. However, little research has been conducted on the issues of information confidentiality and security to NeRF, such as steganography. Existing NeRF steganography solutions have shortcomings in low steganography quality, model weight damage, and limited amount of steganographic information. This paper proposes Noise-NeRF, a novel NeRF steganography method employing Adaptive Pixel Selection strategy and Pixel Perturbation strategy to improve the quality and efficiency of steganography via trainable noise. Extensive experiments validate the state-of-the-art performances of Noise-NeRF on both steganography quality and rendering quality, as well as effectiveness in super-resolution image steganography.
- “Nerfstudio: A modular framework for neural radiance field development,” in ACM SIGGRAPH 2023 Conference Proceedings, 2023, pp. 1–12.
- “Mip-nerf 360: Unbounded anti-aliased neural radiance fields,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022, pp. 5470–5479.
- “Seathru-nerf: Neural radiance fields in scattering media,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023, pp. 56–65.
- “Targeted adversarial attacks on generalizable neural radiance fields,” in Proceedings of the IEEE/CVF International Conference on Computer Vision, 2023, pp. 3718–3727.
- “Copyrnerf: Protecting the copyright of neural radiance fields,” in Proceedings of the IEEE/CVF International Conference on Computer Vision, 2023, pp. 22401–22411.
- “Steganerf: Embedding invisible information within neural radiance fields,” in Proceedings of the IEEE/CVF International Conference on Computer Vision, 2023, pp. 441–453.
- “Nerf: Representing scenes as neural radiance fields for view synthesis,” Communications of the ACM, vol. 65, pp. 99–106, 2021.
- “Tensorf: Tensorial radiance fields,” in Proceedings of the European Conference on Computer Vision (ECCV), 2022.
- “Plenoxels: Radiance fields without neural networks,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022, pp. 5501–5510.
- “Instant neural graphics primitives with a multiresolution hash encoding,” ACM Transactions on Graphics (ToG), vol. 41, pp. 1–15, 2022.
- “Sine: Semantic-driven image-based nerf editing with prior-guided editing field,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023, pp. 20919–20929.
- “General neural gauge fields,” in Proceedings of the International Conference on Learning Representations (ICLR), 2023.
- “Local 3d editing via 3d distillation of clip knowledge,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023, pp. 12674–12684.
- “pixelnerf: Neural radiance fields from one or few images,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2021, pp. 4578–4587.
- “Ibrnet: Learning multi-view image-based rendering,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2021, pp. 4690–4699.
- “Rodin: A generative model for sculpting 3d digital avatars using diffusion,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023, pp. 4563–4573.
- “Neo 360: Neural fields for sparse view synthesis of outdoor scenes,” in Proceedings of the IEEE/CVF International Conference on Computer Vision, 2023, pp. 9187–9198.
- “Switch-nerf: Learning scene decomposition with mixture of experts for large-scale neural radiance fields,” in Proceedings of the International Conference on Learning Representations (ICLR), 2023.
- “Block-nerf: Scalable large scene neural view synthesis,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022, pp. 8248–8258.
- ,” https://lumalabs.ai/.
- “Spread spectrum image steganography,” IEEE Transactions on image processing, pp. 1075–1083, 1999.
- “Reliable detection of lsb steganography based on the difference image histogram,” in Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003.(ICASSP’03)., 2003, pp. III–545.
- “Edge adaptive image steganography based on lsb matching revisited,” IEEE Transactions on information forensics and security, pp. 201–214, 2010.
- “Inverted lsb image steganography using adaptive pattern to improve imperceptibility,” Journal of King Saud University-Computer and Information Sciences, pp. 3559–3568, 2022.
- “Hidden: Hiding data with deep networks,” in Proceedings of the European Conference on computer vision (ECCV), 2018, pp. 657–672.
- Shumeet Baluja, “Hiding images in plain sight: Deep steganography,” Advances in neural information processing systems, vol. 30, 2017.
- Baluja, “Hiding images within images,” IEEE Transactions on Pattern Analysis and machine intelligence, pp. 1685–1697, 2019.
- “Octnet: Learning deep 3d representations at high resolutions,” in Proceedings of the IEEE conference on computer vision and pattern recognition, 2017, pp. 3577–3586.
- “Robust mesh watermarking,” in Proceedings of the 26th annual conference on Computer graphics and interactive techniques, 1999, pp. 49–56.
- “Gaussian model for 3d mesh steganography,” IEEE Signal Processing Letters, vol. 28, pp. 1729–1733, 2021.
- “Embedding novel views in a single jpeg image,” in Proceedings of the IEEE/CVF International Conference on Computer Vision, 2021, pp. 14519–14527.
- “Distributionally adversarial attack,” in Proceedings of the AAAI Conference on Artificial Intelligence, 2019, pp. 2253–2260.
- “Towards deep learning models resistant to adversarial attacks,” arXiv preprint arXiv:1706.06083, 2017.
- “Towards evaluating the robustness of neural networks,” in 2017 IEEE symposium on security and privacy (sp), 2017, pp. 39–57.
- “Attention is all you need,” Advances in neural information processing systems, vol. 30, 2017.
- “Towards query-efficient adversarial attacks against automatic speech recognition systems,” IEEE Transactions on Information Forensics and Security, pp. 896–908, 2020.
- “Local light field fusion: Practical view synthesis with prescriptive sampling guidelines,” ACM Transactions on Graphics (TOG), pp. 1–14, 2019.
- “Imagenet: A large-scale hierarchical image database,” in 2009 IEEE conference on computer vision and pattern recognition. Ieee, 2009, pp. 248–255.
- “Ntire 2017 challenge on single image super-resolution: Dataset and study,” in Proceedings of the IEEE conference on computer vision and pattern recognition workshops, 2017, pp. 126–135.
- “Recovering realistic texture in image super-resolution by deep spatial feature transform,” in Proceedings of the IEEE conference on computer vision and pattern recognition, 2018, pp. 606–615.
- “A style-based generator architecture for generative adversarial networks,” in Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2019, pp. 4401–4410.
- “Progressive growing of gans for improved quality, stability, and variation,” arXiv preprint arXiv:1710.10196, 2017.
- “Detecting lsb steganography in color, and gray-scale images,” IEEE multimedia, pp. 22–28, 2001.