SSyncOA: Self-synchronizing Object-aligned Watermarking to Resist Cropping-paste Attacks (2405.03458v1)
Abstract: Modern image processing tools have made it easy for attackers to crop the region or object of interest in images and paste it into other images. The challenge this cropping-paste attack poses to the watermarking technology is that it breaks the synchronization of the image watermark, introducing multiple superimposed desynchronization distortions, such as rotation, scaling, and translation. However, current watermarking methods can only resist a single type of desynchronization and cannot be applied to protect the object's copyright under the cropping-paste attack. With the finding that the key to resisting the cropping-paste attack lies in robust features of the object to protect, this paper proposes a self-synchronizing object-aligned watermarking method, called SSyncOA. Specifically, we first constrain the watermarked region to be aligned with the protected object, and then synchronize the watermark's translation, rotation, and scaling distortions by normalizing the object invariant features, i.e., its centroid, principal orientation, and minimum bounding square, respectively. To make the watermark embedded in the protected object, we introduce the object-aligned watermarking model, which incorporates the real cropping-paste attack into the encoder-noise layer-decoder pipeline and is optimized end-to-end. Besides, we illustrate the effect of different desynchronization distortions on the watermark training, which confirms the necessity of the self-synchronization process. Extensive experiments demonstrate the superiority of our method over other SOTAs.
- “Hidden: Hiding data with deep networks,” in ECCV (15). 2018, vol. 11219 of Lecture Notes in Computer Science, pp. 682–697, Springer.
- “Watermarking images in self-supervised latent spaces,” in ICASSP. 2022, pp. 3054–3058, IEEE.
- “Stegastamp: Invisible hyperlinks in physical photographs,” in CVPR. 2020, pp. 2114–2123, Computer Vision Foundation / IEEE.
- “Learning invisible markers for hidden codes in offline-to-online photography,” in CVPR. 2022, pp. 2263–2272, IEEE.
- “Efficient general print-scanning resilient data hiding based on uniform log-polar mapping,” IEEE Trans. Inf. Forensics Secur., vol. 5, no. 1, pp. 1–12, 2010.
- “Affine legendre moment invariants for image watermarking robust to geometric distortions,” IEEE Trans. Image Process., vol. 20, no. 8, pp. 2189–2199, 2011.
- “MBRS: enhancing robustness of dnn-based watermarking by mini-batch of real and simulated JPEG compression,” in ACM Multimedia. 2021, pp. 41–49, ACM.
- “ARWGAN: attention-guided robust image watermarking model based on GAN,” IEEE Trans. Instrum. Meas., vol. 72, pp. 1–17, 2023.
- “Adaptor: Improving the robustness and imperceptibility of watermarking by the adaptive strength factor,” IEEE Transactions on Circuits and Systems for Video Technology, pp. 1–1, 2023.
- “Deep template-based watermarking,” IEEE Trans. Circuits Syst. Video Technol., vol. 31, no. 4, pp. 1436–1451, 2021.
- “Practical deep dispersed watermarking with synchronization and fusion,” in ACM Multimedia. 2023, pp. 7922–7932, ACM.
- “Self-synchronizing watermarking scheme for an arbitrarily shaped object,” Pattern Recognit., vol. 36, no. 11, pp. 2737–2741, 2003.
- “Robust object-based watermarking scheme via shape self-similarity segmentation,” Pattern Recognit. Lett., vol. 25, no. 15, pp. 1673–1680, 2004.
- “Geometrically invariant object-based watermarking using SIFT feature,” in ICIP (5). 2007, pp. 473–476, IEEE.
- “Object based watermarking for H.264/AVC video resistant to rst attacks,” Multim. Tools Appl., vol. 75, no. 6, pp. 3053–3080, 2016.
- “U-net: Convolutional networks for biomedical image segmentation,” in MICCAI (3). 2015, vol. 9351 of Lecture Notes in Computer Science, pp. 234–241, Springer.
- “The unreasonable effectiveness of deep features as a perceptual metric,” in CVPR. 2018, pp. 586–595, Computer Vision Foundation / IEEE Computer Society.
- “The lovász-softmax loss: A tractable surrogate for the optimization of the intersection-over-union measure in neural networks,” in CVPR. 2018, pp. 4413–4421, Computer Vision Foundation / IEEE Computer Society.
- “Learning to detect salient objects with image-level supervision,” in CVPR. 2017, pp. 3796–3805, IEEE Computer Society.
- “Rosteals: Robust steganography using autoencoder latent space,” in CVPR Workshops. 2023, pp. 933–942, IEEE.