2000 character limit reached
GABIC: Graph-based Attention Block for Image Compression (2410.02981v1)
Published 3 Oct 2024 in eess.IV, cs.CV, and cs.LG
Abstract: While standardized codecs like JPEG and HEVC-intra represent the industry standard in image compression, neural Learned Image Compression (LIC) codecs represent a promising alternative. In detail, integrating attention mechanisms from Vision Transformers into LIC models has shown improved compression efficiency. However, extra efficiency often comes at the cost of aggregating redundant features. This work proposes a Graph-based Attention Block for Image Compression (GABIC), a method to reduce feature redundancy based on a k-Nearest Neighbors enhanced attention mechanism. Our experiments show that GABIC outperforms comparable methods, particularly at high bit rates, enhancing compression performance.
- Gregory K Wallace, “The JPEG still picture compression standard,” CACM, 1991.
- Bellard Fabrice, “BPG image format,” 2014.
- Benjamin Bross et al., “Overview of the versatile video coding (VVC) standard and its applications,” IEEE TCSVT, 2021.
- Johannes Ballé et al., “End-to-end optimized image compression,” in ICLR, 2017.
- Johannes Ballé et al., “Variational image compression with a scale hyperprior,” in ICLR, 2018.
- “Joint autoregressive and hierarchical priors for learned image compression,” NeurIPS, 2018.
- Zhengxue Cheng et al., “Learned image compression with discretized gaussian mixture likelihoods and attention modules,” in CVPR, 2020.
- “The devil is in the details: Window-based attention for image compression,” in CVPR, 2022.
- “Density modeling of images using a generalized normalization transformation,” in ICLR, 2016.
- “Learned image compression with mixed transformer-CNN architectures,” in CVPR, 2023.
- Ze Liu et al., “Swin transformer: Hierarchical vision transformer using shifted windows,” in ICCV, 2021.
- Petar Veličković et al., “Graph attention networks,” in ICLR, 2018.
- Siwei Ma et al., “Image and video compression with neural networks: A review,” IEEE TCSVT, 2019.
- Alberto Presta et al., “A differentiable entropy model for learned image compression,” in ICIAP, 2023.
- “Channel-wise autoregressive entropy models for learned image compression,” in ICIP, 2020.
- “Enhanced invertible encoding for learned image compression,” in ACMMM, 2021.
- Chunhui Yang et al., “Graph-convolution network for image compression,” in ICIP, 2021.
- Lei Zhou et al., “End-to-end optimized image compression with attention mechanism,” in CVPR Workshops, 2019.
- Haojie Liu et al., “Non-local attention optimized deep image compression,” ArXiv, 2019.
- “Semi-supervised classification with graph convolutional networks,” in ICLR, 2017.
- “Vision GNN: An image is worth graph of nodes,” NeurIPS, 2022.
- Yan Han et al., “Vision HGNN: An image is more than a graph of nodes,” in ICCV, 2023.
- Jhony H. Giraldo et al., “Hypergraph convolutional networks for weakly-supervised semantic segmentation,” in ICIP, 2022.
- Alexey Dosovitskiy et al., “An image is worth 16x16 words: Transformers for image recognition at scale,” in ICLR, 2021.
- Justin Gilmer et al., “Neural message passing for quantum chemistry,” in ICML, 2017.
- Xiaolong Wang et al., “Non-local neural networks,” in CVPR, 2018.
- Jean Bégaint et al., “CompressAI: a PyTorch library and evaluation platform for end-to-end compression research,” arXiv, 2020.
- “Fast graph representation learning with PyTorch Geometric,” in ICLR Workshops, 2019.
- Ivan Krasin et al., “OpenImages: A public dataset for large-scale multi-label and multi-class image classification.,” Dataset available from https://github.com/openimages, 2016.
- “Adam: A method for stochastic optimization,” in ICLR, 2015.
- Eastman Kodak, “Kodak lossless true color image suite (photocd pcd0992),” 1993, http://r0k.us/graphics/kodak/.
- “Workshop and challenge on learned image compression,” 2020, https://www.compression.cc/.
