Process-and-Forward: Deep Joint Source-Channel Coding Over Cooperative Relay Networks (2403.10613v3)
Abstract: We introduce deep joint source-channel coding (DeepJSCC) schemes for image transmission over cooperative relay channels. The relay either amplifies-and-forwards its received signal, called DeepJSCC-AF, or leverages neural networks to extract relevant features from its received signal, called DeepJSCC-PF (Process-and-Forward). We consider both half- and full-duplex relays, and propose a novel transformer-based model at the relay. For a half-duplex relay, it is shown that the proposed scheme learns to generate correlated signals at the relay and source to obtain beamforming gains. In the full-duplex case, we introduce a novel block-based transmission strategy, in which the source transmits in blocks, and the relay updates its knowledge about the input signal after each block and generates its own signal. To enhance practicality, a single transformer-based model is used at the relay at each block, together with an adaptive transmission module, which allows the model to seamlessly adapt to different channel qualities and the transmission powers}. Simulation results demonstrate the superior performance of DeepJSCC-PF compared to the state-of-the-art BPG image compression algorithm operating at the maximum achievable rate of conventional decode-and-forward and compress-and-forward protocols, in both half- and full-duplex relay scenarios over AWGN and Rayleigh fading channels.
- “Deep joint source-channel coding over cooperative relay networks,” in IEEE International Conference on Machine Learning for Communication and Networking, 2024.
- “User cooperation diversity. Part I. system description,” IEEE Transactions on Communications, vol. 51, no. 11, pp. 1927–1938, 2003.
- T. Cover and A.E. Gamal, “Capacity theorems for the relay channel,” IEEE Transactions on Information Theory, vol. 25, no. 5, pp. 572–584, 1979.
- A. Host-Madsen and J. Zhang, “Capacity bounds and power allocation for wireless relay channels,” IEEE Transactions on Information Theory, vol. 51, no. 6, pp. 2020–2040, 2005.
- “Cooperative strategies and capacity theorems for relay networks,” IEEE Transactions on Information Theory, vol. 51, no. 9, pp. 3037–3063, 2005.
- Network Information Theory, Cambridge University Press, 2011.
- “Compress-forward coding with BPSK modulation for the half-duplex Gaussian relay channel,” IEEE Transactions on Signal Processing, vol. 57, no. 11, pp. 4467–4481, 2009.
- “Slepian-wolf coded nested lattice quantization for wyner-ziv coding: High-rate performance analysis and code design,” IEEE Transactions on Information Theory, vol. 52, no. 10, pp. 4358–4379, 2006.
- I. Estella Aguerri and D. Gündüz, “Capacity of a class of state-dependent orthogonal relay channels,” IEEE Transactions on Information Theory, vol. 62, no. 3, pp. 1280–1295, 2016.
- A. Wyner and J. Ziv, “The rate-distortion function for source coding with side information at the decoder,” IEEE Transactions on Information Theory, vol. 22, no. 1, pp. 1–10, 1976.
- “Reliable joint source-channel cooperative transmission over relay networks,” IEEE Transactions on Information Theory, vol. 59, no. 4, pp. 2442–2458, 2013.
- “Cooperative source and channel coding for wireless multimedia communications,” IEEE Journal of Selected Topics in Signal Processing, pp. 295–307, 2007.
- “Source-channel rate optimization for progressive image transmission over block fading relay channels,” IEEE Transactions on Communications, vol. 58, no. 6, pp. 1631–1642, 2010.
- “Deep joint source-channel coding for wireless image transmission,” IEEE Transactions on Cognitive Communications and Networking, 2019.
- “Deep joint source-channel coding for semantic communications,” IEEE Communications Magazine, vol. 61, no. 11, pp. 42–48, 2023.
- “OFDM-guided deep joint source channel coding for wireless multipath fading channels,” IEEE Trans. on Cogn. Comm. and Networking, vol. 8, no. 2, pp. 584–599, 2022.
- “Wireless image transmission using deep source channel coding with attention modules,” IEEE Trans. on Circuits and Systems for Video Tech., 2021.
- T.-Y. Tung and D. Gündüz, “Deepwive: Deep-learning-aided wireless video transmission,” IEEE Journal on Selected Areas in Communications, vol. 40, no. 9, pp. 2570–2583, 2022.
- “Wireless deep video semantic transmission,” IEEE Journal on Selected Areas in Communications, vol. 41, no. 1, pp. 214–229, 2023.
- “Semantic-preserved communication system for highly efficient speech transmission,” IEEE Journal on Selected Areas in Communications, vol. 41, no. 1, pp. 245–259, 2023.
- “Wireless point cloud transmission,” arXiv preprint arXiv:2306.08730, 2023.
- “Distributed deep joint source-channel coding over a multiple access channel,” in IEEE International Conference on Communications, 2023.
- “Fusion-based multi-user semantic communications for wireless image transmission over degraded broadcast channels,” arXiv preprint arXiv:2305.09165, 2023.
- “Semantic communication on multi-hop concatenated relay networks,” in 2023 IEEE/CIC International Conference on Communications in China (ICCC), 2023, pp. 1–6.
- “A relay system for semantic image transmission based on shared feature extraction and hyperprior entropy compression,” IEEE Internet of Things Journal, pp. 1–1, 2024.
- “A hybrid joint source-channel coding scheme for mobile multi-hop networks,” in IEEE International Conference on Communications, 2024.
- “Cooperative semantic communication with on-demand semantic forwarding,” IEEE Open Journal of the Communications Society, vol. 5, pp. 349–363, 2024.
- “An image is worth 16x16 words: Transformers for image recognition at scale,” in International Conference on Learning Representations, 2021.
- “Low-density lattice codes for full-duplex relay channels,” IEEE Transactions on Wireless Communications, vol. 14, no. 4, pp. 2309–2321, 2015.
- “Attention is all you need,” in NIPS, 2017.
- “DeepJSCC-1++: Robust and bandwidth-adaptive wireless image transmission,” in 2023 IEEE Global Communications Conference, 2023, pp. 3148–3154.
- “Deepcode: Feedback codes via deep learning,” in Advances in Neural Information Processing Systems, 2018.
- “All you need is feedback: Communication with block attention feedback codes,” IEEE Journal on Selected Areas in Information Theory, vol. 3, no. 3, pp. 587–602, 2022.
- “Deep learning face attributes in the wild,” in Proceedings of International Conference on Computer Vision (ICCV), December 2015.
- “Twins: Revisiting the design of spatial attention in vision transformers,” in Advances in Neural Information Processing Systems, 2021, vol. 34, pp. 9355–9366.
- Chenghong Bian (21 papers)
- Yulin Shao (56 papers)
- Haotian Wu (49 papers)
- Emre Ozfatura (33 papers)
- Deniz Gunduz (506 papers)