(Un)paired signal-to-signal translation with 1D conditional GANs
Abstract: I show that a one-dimensional (1D) conditional generative adversarial network (cGAN) with an adversarial training architecture is capable of unpaired signal-to-signal ("sig2sig") translation. Using a simplified CycleGAN model with 1D layers and wider convolutional kernels, mirroring WaveGAN to reframe two-dimensional (2D) image generation as 1D audio generation, I show that recasting the 2D image-to-image translation task to a 1D signal-to-signal translation task with deep convolutional GANs is possible without substantial modification to the conventional U-Net model and adversarial architecture developed as CycleGAN. With this I show for a small tunable dataset that noisy test signals unseen by the 1D CycleGAN model and without paired training transform from the source domain to signals similar to paired test signals in the translated domain, especially in terms of frequency, and I quantify these differences in terms of correlation and error.
- Adversarial Audio Synthesis, February 2019. arXiv:1802.04208 [cs].
- Generative Adversarial Networks, June 2014. arXiv:1406.2661 [cs, stat].
- Image-to-Image Translation with Conditional Adversarial Networks, November 2018. arXiv:1611.07004 [cs].
- Sig2Sig: Signal Translation Networks to Take the Remains of the Past. In ICASSP 2021 - 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pages 3620–3624, June 2021. ISSN: 2379-190X.
- Fully Convolutional Networks for Semantic Segmentation, March 2015. arXiv:1411.4038 [cs].
- 1D conditional generative adversarial network for spectrum-to-spectrum translation of simulated chemical reflectance signatures. Journal of Spectral Imaging, 10, June 2021.
- Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks, January 2016. arXiv:1511.06434 [cs].
- Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks, August 2020. arXiv:1703.10593 [cs].
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.