Papers
Topics
Authors
Recent
Search
2000 character limit reached

(Un)paired signal-to-signal translation with 1D conditional GANs

Published 5 Mar 2024 in eess.AS, cs.CV, cs.GR, and cs.LG | (2403.04800v1)

Abstract: I show that a one-dimensional (1D) conditional generative adversarial network (cGAN) with an adversarial training architecture is capable of unpaired signal-to-signal ("sig2sig") translation. Using a simplified CycleGAN model with 1D layers and wider convolutional kernels, mirroring WaveGAN to reframe two-dimensional (2D) image generation as 1D audio generation, I show that recasting the 2D image-to-image translation task to a 1D signal-to-signal translation task with deep convolutional GANs is possible without substantial modification to the conventional U-Net model and adversarial architecture developed as CycleGAN. With this I show for a small tunable dataset that noisy test signals unseen by the 1D CycleGAN model and without paired training transform from the source domain to signals similar to paired test signals in the translated domain, especially in terms of frequency, and I quantify these differences in terms of correlation and error.

Authors (1)
Definition Search Book Streamline Icon: https://streamlinehq.com
References (8)
  1. Adversarial Audio Synthesis, February 2019. arXiv:1802.04208 [cs].
  2. Generative Adversarial Networks, June 2014. arXiv:1406.2661 [cs, stat].
  3. Image-to-Image Translation with Conditional Adversarial Networks, November 2018. arXiv:1611.07004 [cs].
  4. Sig2Sig: Signal Translation Networks to Take the Remains of the Past. In ICASSP 2021 - 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pages 3620–3624, June 2021. ISSN: 2379-190X.
  5. Fully Convolutional Networks for Semantic Segmentation, March 2015. arXiv:1411.4038 [cs].
  6. 1D conditional generative adversarial network for spectrum-to-spectrum translation of simulated chemical reflectance signatures. Journal of Spectral Imaging, 10, June 2021.
  7. Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks, January 2016. arXiv:1511.06434 [cs].
  8. Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks, August 2020. arXiv:1703.10593 [cs].

Summary

No one has generated a summary of this paper yet.

Paper to Video (Beta)

No one has generated a video about this paper yet.

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Continue Learning

We haven't generated follow-up questions for this paper yet.

Collections

Sign up for free to add this paper to one or more collections.

Tweets

Sign up for free to view the 2 tweets with 3 likes about this paper.