Papers
Topics
Authors
Recent
Search
2000 character limit reached

Everybody Compose: Deep Beats To Music

Published 9 Jun 2023 in cs.SD, cs.LG, cs.MM, and eess.AS | (2306.06284v1)

Abstract: This project presents a deep learning approach to generate monophonic melodies based on input beats, allowing even amateurs to create their own music compositions. Three effective methods - LSTM with Full Attention, LSTM with Local Attention, and Transformer with Relative Position Representation - are proposed for this novel task, providing great variation, harmony, and structure in the generated music. This project allows anyone to compose their own music by tapping their keyboards or ``recoloring'' beat sequences from existing works.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (16)
  1. Dzmitry Bahdanau, Kyunghyun Cho and Yoshua Bengio “Neural machine translation by jointly learning to align and translate” In arXiv preprint arXiv:1409.0473, 2014
  2. “Sketchygan: Towards diverse and realistic sketch to image synthesis” In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2018, pp. 9416–9425
  3. Keunwoo Choi, George Fazekas and Mark Sandler “Text-based LSTM networks for automatic music composition” In arXiv preprint arXiv:1604.05358, 2016
  4. “A first look at music composition using lstm recurrent neural networks” In Istituto Dalle Molle Di Studi Sull Intelligenza Artificiale 103 Google Scholar, 2002, pp. 48
  5. “Generative adversarial networks” In Communications of the ACM 63.11 ACM New York, NY, USA, 2020, pp. 139–144
  6. “Enabling Factorized Piano Music Modeling and Generation with the MAESTRO Dataset” In International Conference on Learning Representations, 2019 URL: https://openreview.net/forum?id=r1lYRjC9F7
  7. “Long short-term memory” In Neural computation 9.8 MIT Press, 1997, pp. 1735–1780
  8. “Music transformer: generating music with long-term structure” In arXiv preprint arXiv:1809.04281, 2018
  9. Magenta “Note-seq: Generating musical notes with RNNs”, https://github.com/magenta/note-seq, 2020 URL: https://github.com/magenta/note-seq
  10. “Symbolic Music Generation with Transformer-GANs” In Proceedings of the AAAI Conference on Artificial Intelligence 35.1, 2021, pp. 408–417 DOI: 10.1609/aaai.v35i1.16117
  11. Christine McLeavey Payne “MuseNet” https://openai.com/blog/musenet/ In OpenAI, 2019
  12. “Piano e-Competition” Accessed: November 5, 2022, https://piano-e-competition.com/
  13. Peter Shaw, Jakob Uszkoreit and Ashish Vaswani “Self-Attention with Relative Position Representations” In CoRR abs/1803.02155, 2018 arXiv: http://arxiv.org/abs/1803.02155
  14. “Performance RNN: Generating Music with Expressive Timing and Dynamics” In Magenta Blog, https://magenta.tensorflow.org/performance-rnn, 2017
  15. “Attention is All you Need” In Advances in Neural Information Processing Systems 30 Curran Associates, Inc., 2017 URL: https://proceedings.neurips.cc/paper/2017/file/3f5ee243547dee91fbd053c1c4a845aa-Paper.pdf
  16. Elliot Waite “Generating Long-Term Structure in Songs and Stories” https://magenta.tensorflow.org/2016/07/15/lookback-rnn-attention-rnn In Magenta, 2016

Summary

No one has generated a summary of this paper yet.

Paper to Video (Beta)

No one has generated a video about this paper yet.

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Continue Learning

We haven't generated follow-up questions for this paper yet.

Collections

Sign up for free to add this paper to one or more collections.