Papers
Topics
Authors
Recent
Search
2000 character limit reached

Roman Numeral Analysis with Graph Neural Networks: Onset-wise Predictions from Note-wise Features

Published 7 Jul 2023 in cs.SD and cs.LG | (2307.03544v2)

Abstract: Roman Numeral analysis is the important task of identifying chords and their functional context in pieces of tonal music. This paper presents a new approach to automatic Roman Numeral analysis in symbolic music. While existing techniques rely on an intermediate lossy representation of the score, we propose a new method based on Graph Neural Networks (GNNs) that enable the direct description and processing of each individual note in the score. The proposed architecture can leverage notewise features and interdependencies between notes but yield onset-wise representation by virtue of our novel edge contraction algorithm. Our results demonstrate that ChordGNN outperforms existing state-of-the-art models, achieving higher accuracy in Roman Numeral analysis on the reference datasets. In addition, we investigate variants of our model using proposed techniques such as NADE, and post-processing of the chord predictions. The full source code for this work is available at https://github.com/manoskary/chordgnn

Definition Search Book Streamline Icon: https://streamlinehq.com
References (28)
  1. J. Pauwels, K. O’Hanlon, E. Gómez, M. Sandler et al., “20 years of Automatic Chord Recognition from Audio,” in Proceedings of the International Society for Music Information Retrieval Conference (ISMIR), 2019.
  2. C. Raphael and J. Stoddard, “Functional Harmonic Analysis Using Probabilistic Models,” Computer Music Journal, vol. 28, no. 3, pp. 45–52, 2004.
  3. J. P. Magalhaes and W. B. de Haas, “Functional Modelling of Musical Harmony: an experience report,” ACM SIGPLAN Notices, vol. 46, no. 9, pp. 156–162, 2011.
  4. T.-P. Chen, L. Su et al., “Functional Harmony Recognition of Symbolic Music Data with Multi-task Recurrent Neural Networks.” in Proceedings of the International Society for Music Information Retrieval Conference (ISMIR), 2018.
  5. G. Micchi, M. Gotham, and M. Giraud, “Not all roads lead to Rome: Pitch representation and model architecture for automatic harmonic analysis,” Transactions of the International Society for Music Information Retrieval (TISMIR), vol. 3, no. 1, pp. 42–54, 2020.
  6. N. Nápoles López, M. Gotham, and I. Fujinaga, “AugmentedNet: A Roman Numeral Analysis Network with Synthetic Training Examples and Additional Tonal Tasks.” in Proceedings of the International Society for Music Information Retrieval Conference (ISMIR), 2021.
  7. G. Micchi, K. Kosta, G. Medeot, and P. Chanquion, “A deep learning method for enforcing coherence in Automatic Chord Recognition.” in Proceedings of the International Society for Music Information Retrieval Conference (ISMIR), 2021.
  8. A. P. McLeod and M. A. Rohrmeier, “A modular system for the harmonic analysis of musical scores using a large vocabulary,” in Proceedings of the International Society for Music Information Retrieval Conference (ISMIR), 2021.
  9. D. Jeong, T. Kwon, Y. Kim, and J. Nam, “Graph Neural Network for Music Score Data and Modeling Expressive Piano Performance,” in Proceedings of International Conference on Machine Learning (ICML), 2019.
  10. E. Karystinaios and G. Widmer, “Cadence Detection in Symbolic Classical Music using Graph Neural Networks,” Proceedings of the International Society for Music Information Retrieval Conference (ISMIR), 2022.
  11. E. Karystinaios, F. Foscarin, and G. Widmer, “Musical Voice Separation as Link Prediction: Modeling a Musical Perception Task as a Multi-Trajectory Tracking Problem,” in Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI), 2023.
  12. C. Hernandez-Olivan, S. R. Llamas, and J. R. Beltran, “Symbolic Music Structure Analysis with Graph Representations and Changepoint Detection Methods,” 2023.
  13. Z. Zhang, P. Luo, C. C. Loy, and X. Tang, “Facial Landmark Detection by Deep Multi-task Learning,” in Proceedings of the European Conference on Computer Vision (ECCV), 2014.
  14. M. Guo, A. Haque, D.-A. Huang, S. Yeung, and L. Fei-Fei, “Dynamic Task Prioritization for Multitask Learning,” in Proceedings of the European Conference on Computer Vision (ECCV), 2018.
  15. Z. Chen, V. Badrinarayanan, C.-Y. Lee, and A. Rabinovich, “GradNorm: Gradient Normalization for Adaptive Loss Balancing in Deep Multitask Networks,” in Proceedings of the International Conference on Machine Learning (ICML), 2018.
  16. A. Javaloy and I. Valera, “RotoGrad: Gradient Homogenization in Multitask Learning,” in Proceedings of the International Conference on Learning Representations (ICLR), 2022.
  17. A. Navon, A. Shamsian, I. Achituve, H. Maron, K. Kawaguchi, G. Chechik, and E. Fetaya, “Multi-task Learning as a Bargaining Game,” Proceedings of the International Conference on Machine Learning (ICML), 2022.
  18. W. Hamilton, Z. Ying, and J. Leskovec, “Inductive representation learning on large graphs,” Advances in neural information processing systems, vol. 30, 2017.
  19. L. Liebel and M. Körner, “Auxiliary tasks in multi-task learning,” arXiv preprint arXiv:1805.06334, 2018.
  20. N. Nápoles López, “Automatic roman numeral analysis in symbolic music representations,” Ph.D. dissertation, Schulich School of Music McGill University, December 2022.
  21. M. Neuwirth, D. Harasim, F. C. Moss, and M. Rohrmeier, “The Annotated Beethoven Corpus (ABC): A dataset of harmonic analyses of all Beethoven string quartets,” Frontiers in Digital Humanities, vol. 5, p. 16, 2018.
  22. N. Nápoles López, “Automatic Harmonic Analysis of Classical String Quartets from Symbolic Score,” Ph.D. dissertation, Master’s thesis, Universitat Pompeu Fabra, 2017.
  23. J. Devaney, C. Arthur, N. Condit-Schultz, and K. Nisula, “Theme and Variation Encodings with Roman Numerals (TAVERN): A new data set for symbolic music analysis,” in Proceedings of the International Society for Music Information Retrieval Conference (ISMIR), 2015.
  24. M. Gotham, D. Tymoczko, and M. S. Cuthbert, “The RomanText Format: A Flexible and Standard Method for Representing Roman Numeral Analyses.” in Proceedings of the International Society for Music Information Retrieval Conference (ISMIR), 2019.
  25. M. R. H. Gotham and P. Jonas, “The Openscore Lieder Corpus,” in Proceedings of the Music Encoding Conference (MEC), 2021.
  26. N. Nápoles López and I. Fujinaga, “Harmonic Reductions as a Strategy for Creative Data Augmentation,” in Late-Breaking Demo at International Society for Music Information Retrieval Conference (ISMIR), 2020.
  27. J. Hentschel, M. Neuwirth, and M. Rohrmeier, “The Annotated Mozart Sonatas: Score, Harmony, and Cadence,” Transactions of the International Society for Music Information Retrieval (TISMIR), vol. 4, no. ARTICLE, pp. 67–80, 2021.
  28. C. Harte, “Towards automatic extraction of harmony information from music signals,” Ph.D. dissertation, Queen Mary University of London, 2010.
Citations (4)

Summary

No one has generated a summary of this paper yet.

Paper to Video (Beta)

No one has generated a video about this paper yet.

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Continue Learning

We haven't generated follow-up questions for this paper yet.

Collections

Sign up for free to add this paper to one or more collections.