Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
167 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
42 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

A Computational Analysis of Lyric Similarity Perception (2404.02342v2)

Published 2 Apr 2024 in cs.CL, cs.SD, and eess.AS

Abstract: In musical compositions that include vocals, lyrics significantly contribute to artistic expression. Consequently, previous studies have introduced the concept of a recommendation system that suggests lyrics similar to a user's favorites or personalized preferences, aiding in the discovery of lyrics among millions of tracks. However, many of these systems do not fully consider human perceptions of lyric similarity, primarily due to limited research in this area. To bridge this gap, we conducted a comparative analysis of computational methods for modeling lyric similarity with human perception. Results indicated that computational models based on similarities between embeddings from pre-trained BERT-based models, the audio from which the lyrics are derived, and phonetic components are indicative of perceptual lyric similarity. This finding underscores the importance of semantic, stylistic, and phonetic similarities in human perception about lyric similarity. We anticipate that our findings will enhance the development of similarity-based lyric recommendation systems by offering pseudo-labels for neural network development and introducing objective evaluation metrics.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (38)
  1. Hervé Abdi and Lynne J Williams. 2010. Principal component analysis. Wiley interdisciplinary reviews: computational statistics, 2(4):433–459.
  2. Kriti Bansal and Vinod Jain. 2020. Performance analysis of collaborative filtering based recommendation system on similarity threshold. In 2020 Fourth International Conference on Computing Methodologies and Communication (ICCMC), pages 442–448. IEEE.
  3. Markov constraints for generating lyrics with style. In Ecai, volume 242, pages 115–120.
  4. A large-scale evaluation of acoustic and subjective music-similarity measures. Computer Music Journal, pages 63–76.
  5. The million song dataset.
  6. Latent dirichlet allocation. Journal of machine Learning research, 3(Jan):993–1022.
  7. Dmitry Bogdanov et al. 2013. From music similarity to music recommendation: Computational approaches based on audio features and metadata.
  8. Michael L Burton and Sara B Nerlove. 1976. Balanced designs for triads tests: Two examples from english. Social Science Research, 5(3):247–267.
  9. Content-based music information retrieval: Current directions and future challenges. Proceedings of the IEEE, 96(4):668–696.
  10. Kahyun Choi and J Stephen Downie. 2018. Exploratory investigation of word embedding in song lyric topic classification: promising preliminary results. In Proceedings of the 18th ACM/IEEE on Joint Conference on Digital Libraries, pages 327–328.
  11. Music mood detection based on audio and lyrics with deep neural net. arXiv preprint arXiv:1809.07276.
  12. Content-driven music recommendation: Evolution, state of the art, and challenges. arXiv preprint arXiv:2107.11803.
  13. BERT: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT), pages 4171–4186.
  14. Xiao Hu and J Stephen Downie. 2010. When lyrics outperform audio for music mood classification: A feature analysis. In Ismir, pages 619–624.
  15. Lyric text mining in music mood classification. American music, 183(5,049):2–209.
  16. A computational framework for singable lyric translation. In Proceedings of the 24th International Society for Music Information Retrieval (ISMIR).
  17. Multimodal music mood classification using audio and lyrics. In 2008 seventh international conference on machine learning and applications, pages 688–693. IEEE.
  18. Tao Li and Mitsunori Ogihara. 2004. Music artist style identification by semi-supervised learning from both lyrics and content. In Proceedings of the 12th annual ACM international conference on Multimedia, pages 364–367.
  19. Natural language processing of lyrics. In Proceedings of the 13th annual ACM international conference on Multimedia, pages 475–478.
  20. Rhyme and style features for musical genre classification by song lyrics. In Ismir, pages 337–342.
  21. Learning content similarity for music recommendation. IEEE Transactions on Audio, Speech, and Language Processing, 20(8):2207–2218.
  22. Perceptual evaluation of inter-song similarity in western popular music. Journal of New Music Research, 40(1):1–26.
  23. Elias Pampalk. 2004. A matlab toolbox to compute music similarity from audio. In ISMIR.
  24. Allison Parrish. 2017. Poetic sound similarity vectors using phonetic features. In Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment, volume 13, pages 99–106.
  25. Retrieving similar lyrics for music recommendation system. In Proceedings of the 14th International Conference on Natural Language Processing (ICON-2017), pages 290–297.
  26. Marcus Pearce and Daniel Müllensiefen. 2017. Compression-based modelling of musical similarity perception. Journal of New Music Research, 46(2):135–155.
  27. Jordi Pons and Xavier Serra. 2019. musicnn: Pre-trained convolutional neural networks for music audio tagging. arXiv preprint arXiv:1909.06654.
  28. Nils Reimers and Iryna Gurevych. 2019. Sentence-BERT: Sentence embeddings using Siamese BERT-networks. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), pages 3982–3992.
  29. Lyemobert: Classification of lyrics’ emotion and recommendation using a pre-trained model. Procedia Computer Science, 218:1196–1208.
  30. Lyricsradar: A lyrics retrieval system based on latent topics of lyrics. In Ismir, pages 585–590.
  31. Current challenges and visions in music recommender systems research. International Journal of Multimedia Information Retrieval, 7:95–116.
  32. Learning to automatically generating genre-specific song lyrics: A comparative study. In Iberoamerican Knowledge Graphs and Semantic Web Conference, pages 62–75. Springer.
  33. Measuring similarity similarly: Lda and human perception. ACM Transactions on Intelligent Systems and Technology (TIST), 8(1):1–28.
  34. Lyric jumper: A lyrics-based music exploratory web service by modeling lyrics generative process. In ISMIR, pages 544–551.
  35. MiniLM: Deep self-attention distillation for task-agnostic compression of pre-trained transformers. Advances in Neural Information Processing Systems (NeurIPS), 33:5776–5788.
  36. Kento Watanabe and Masataka Goto. 2020. Lyrics information processing: Analysis, generation, and applications. In Proceedings of the 1st Workshop on NLP for Music and Audio (NLP4MusA), pages 6–12, Online. Association for Computational Linguistics.
  37. Modeling structural topic transitions for automatic lyrics generation. In Proceedings of The 28th Pacific Asia Conference on Language, Information and Computation, pages 422–431. Waseda University.
  38. Lyrisys: An interactive support system for writing lyrics based on topic transition. In Proceedings of the 22nd international conference on intelligent user interfaces, pages 559–563.

Summary

We haven't generated a summary for this paper yet.