2000 character limit reached
Track Role Prediction of Single-Instrumental Sequences
Published 20 Apr 2024 in cs.SD, cs.IR, and eess.AS | (2404.13286v1)
Abstract: In the composition process, selecting appropriate single-instrumental music sequences and assigning their track-role is an indispensable task. However, manually determining the track-role for a myriad of music samples can be time-consuming and labor-intensive. This study introduces a deep learning model designed to automatically predict the track-role of single-instrumental music sequences. Our evaluations show a prediction accuracy of 87% in the symbolic domain and 84% in the audio domain. The proposed track-role prediction methods hold promise for future applications in AI music generation and analysis.
- P. Alperson, “The instrumentality of music,” The Journal of Aesthetics and Art Criticism, vol. 66, no. 1, pp. 37–51, 2008.
- J. Ens and P. Pasquier, “Mmm: Exploring conditional multi-track music generation with the transformer,” arXiv preprint arXiv:2008.06048, 2020.
- P. Lu, X. Xu, C. Kang, B. Yu, C. Xing, X. Tan, and J. Bian, “Musecoco: Generating symbolic music from text,” arXiv preprint arXiv:2306.00110, 2023.
- H. Lee, T. Kim, H. Kang, M. Ki, H. Hwang, S. Han, S. J. Kim et al., “Commu: Dataset for combinatorial music generation,” Advances in Neural Information Processing Systems, vol. 35, pp. 39 103–39 114, 2022.
- K. Kim, M. Park, H. Joung, Y. Chae, Y. Hong, S. Go, and K. Lee, “Show me the instruments: Musical instrument retrieval from mixture audio,” in ICASSP 2023-2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 2023, pp. 1–5.
- J. Ching, A. Ramires, and Y.-H. Yang, “Instrument role classification: Auto-tagging for loop based music,” in Proceedings of The 2020 Joint Conference on AI Music Creativity, 2020, pp. 196–202.
- M. Zeng, X. Tan, R. Wang, Z. Ju, T. Qin, and T.-Y. Liu, “Musicbert: Symbolic music understanding with large-scale pre-training,” arXiv preprint arXiv:2106.05630, 2021.
- Q. Kong, Y. Cao, T. Iqbal, Y. Wang, W. Wang, and M. D. Plumbley, “Panns: Large-scale pretrained audio neural networks for audio pattern recognition,” IEEE/ACM Transactions on Audio, Speech, and Language Processing, vol. 28, pp. 2880–2894, 2020.
- J. F. Gemmeke, D. P. Ellis, D. Freedman, A. Jansen, W. Lawrence, R. C. Moore, M. Plakal, and M. Ritter, “Audio set: An ontology and human-labeled dataset for audio events,” in 2017 IEEE international conference on acoustics, speech and signal processing (ICASSP). IEEE, 2017, pp. 776–780.
- Y. Wu, K. Chen, T. Zhang, Y. Hui, T. Berg-Kirkpatrick, and S. Dubnov, “Large-scale contrastive language-audio pretraining with feature fusion and keyword-to-caption augmentation,” in ICASSP 2023-2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 2023, pp. 1–5.
- J. Engel, C. Resnick, A. Roberts, S. Dieleman, M. Norouzi, D. Eck, and K. Simonyan, “Neural audio synthesis of musical notes with wavenet autoencoders,” in International Conference on Machine Learning. PMLR, 2017, pp. 1068–1077.
Paper Prompts
Sign up for free to create and run prompts on this paper.