Introducing EEG Analyses to Help Personal Music Preference Prediction (2404.15753v1)
Abstract: Nowadays, personalized recommender systems play an increasingly important role in music scenarios in our daily life with the preference prediction ability. However, existing methods mainly rely on users' implicit feedback (e.g., click, dwell time) which ignores the detailed user experience. This paper introduces Electroencephalography (EEG) signals to personal music preferences as a basis for the personalized recommender system. To realize collection in daily life, we use a dry-electrodes portable device to collect data. We perform a user study where participants listen to music and record preferences and moods. Meanwhile, EEG signals are collected with a portable device. Analysis of the collected data indicates a significant relationship between music preference, mood, and EEG signals. Furthermore, we conduct experiments to predict personalized music preference with the features of EEG signals. Experiments show significant improvement in rating prediction and preference classification with the help of EEG. Our work demonstrates the possibility of introducing EEG signals in personal music preference with portable devices. Moreover, our approach is not restricted to the music scenario, and the EEG signals as explicit feedback can be used in personalized recommendation tasks.
- Justin Basilico and Thomas Hofmann. 2004. Unifying Collaborative and Content-Based Filtering. In Proceedings of the Twenty-First International Conference on Machine Learning (Banff, Alberta, Canada) (ICML ’04). Association for Computing Machinery, New York, NY, USA, 9. https://doi.org/10.1145/1015330.1015394
- Recommender systems survey. Knowledge-based systems 46 (2013), 109–132.
- Improving music recommendation by incorporating social influence. Multimedia Tools and Applications 78, 3 (2019), 2667–2687.
- Tianqi Chen and Carlos Guestrin. 2016. XGBoost: A Scalable Tree Boosting System. In Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (San Francisco, California, USA) (KDD ’16). ACM, New York, NY, USA, 785–794. https://doi.org/10.1145/2939672.2939785
- Web Search via an Efficient and Effective Brain-Machine Interface. CoRR abs/2110.07225 (2021). arXiv:2110.07225 https://arxiv.org/abs/2110.07225
- Zhiyong Cheng and Jialie Shen. 2016. On effective location-aware music recommendation. ACM Transactions on Information Systems (TOIS) 34, 2 (2016), 1–32.
- Ian Cross. 2001. Music, cognition, culture, and evolution. Annals of the New York Academy of sciences 930, 1 (2001), 28–42.
- Content-driven Music Recommendation: Evolution, State of the Art, and Challenges. arXiv preprint arXiv:2107.11803 (2021).
- Speech synthesis from neural decoding of spoken sentences. Nature 568 (2019). https://doi.org/10.1038/s41586-019-1119-1
- MEG and EEG Data Analysis with MNE-Python. Frontiers in Neuroscience 7, 267 (2013), 1–13. https://doi.org/10.3389/fnins.2013.00267
- Guibing Guo and Mohamed Elgendi. 2017. Analysis of EEG signals and its application to neuromarketing. Multimedia Tools and Applications 76 (2017), 19087–19111. https://doi.org/10.1007/s11042-017-4580-6
- Contextual and sequential user embeddings for large-scale music recommendation. In Fourteenth ACM Conference on Recommender Systems. 53–62.
- Brain-to-text: Decoding spoken phrases from phone representations in the brain. Frontiers in Neuroscience 9, MAY (2015). https://doi.org/10.3389/fnins.2015.00217
- Fusion of EEG response and sentiment analysis of products review to predict customer satisfaction. Information Fusion 52 (2019), 41–52. https://doi.org/10.1016/j.inffus.2018.11.001
- A Music Recommendation System for Depression Therapy Based on EEG. In 2020 IEEE International Conference on Consumer Electronics - Taiwan (ICCE-Taiwan). 1–2. https://doi.org/10.1109/ICCE-Taiwan49838.2020.9258021
- Forehead EEG in Support of Future Feasible Personal Healthcare Solutions: Sleep Management, Headache Prevention, and Depression Treatment. IEEE Access 5 (2017), 10612–10621. https://doi.org/10.1109/ACCESS.2017.2675884
- Challenges in Designing a Brain-Machine Search Interface. SIGIR Forum 54, 2, Article 3 (aug 2021), 13 pages. https://doi.org/10.1145/3483382.3483387
- Scott M Lundberg and Su-In Lee. 2017. A Unified Approach to Interpreting Model Predictions. In Advances in Neural Information Processing Systems, I. Guyon, U. V. Luxburg, S. Bengio, H. Wallach, R. Fergus, S. Vishwanathan, and R. Garnett (Eds.), Vol. 30. Curran Associates, Inc. https://proceedings.neurips.cc/paper/2017/file/8a20a8621978632d76c43dfd28b67767-Paper.pdf
- Music discovery with social networks. In Workshop on Music Recommendation and Discovery. Association for Computing Machinery New York, 1–6.
- YV Srinivasa Murthy and Shashidhar G Koolagudi. 2018. Content-based music information retrieval (cb-mir) and its applications toward the music industry: A review. ACM Computing Surveys (CSUR) 51, 3 (2018), 1–46.
- Cortical control of a tablet computer by people with paralysis. PLoS ONE (2018). https://doi.org/10.1371/journal.pone.0204566
- Scikit-learn: Machine Learning in Python. Journal of Machine Learning Research 12 (2011), 2825–2830.
- Cognitive ability assessment by Brain-Computer Interface. Validation of a new assessment method for cognitive abilities. Journal of Neuroscience Methods 201, 1 (2011), 239–250. https://doi.org/10.1016/j.jneumeth.2011.06.025
- Attentive neural architecture incorporating song features for music recommendation. In Proceedings of the 12th ACM Conference on Recommender Systems. 417–421.
- Listener Modeling and Context-Aware Music Recommendation Based on Country Archetypes. Frontiers in Artificial Intelligence 3 (2020).
- Peia: Personality and emotion integrated attentive model for music recommendation on social media platforms. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 34. 206–213.
- Multimodal Emotion Recognition in Response to Videos. IEEE Transactions on Affective Computing 3, 2 (2012), 211–223. https://doi.org/10.1109/T-AFFC.2011.37
- A survey of music recommendation systems and future perspectives. In 9th international symposium on computer music modeling and retrieval, Vol. 4. Citeseer, 395–410.
- Swathi Swaminathan and E. Glenn Schellenberg. 2015. Current Emotion Research in Music Psychology. Emotion Review 7, 2 (2015), 189–197. https://doi.org/10.1177/1754073914558282
- An online brain-computer interface using non-flashing visual evoked potentials. Journal of neural engineering (2010). https://doi.org/10.1088/1741-2560/7/3/036003
- Robert E Thayer. 1990. The biopsychology of mood and arousal. Oxford University Press.
- Deep content-based music recommendation. In Neural Information Processing Systems Conference (NIPS 2013), Vol. 26. Neural Information Processing Systems Foundation (NIPS).
- Daniel Västfjäll. 2001. Emotion induction through music: A review of the musical mood induction procedure. Musicae Scientiae 5, 1_suppl (2001), 173–211.
- A survey on neural recommendation: From collaborative filtering to content and context enriched recommendation. arXiv preprint arXiv:2104.13030 (2021).
- Chao Xue and Tian Li. 2018. The influence of induced mood on music preference. Cognitive Processing 19 (2018), 517–525. https://doi.org/10.1007/s10339-018-0872-7
- A New Recommender System for 3D E-Commerce: An EEG Based Approach. Journal of Advanced Management Sciencee 1, 1 (2013), 61–65. https://doi.org/10.12720/joams.1.1.61-65
- Billy Yapriady and Alexandra L Uitdenbogerd. 2005. Combining demographic data with collaborative filtering for automatic music recommendation. In International Conference on Knowledge-Based and Intelligent Information and Engineering Systems. Springer, 201–207.
- Hybrid Collaborative and Content-based Music Recommendation Using Probabilistic Model with Latent User Preferences.. In ISMIR, Vol. 6. 296–301.
- Culture-aware music recommendation. In Proceedings of the 26th Conference on User Modeling, Adaptation and Personalization. 357–358.
- EEG-based emotion classification using deep belief networks. In 2014 IEEE International Conference on Multimedia and Expo (ICME). 1–6. https://doi.org/10.1109/ICME.2014.6890166