Abstract
Facial Emotion Detection and Music Recommendation System is a real-time facial emotion detection and personalized music recommendation system. It employs a trained Convolutional Neural Network (CNN) trained on the FER2013 database for seven emotion recognitions, i.e., anger, disgust, fear, happiness, sorrow, surprise, and neutrality. Everything is accomplished through Artificial Intelligence (AI) and Computer Vision technology. React and Flask are used to create the frontend and backend, while OpenCV is used to detect the facial emotion of the user through the webcam. The system does not pre-downloading playlists but dynamically uses the YouTube Data Application Programming Interface (API) to download appropriate music tracks depending on the emotional state of the user. Measures of precision, recall, accuracy (79.07%), and loss values are used to deploy the proposed system. The values indicate the viability of the application of Xpressify for use in real-time affect classification and customized music. With dynamic, interactive, and emotive-response music recommendations, the integration provides a more realistic experience for the user and is applicable in entertainment, mental health, and human-computer interaction.
References
- Bakariya, Brijesh, Arshdeep Singh, Harmanpreet Singh, Pankaj Raju, Rohit Rajpoot, and Krishna Kumar Mohbey. "Facial emotion recognition and music recommendation system using CNN-based deep learning techniques." Evolving Systems 15, no. 2 (2024): 641-658.
- Florence, S. Metilda, and Mohan Uma. "Emotional detection and music recommendation system based on user facial expression." In IOP conference series: Materials science and engineering, vol. 912, no. 6, p. 062007. IOP Publishing, 2020.
- Shalini, Shantha K., R. Jaichandran, S. Leelavathy, R. Raviraghul, J. Ranjitha, and N. Saravanakumar. "Facial Emotion Based Music Recommendation System using computer vision and machine learning techiniques." Turkish journal of computer and mathematics education 12, no. 2 (2021): 912-917.
- Patel, Kevin, and Rajeev Kumar Gupta. "Song playlist generator system based on facial expression and song mood." In 2021 international conference on artificial intelligence and machine vision (AIMV), IEEE, (2021): 1-6.
- Pareeka, Shreela, Ritika Rai, Rishika Tyagi, Priyanshu Singh, and Vishakha Chauhan. "Emo Melodies-Music Aligned with Facial Emotions." SSRN Electronic Journal (2024).
- Chidambaram, G., A. Dhanush Ram, G. Kiran, P. Shivesh Karthic, and Abdul Kaiyum. "Music recommendation system using emotion recognition." International Research Journal of Engineering and Technology (IRJET) 8, no. 07 (2021): 2395-0056.
- Bagwan, Raheena, Sakshi Chintawar, Komal Dhapudkar, Alisha Balamwar, and Sandeep Gore. "Facial Emotion Recognition using Convolution Neural Network." International Journal of Trend in Scientific Research and Development (ijtsrd) 5, no. 3 (2021): 800-801.
- Athavle, Madhuri, Deepali Mudale, Upasana Shrivastav, and Megha Gupta. "Music recommendation based on face emotion recognition." Journal of Informatics Electrical and Electronics Engineering (JIEEE) 2, no. 2 (2021): 1-11.
- S. Bobade et al., "Music recommendation system using facial expression," in Proceedings of the International Conference on Emerging Trends in Information Technology and Engineering (ic-ETITE), Vellore, India, Nov. (2023): 1–5.
- S. Kulkarni et al., "Facial emotion based music recommendation system," in Proceedings of the International Conference on Advances in Computing and Communication Engineering (ICACCE), Las Vegas, NV, USA, May (2023): 1–6.
- Athavle, Madhuri. (2021). Music Recommendation Based on Face Emotion Recognition. Journal of Informatics Electrical and Electronics Engineering (JIEEE). 2. 1-11.
- S. K. Sana et al., "Facial emotion recognition based music system using convolutional neural networks," Mater. Today: Proc., vol. 56, 2022, Art. no. 03.131.
- N. P. Mankale, "Music Recommendation System Based on Facial Emotions," International Journal of Research Publication and Reviews, vol. 4, no. 10, Oct. (2023): 457–462.
- D. Tiwari, H. Kumar, and S. Garg, "Music recommendation system using facial expression," International Research Journal of Engineering and Technology (IRJET), vol. 11, no. 05, May (2024): 2145–2149.
- K. Lekha Sree and P. Praveen Kumar, "Music Recommend System Using Facial Emotion Recognition," International Journal of Creative Research Thoughts (IJCRT), vol. 11, no. 10, Oct. (2023): 688–693.
- A. Pradhan et al., "Facial emotion based music recommendation system," International Journal of Engineering Applied Sciences and Technology, vol. 7, no. 12, Apr. (2023): 68–70.
- M. K, H. R. Jain, A. R. Chandra, and J. Bhansali, "Music Recommendation Based on Facial Expression," International Journal of Latest Technology in Engineering, Management & Applied Science (IJLTEMAS), vol. IX, no. XI, p. 18, Nov. 2020.
- More et al., "Melomaniac: Emotion based music recommendation system," International Journal of Advance Research and Innovative Ideas in Education (IJARIIE), vol. 7, no. 3, (2021): 1323–1329.
- Kabani, Hafeez, Sharik Khan, Omar Khan, and Shabana Tadvi. "Emotion based music player." International journal of engineering research and general science 3, no. 1 (2015): 2091-2730.
- Bansal, Dhruvisha, Pinkal Bhatt, Megha Dusane, Avneet Saluja, and Kushal Patel. "Emotion based music playing device." International research journal of engineering and technology (IRJET) 7, no. 06 (2020).
- Kabani, Hafeez, Sharik Khan, Omar Khan, and Shabana Tadvi. "Emotion based music player." International journal of engineering research and general science 3, no. 1 (2015): 2091-2730.
- Sawant, Srushti, Shraddha Patil, and Shubhangi Biradar. "Emotion based music system." International Journal of Innovations & Advancement in Computer Science, IJIACS ISSN (2018): 2347-8616.
- Agrawal, Charu, Meghna Varma, Anish Varshaney, Khushboo Singh, Chirag Advani, and Diwakar Yagyasen. "Emotions Based Music Player." International Research Journal of Engineering and Technology (IRJET) 8, no. 7 (2021): 2584-2587.
- Singh, Sushant Kumar. "Emotion-Aware Music Recommendation System using Facial Expression Analysis." International Journal of Performability Engineering 21, no. 6 (2025).
- Gilda, Shlok, Husain Zafar, Chintan Soni, and Kshitija Waghurdekar. "Smart music player integrating facial emotion recognition and music mood recommendation." In 2017 international conference on wireless communications, signal processing and networking (wispnet), IEEE, (2017): 154-158
