Design of a Music Recommendation Device Using Mini-Xception CNN and Facial Recognition
PDF
PDF

How to Cite

Singh, Chandan, V Himayanth, and B. Balakiruthiga. 2023. “Design of a Music Recommendation Device Using Mini-Xception CNN and Facial Recognition”. Journal of Soft Computing Paradigm 5 (2): 181-93. https://doi.org/10.36548/jscp.2023.2.007.

Keywords

— Artificial Intelligence (AI)
— Machine Learning (ML)
— Deep Convolutional Neural Network (DCNN)
— Facial recognition-based Music Recommendation System (MRS)
Published: 30-06-2023

Abstract

Due to the emerging developments in Artificial Intelligence and Machine Learning Technologies, various prediction systems are been developed based on human emotions and real time aspects of human psychology as well. Facial recognition system is one such mechanism which is the most vibrant strategy used for predicting human emotions. It is extensively applied in surveillance systems, fault identification and other security related aspects. Based on the human emotions researchers have already proposed several music recommendation systems. This paper aims to propose a Facial recognition-based music recommendation system to treat the psychology patients. This helps to recover the patients from mental stress, anxiety, and depression. The suggested method aims to take into account the limitations of the face recognition system in current frameworks, such as the requirement to lower the processing delay for deep feature extraction and the necessity to design a Mini exception technique based on Deep Convolutional Neural Network (DCNN) architecture. The FER- 2013 image dataset, which consists of 35000 face photos with automated labelling is considered. It is used to determine how well the proposed approach would detect the various emotion classes. In comparison to other states of methods, the Mini exception technique utilised in CNN layers acts as a lightweight system. The proposed solution has a 92% accuracy rate and removes the barrier between the current frameworks. The suggested music is taken from a music database and then further mapped in accordance with the algorithm's output.

References

  1. S. Gilda, H. Zafar, C. Soni and K. Waghurdekar, "Smart music player integrating facial emotion recognition and music mood recommendation," 2017 International Conference on Wireless Communications, Signal Processing and Networking (WiSPNET), Chennai, India, 2017, pp. 154-158, doi: 10.1109/WiSPNET.2017.8299738.
  2. A. V. Iyer, V. Pasad, S. R. Sankhe and K. Prajapati, "Emotion based mood enhancing music recommendation," 2017 2nd IEEE International Conference on Recent Trends in Electronics, Information & Communication Technology (RTEICT), Bangalore, India, 2017, pp. 1573-1577, doi: 10.1109/RTEICT.2017.8256863.
  3. B. Lin, M. Liu, W. Hsiung and J. Jhang, "Music emotion recognition based on two-level support vector classification," 2016 International Conference on Machine Learning and Cybernetics (ICMLC), Jeju, Korea (South), 2016, pp. 375-389, doi: 10.1109/ICMLC.2016.7860930.
  4. H. Jun, L. Shuai, S. Jinming, L. Yue, W. Jingwei and J. Peng, "Facial Expression Recognition Based on VGGNet Convolutional Neural Network," 2018 Chinese Automation Congress (CAC), Xi'an, China, 2018, pp. 4146-4151, doi: 10.1109/CAC.2018.8623238.
  5. L. Xu, M. Fei, W. Zhou and A. Yang, "Face Expression Recognition Based on Convolutional Neural Network," 2018 Australian & New Zealand Control Conference (ANZCC), Melbourne, VIC, Australia, 2018, pp. 115-118, doi: 10.1109/ANZCC.2018.8606597.
  6. A. Alrihaili, A. Alsaedi, K. Albalawi and L. Syed, "Music Recommender System for Users Based on Emotion Detection through Facial Features," 2019 12th International Conference on Developments in eSystems Engineering (DeSE), Kazan, Russia, 2019, pp. 1014-1019, doi: 10.1109/DeSE.2019.00188.
  7. B. Verma and A. Choudhary, "A Framework for Driver Emotion Recognition using Deep Learning and Grassmann Manifolds," 2018 21st International Conference on Intelligent Transportation Systems (ITSC), Maui, HI, USA, 2018, pp. 1421-1426, doi: 10.1109/ITSC.2018.8569461.
  8. M. Wang, Z. Wang, S. Zhang, J. Luan and Z. Jiao, "Face Expression Recognition Based on Deep Convolution Network," 2018 11th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics (CISP-BMEI), Beijing, China, 2018, pp. 1-9, doi: 10.1109/CISP-BMEI.2018.8633014.
  9. B. Subarna and D. M. Viswanathan, "Real Time Facial Expression Recognition Based on Deep Convolutional Spatial Neural Networks," 2018 International Conference on Emerging Trends and Innovations In Engineering And Technological Research (ICETIETR), Ernakulam, India, 2018, pp. 1-5, doi: 10.1109/ICETIETR.2018.8529105.
  10. Jun, He, et al. "Facial expression recognition based on VGGNet convolutional neural network." 2018 Chinese Automation Congress (CAC). IEEE, 2018.
  11. J. L. Joseph and S. P. Mathew, "Facial Expression Recognition for the Blind Using Deep Learning," 2021 IEEE 4th International Conference on Computing, Power and Communication Technologies (GUCON), Kuala Lumpur, Malaysia, 2021, pp. 1-5, doi: 10.1109/GUCON50781.2021.9574035.
  12. K. -C. Liu, C. -C. Hsu, W. -Y. Wang and H. -H. Chiang, "Facial Expression Recognition Using Merged Convolution Neural Network," 2019 IEEE 8th Global Conference on Consumer Electronics (GCCE), Osaka, Japan, 2019, pp. 296-298, doi: 10.1109/GCCE46687.2019.9015479.
  13. G. Yamaguchi and M. Fukumoto, "A Music Recommendation System based on Melody Creation by Interactive GA," 2019 20th IEEE/ACIS International Conference on Software Engineering, Artificial Intelligence, Networking and Parallel/Distributed Computing (SNPD), Toyama, Japan, 2019, pp. 286-290, doi: 10.1109/SNPD.2019.8935654.