Abstract
Humans are good at making millions of facial movements during conversation. In interpersonal relationships, the human emotion sensing system is vital. At an older age, automatic emotion recognition is a trendy research problem. Emotions are expressed through personas, hand and body gestures, and facial expressions. Emotion recognition via facial expressions is one of the most important fields in the human-machine interface. The strategy of recognizing emotions from facial expressions is known as facial expression analysis. Emotions are automatically perceived by the human brain, and software that can recognise emotions has recently been developed. This technology is constantly improving, and it will ultimately be able to sense emotions as accurately as human brains. The purpose of this work is to present a survey of emotion detection research using various machine learning techniques. It also summarises the benefits, drawbacks, and limitations of current approaches, as well as the concept's evolution in research.
References
Verma, Rohit, and Mohamed-Yahia Dabbagh. "Fast facial expression recognition based on local binary patterns." 2013 26th IEEE Canadian Conference on Electrical and Computer Engineering (CCECE). IEEE, 2013.
N. Sebe, M. S. Lew, Y. Sun, I. Cohen, T. Gevers, and T. S. Huang. Authentic facial expression analysis. Image and Vision Computing, 25(12):1856–1863, 2007
B. Hasani, M. M. Arzani, M. Fathy, and K. Raahemifar. Facial expression recognition with discriminatory graphical models. In 2016 2nd International Conference of Signal Processing and Intelligent Systems (ICSPIS), pp. 1– 7, Dec 2016
B. Hasani and M. H. Mahoor. Spatio-temporal facial expression recognition using convolutional neural networks and conditional random fields. arXiv preprint arXiv:1703.06995, 2017
A. Krizhevsky, I. Sutskever, and G. E. Hinton. Imagenet classification with deep convolutional neural networks. In Advances in neural information processing systems, pp. 1097–1105, 2012
Szegedy, W. Liu, Y. Jia, P. Sermanet, S. Reed, D. Anguelov, D. Erhan, V. Vanhoucke, and A. Rabinovich. Going deeper with convolutions. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–9, 2015.
Mollahosseini, B. Hasani, M. J. Salvador, H. Abdollahi, D. Chan, and M. H. Mahoor. Facial expression recognition from world wild web. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, June 2016
Graves, A. r. Mohamed, and G. Hinton, Speech recognition with deep recurrent neural networks. In Proc. IEEE International Conference on Acoustics, Speech and Signal Processing, pp. 6645-6649, 2013
Sanin, C. Sanderson, M. T. Harandi, and B. C. Lovell, Spatiotemporal covariance descriptors for action and gesture recognition. In IEEE Workshop on Applications of Computer Vision, 2013
S. Jain, C. Hu, and J. K. Aggarwal, Facial expression recognition with temporal modeling of shapes. In Proc. IEEE International Conference on Computer Vision Workshops, pp. 1642-1649, 2011.
Kumar, GA Rajesh, Ravi Kant Kumar, and Goutam Sanyal. "Facial emotion analysis using deep convolution neural network." 2017 International Conference on Signal Processing and Communication (ICSPC). IEEE, 2017.
Liu, Wei-feng, Shu-juan Li, and Yan-jiang Wang. "Automatic facial expression recognition based on local binary patterns of local areas." 2009 WASE International Conference on Information Engineering. Vol. 1. IEEE, 2009.
T. Zhang, W. Zheng, Z. Cui, Y. Zong and Y. Li, SpatialTemporal Recurrent Neural Network for Emotion Recognition, IEEE Transactions on Cybernetics, arXiv:1705.04515, Issue: 99, pp. 1-9, 2018
Sailunaz, Kashfia, et al. "Emotion detection from text and speech: a survey." Social Network Analysis and Mining 8.1 (2018): 1-26.
Yamazoe, Hirotake, et al. "A body-mounted camera system for head-pose estimation and user-view image synthesis." Image and Vision Computing 25.12 (2007): 1848-1855.
Joseph, Allen, and P. Geetha. "Facial emotion detection using modified eyemap–mouthmap algorithm on an enhanced image and classification with tensorflow." The Visual Computer 36.3 (2020): 529-539.
Vimaleswaran, Brindahini, and Gayashini Shyanka Ratnayake. "E-Therapy Improvement Monitoring Platform for Depression using Facial Emotion Detection of Youth." 2021 Third International Conference on Intelligent Communication Technologies and Virtual Mobile Networks (ICICV). IEEE, 2021.
Lakshmi, D., and R. Ponnusamy. "Facial emotion recognition using modified HOG and LBP features with deep stacked autoencoders." Microprocessors and Microsystems 82 (2021): 103834.
Rani, Pooja. "Emotion detection of autistic children using image processing." 2019 Fifth International Conference on Image Information Processing (ICIIP). IEEE, 2019.
Dagar, Debishree, et al. "Automatic emotion detection model from facial expression." 2016 International Conference on Advanced Communication Control and Computing Technologies (ICACCCT). IEEE, 2016.
F. Visin, K. Kastner, K. Cho, M. Matteucci, et al., Renet: A recurrent neural network based alternative to convolutional networks. arXiv preprint arXiv:1505.00393, 2015
F. Visin, K. Kastner, A. Courville, Y. Bengio, et al., ReSeg: A Recurrent Neural Network for Object Segmentation. arXiv preprint arXiv:1511.07053, 2015
P. Khorrami , T. L. Paine , K. Brady, C. Dagli , T. S. Huang, How Deep Neural Networks can Improve Emotion Recognition on Video Data, IEEE Conference on Image Processing (ICIP) , 2016