Movements Recognition in the Human Body Based on Deep Learning Strategies

Muthana S. Mahdi

doi:10.37899/journallamultiapp.v4i1.773

Muthana S. Mahdi Department of Computer Science, College of Science, Mustansiriyah University, Baghdad, Iraq

DOI: https://doi.org/10.37899/journallamultiapp.v4i1.773

Keywords: Emotion Recognition, Body Movement Recognition, Convolutional Neural Network, Non-Verbal Connection, Human Interaction with The Computer

Abstract

These days, the study of human body movements for the purpose of emotion identification is an absolutely necessary component of social communication. Several different contexts call for the implementation of non-verbal communication strategies such as gestures, eye movements, facial expressions, and body language. Among them, emotion detection based on body movements. It can also identify the emotions of a person even if they are too far away from the camera. Other studies have shown that body language can express emotional states more effectively than words can. In this research study, an emotional state is determined by the human motion of the entire body. The architecture of a deep convolution neural network is used, and multiple parameter settings are considered. Both the University of York's emotion dataset, which includes 15 different kinds of emotions, and dataset of GEMEP corpus, which includes five emotions, can be used to assess the proposed system. The results of the experiments demonstrated that the proposed system has a higher degree of recognition accuracy.

References

Acharjya, D. P., Geetha, M. K., & Sanyal, S. (Eds.). (2017). Internet of Things: novel advances and envisioned applications.‏

Arunnehru, J., & Kalaiselvi Geetha, M. (2017). Automatic human emotion recognition in surveillance video. Intelligent techniques in signal processing for multimedia security, 321-342.‏

Asaju, C., & Vadapalli, H. (2022, January). A temporal approach to facial emotion expression recognition. In Artificial Intelligence Research: Second Southern African Conference, SACAIR 2021, Durban, South Africa, December 6–10, 2021, Proceedings (pp. 274-286). Cham: Springer International Publishing.‏

Barros, P., Jirak, D., Weber, C., & Wermter, S. (2015). Multimodal emotional state recognition using sequence-dependent deep hierarchical features. Neural Networks, 72, 140-151.‏

Brock, H. (2018, February). Deep learning—Accelerating Next Generation Performance Analysis Systems?. In Proceedings (Vol. 2, No. 6, p. 303). MDPI.‏

Ebrahimi Kahou, S., Michalski, V., Konda, K., Memisevic, R., & Pal, C. (2015, November). Recurrent neural networks for emotion recognition in video. In Proceedings of the 2015 ACM on international conference on multimodal interaction (pp. 467-474).‏

Elfaramawy, N., Barros, P., Parisi, G. I., & Wermter, S. (2017, October). Emotion recognition from body expressions with a neural network architecture. In Proceedings of the 5th International Conference on Human Agent Interaction (pp. 143-149).‏

Gavrilescu, M. (2015, November). Recognizing emotions from videos by studying facial expressions, body postures and hand gestures. In 2015 23rd Telecommunications Forum Telfor (TELFOR) (pp. 720-723). IEEE.‏

Gunes, H., Shan, C., Chen, S., & Tian, Y. (2015). Bodily expression for automatic affect recognition. Emotion recognition: A pattern analysis approach, 343-377.‏

Holden, D., Saito, J., & Komura, T. (2016). A deep learning framework for character motion synthesis and editing. ACM Transactions on Graphics (TOG), 35(4), 1-11.‏

Khorrami, P., Le Paine, T., Brady, K., Dagli, C., & Huang, T. S. (2016, September). How deep neural networks can improve emotion recognition on video data. In 2016 IEEE international conference on image processing (ICIP) (pp. 619-623). IEEE.‏

LeCun, Y., Bengio, Y., & Hinton, G. (2015). Deep learning. nature, 521(7553), 436-444.‏

Marrero Fernandez, P. D., Guerrero Pena, F. A., Ren, T., & Cunha, A. (2019). Feratt: Facial expression recognition with attention net. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops.‏

Niewiadomski, R., Mancini, M., Varni, G., Volpe, G., & Camurri, A. (2015). Automated laughter detection from full-body movements. IEEE Transactions on Human-Machine Systems, 46(1), 113-123.‏

Noroozi, F., Corneanu, C. A., Kamińska, D., Sapiński, T., Escalera, S., & Anbarjafari, G. (2018). Survey on emotional body gesture recognition. IEEE transactions on affective computing, 12(2), 505-523.‏

Ranganathan, H., Venkateswara, H., Chakraborty, S., & Panchanathan, S. (2017, September). Deep active learning for image classification. In 2017 IEEE International Conference on Image Processing (ICIP) (pp. 3934-3938). IEEE.‏

Santhoshkumar, R., & Geetha, M. K. (2019). Deep learning approach for emotion recognition from human body movements with feedforward deep convolution neural networks. Procedia Computer Science, 152, 158-165.‏

Santhoshkumar, R., Geetha, M. K., & Arunnehru, J. (2017). SVM–KNN based Emotion Recognition of Human in Video using HOG Feature and KLT Tracking Algorithm. International Journal of Pure and Applied Mathematics, 117(15), 621-634.‏

Sati, V., Sánchez, S. M., Shoeibi, N., Arora, A., & Corchado, J. M. (2021). Face detection and recognition, face emotion recognition through NVIDIA Jetson Nano. In Ambient Intelligence–Software and Applications: 11th International Symposium on Ambient Intelligence (pp. 177-185). Springer International Publishing.‏

Shirbhate, N., & Talele, K. (2016, December). Human body language understanding for action detection using geometric features. In 2016 2nd International Conference on Contemporary Computing and Informatics (IC3I) (pp. 603-607). IEEE.‏

Tamhane, S., Shrirao, A., Shah, M., & Patil, D. (2022). Emotion Recognition Using Deep Convolutional Neural Networks. Available at SSRN 4096405.‏

Zhang, L., Wang, S., & Liu, B. (2018). Deep learning for sentiment analysis: A survey. Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery, 8(4), e1253.‏