Multimodal Emotion Recognition Using Non-Inertial Loss Function

DOI Web Site 16 References Open Access
  • Orgil Jargalsaikhan
    Graduate School of Technology, Industrial and Social Sciences, Tokushima University
  • Karungaru Stephen
    Graduate School of Technology, Industrial and Social Sciences, Tokushima University
  • Terada Kenji
    Graduate School of Technology, Industrial and Social Sciences, Tokushima University
  • Shagdar Ganbold
    Graduate School of Information and Communication Technology, Mongolian University of Science Technology

Description

<p>Automatic understanding of human emotion in a wild setting using audiovisual signals is extremely challenging. Latent continuous dimensions can be used to accomplish the analysis of human emotional states, behaviors, and reactions displayed in real-world settings. Moreover, Valence and Arousal combinations constitute well-known and effective representations of emotions. In this paper, a new Non-inertial loss function is proposed to train emotion recognition deep learning models. It is evaluated in wild settings using four types of candidate networks with different pipelines and sequence lengths. It is then compared to the Concordance Correlation Coefficient (CCC) and Mean Squared Error (MSE) losses commonly used for training. To prove its effectiveness on efficiency and stability in continuous or non-continuous input data, experiments were performed using the Aff-Wild dataset. Encouraging results were obtained.</p>

Journal

References(16)*help

See more

Keywords

Details 詳細情報について

Report a problem

Back to top