Recognition of Synergetic Functions between Head Movements and Facial Expressions in Conversations
-
- IMAMURA Mai
- Yokohama National University
-
- TAKEDA Kazuki
- Yokohama National University
-
- KUMANO Shiro
- NTT Corporation
-
- OTSUKA Kazuhiro
- Yokohama National University
Bibliographic Information
- Other Title
-
- 対話中の頭部運動と顔表情の相乗機能の認識
Abstract
This paper proposes machine-learning models for recognizing the synergetic functions between facial expressions and head movements in conversations. To discover such synergetic functions, we built a functional facial-expression corpus, which includes various facial functions beyond the affect display, and analyzed it with the functional head-movement corpus. The analysis revealed some types of synergetic relationships between the facial expressions and head movements, including reinforcement, multiplexing, and complement. To recognize such synergetic functions, we build several models using convolutional neural networks (CNNs), which input facial action-unit and head-pose sequences. The experiment results confirmed the potential of the proposed models.
Journal
-
- 電子電子情報通信学会論文誌A 基礎・境界
-
電子電子情報通信学会論文誌A 基礎・境界 J106-A (3), 70-87, 2023-03-01
The Institute of Electronics, Information and Communication Engineers
- Tweet
Details 詳細情報について
-
- CRID
- 1390295203824832128
-
- ISSN
- 18810195
-
- Text Lang
- ja
-
- Data Source
-
- JaLC
- KAKEN
-
- Abstract License Flag
- Disallowed