Recognition of Synergetic Functions between Head Movements and Facial Expressions in Conversations

DOI

Bibliographic Information

Other Title
  • 対話中の頭部運動と顔表情の相乗機能の認識

Abstract

This paper proposes machine-learning models for recognizing the synergetic functions between facial expressions and head movements in conversations. To discover such synergetic functions, we built a functional facial-expression corpus, which includes various facial functions beyond the affect display, and analyzed it with the functional head-movement corpus. The analysis revealed some types of synergetic relationships between the facial expressions and head movements, including reinforcement, multiplexing, and complement. To recognize such synergetic functions, we build several models using convolutional neural networks (CNNs), which input facial action-unit and head-pose sequences. The experiment results confirmed the potential of the proposed models.

Journal

Related Projects

See more

Details 詳細情報について

Report a problem

Back to top