An Interface Agent System Employing an ATMS-Based Multimodal Input Interpretation Method

DOI Web Site 6 Citations 21 References

Bibliographic Information

Other Title
  • ATMSベースのマルチモーダル入力統合方式を用いたインタフェースエージェントシステム
  • ATMS ベース ノ マルチモーダル ニュウリョク トウゴウ ホウシキ オ モ

Search this article

Description

<p>Two requirements should be met in order to develop a practical multimodal interface system, i.e., (1) integration of delayed arrival of data, and (2) elimination of ambiguity in recognition results of each modality. This paper presents an efficient and generic methodology for interpretation of multimodal input to satisfy these requirements. It is able to integrate delayed-arrival data well, and is able to efficiently interpret multimodal input that contains ambiguity by regarding the multimodal interpretation process as hypothetical reasoning and formalizing the control mechanism of interpretation on the basis of the ATMS (Assumption-based Truth Maintenance System). The proposed method is incorporated into an interface agent system that accepts multimodal input consisting of voice and direct indication gesture on a touch display. The system communicates to the user through the interface agent's 3D motion image with facial expressions, gesture, and synthesized voice.</p>

Journal

Citations (6)*help

See more

References(21)*help

See more

Keywords

Details 詳細情報について

Report a problem

Back to top