Affect-as-Information Approach to a Sentiment Analysis Based Evaluation of Conversational Agents
Description
In this paper we propose a novel method forautomatic evaluation of conversational agents. Themethod is based on analyzing the user’s affectconveyed in utterances. From analyzing: the user’sgeneral emotional engagement in the conversation andthe emotion types conveyed by the user in theconversation, a simple psychological reasoning isderived about the user’s sentiment about the agent’sperformance. The evaluation experiment on twoJapanese-speaking conversational agents showed thesame tendencies in the results returned by the systemconstructed on the proposed method and the user’sopinion about the two agents checked in the afterwardsurvey. Thus the method can be used for evaluation ofJapanese-speaking conversational agents.
Journal
-
- Proceedings of the 2008 International Conference on Intelligent Agents, Web Technologies & Internet Commerce (IAWTIC'08)
-
Proceedings of the 2008 International Conference on Intelligent Agents, Web Technologies & Internet Commerce (IAWTIC'08) 901-906, 2017-01-16
- Tweet
Details 詳細情報について
-
- CRID
- 1050282677780790656
-
- NII Article ID
- 120006661402
-
- HANDLE
- 2115/64078
-
- Text Lang
- en
-
- Article Type
- conference paper
-
- Data Source
-
- IRDB
- CiNii Articles