Trial of Learning Support System for Dialogue with People with Pragmatic Language Disorders Using the Wizard of Oz Method for Typical Development

DOI IPSJ

Bibliographic Information

Other Title
  • 定型発達者を対象とするWizard of Oz法を用いた語用障害をかかえる人との対話学習支援システムの試み

Search this article

Description

語用障害をかかえる人と定型発達者は会話が成立しにくい．この問題の解決策として，定型発達者が具体的かつ明瞭な表現を会話に用いることがあげられる．これらのことから，本研究では，語用障害をかかえる人と定型発達者のコミュニケーションの破綻の問題を定型発達者側から改善するために，語用障害をかかえる人を再現したシステムを開発する．これは，「HoloLens 2」を用いて，語用障害をかかえる人役の3Dキャラクタとの対話から，実際の障がい者との対話を疑似体験し，対話を繰り返しながら伝わりにくい表現や適切な対話方法を学習する，Mixed Reality環境の対話システムである．なお，語用障害をかかえる人の特徴は，Wizard of Oz法を用いて再現した．また，現実の物体と仮想オブジェクトを組み合わせ，様々な会話状況を再現できる．実験として，語用障害をかかえる人とのコミュニケーション経験がないまたは少ない定型発達者22名を対象に，学習者のシステム実行中の動向から，学習効果に影響する原因の解明を行った．

Conversations are difficult between people with pragmatic language disorders. One solution to this problem is that TD uses concrete and straightforward expressions in conversation. Therefore, in this research, to improve the problem of communication failure caused by the characteristics of people with pragmatic language disorders, we develop a system that reproduces people with pragmatic language disorders. This is a dialogue system in a mixed reality environment that simulates a dialogue with a real person with disabilities by using “HoloLens 2” to interact with a 3D character playing the role of people with pragmatic language disorders and learns difficult-to-understand expressions and appropriate dialogue methods through repeated dialogue. The characteristics of people with pragmatic language disorders are reproduced using the Wizard of Oz method. In addition, the system can reproduce various conversational situations by combining real and virtual objects. As an experiment, we investigated the influence on learning effectiveness by looking at learners' behavior while running the system. The experiment subjects were 22 TD who had no or little communication experience with people with pragmatic language disorders.

Journal

Keywords

Details 詳細情報について

Report a problem

Back to top