Expression of non-verbal information for a speech synthesis method using a pointing device : As an emotional expression aid during communication

DOI Web Site 1 Citations 12 References
  • Yabu Ken-ichiro
    Graduate School of System Design, Tokyo Metropolitan University
  • Ifukube Tohru
    Research Center for Advanced Science and Technology, University of Tokyo
  • Aomura Shigeru
    Graduate School of System Design, Tokyo Metropolitan University

Bibliographic Information

Other Title
  • ポインティングデバイス型音声生成方式における非言語情報の表出 : 会話時における感情表現手段として
  • ポインティングデバイスガタ オンセイ セイセイ ホウシキ ニ オケル ヒゲンゴ ジョウホウ ノ ヒョウシュツ カイワジ ニ オケル カンジョウ ヒョウゲン シュダン ト シテ

Search this article

Abstract

In the previous report, we proposed a speech production substitute using a pen-tablet and a wearable PC. From the evaluation tests, it was found that by tracing the tablet using a pen, some consonants contained in the continuous speech sounds were perceived even though the consonants did not phonetically exist. Furthermore, it was quite easy to produce non-verbal expression by changing the movement velocity and a touching rhythm. Our speech production method is very effective for a communication tool of people with aphasia or with some articulation difficulties. It would also make them to communicate with their families as well as during speech rehabilitation. In this paper, two pitch control methods were added to the prototype model in order for users to produce more emotional expression than the prototype. One is an intonation producing method that uses a touch panel having a pressure sensor and the other is a song producing method that uses a MIDI (Musical Instrument Digital Interface) keyboard. After an experiment by short-time training, some emotional expression such as laughing and surprising could be produced. Furthermore, one of famous Japanese songs also could be produced by using the pen-tablet with a MIDI keyboard. From the evaluation test, our new models adding intonation and melody are effective for communication with their families or during speech rehabilitation.

Journal

Citations (1)*help

See more

References(12)*help

See more

Related Projects

See more

Keywords

Details 詳細情報について

Report a problem

Back to top