A speech synthesis method using a pointing device : As a speaking aid for speech disorders

  • Yabu Ken-ichiro
    Graduate School of System Design, Tokyo Metropolitan University
  • Ifukube Tohru
    Research Center for Advanced Science and Technology, University of Tokyo
  • Aomura Shigeru
    Graduate School of System Design, Tokyo Metropolitan University

Bibliographic Information

Other Title
  • ポインティングデバイスを利用した音声生成方式 : 発話障害者のための支援機器として
  • ポインティングデバイス オ リヨウ シタ オンセイ セイセイ ホウシキ ハツワ ショウガイシャ ノ タメ ノ シエン キキ ト シテ

Search this article

Abstract

We have proposed a speech production substitute which makes up for a function of articulation by using a pointing device and a wearable PC. In our substitute method, parameters for controlling the device were determined by a position and movement of user's finger. The parameters were minimized as much as possible by considering perceptual characteristics of human speech recognition. We made a prototype model using formant synthesis software on a personal computer and using a pen-tablet interface for the pointing device. In the evaluation tests, 5 continuous speech sounds, which were synthesized by tracing the pen-tablet, were used for recognition test. Although random noise sounds producing fricative and plosive consonants did not exist in the sentences, most consonants contained in the continuous speech sounds were recognizable. Furthermore, it was able to produce emotional expression by changing the movement velocity and a touching rhythm. Since how to handle the device is easy, it is anticipated that our speech production method is very effective for people with some articulation difficulties as one of communication tools in their daily life.

Journal

Citations (5)*help

See more

References(16)*help

See more

Related Projects

See more

Details 詳細情報について

Report a problem

Back to top