Human Information. Finding the Correspondence of Audio-Visual Events Caused by Multiple Movements.

DOI Web Site Web Site 8 Citations 20 References

Bibliographic Information

Other Title
  • 複数運動で生じた視聴覚事象の対応付け
  • Finding the Correspondence of Audio-Visual Events Caused by Multiple Movements

Search this article

Abstract

We understand the environment by integrating information obtained by the senses of sight, hearing and touch. To integrate information across different senses, we must find the correspondence of events observed by different senses. This paper presents a general method for relating the audio-visual events of more than one movement (repetitive and non-repetitive movement) observed by one camera and one microphone. The method uses general laws without object-specific knowledge. As corresponding cues, we use Gestalt's grouping laws : simultaneity of the occurrence of the sound and the change in movement, and similarity of repetition between sound and movement. We conducted experiments in the real environment, and obtained satisfactory results showing the effectiveness of the proposed method.

Journal

Citations (8)*help

See more

References(20)*help

See more

Keywords

Details 詳細情報について

Report a problem

Back to top