Blink-former: Light-aided beamforming for multiple targets enhancement

DOI PDF 被引用文献4件 参考文献15件
  • Daiki Horiike
    Graduate School of System Design, Tokyo Metropolitan University,Tokyo,Japan,191-0065
  • Robin Scheibler
    Graduate School of System Design, Tokyo Metropolitan University,Tokyo,Japan,191-0065
  • Yukoh Wakabayashi
    Graduate School of System Design, Tokyo Metropolitan University,Tokyo,Japan,191-0065
  • Nobutaka Ono
    Graduate School of System Design, Tokyo Metropolitan University,Tokyo,Japan,191-0065

書誌事項

公開日
2019-09
資源種別
journal article
権利情報
  • https://doi.org/10.15223/policy-029
  • https://doi.org/10.15223/policy-037
DOI
  • 10.1109/mmsp.2019.8901799
公開者
IEEE

説明

We propose a multimodal framework to enhance multiple target sound sources using a conventional microphone array, a video camera, and sound power sensors, called Blinkies, that we have recently developed. Each Blinky consists of a microphone, LEDs, a microcontroller, and a battery. One of the LEDs intensity is varied according to sound power, that is, the Blinky works as a sound-to-light conversion sensor. They are easy to distribute over a large area, and thus, the sound power information therein can be harvested by capturing the LED signals with a video camera. Although these signals are a mixture of contributions from multiple sources, we demonstrate that they can be separated into individual source activities by non-negative matrix factorization. The obtained activities are further utilized to design maximum signal-to-interference-and-noise ratio beamformers enhancing the source signals. We conduct numerical simulations and real experiments to evaluate the performance of this method in diffuse noise environment. The experimental results show that the proposed scheme using Blinkies is superior to competing algorithms, especially at low signal-to-noise ratio.

収録刊行物

被引用文献 (4)*注記

もっと見る

参考文献 (15)*注記

もっと見る

関連プロジェクト

もっと見る

詳細情報 詳細情報について

問題の指摘

ページトップへ