3DCNNテンプレートを用いたヒト脳聴覚野における複合音推定システムの提案

書誌事項

タイトル別名
  • Proposal of a Complex Sound Estimation System in Human Brain Auditory Cortex Using 3DCNN Template

抄録

<p>The purpose of this study is to decode complex sounds given as auditory stimulus from the brain image acquired by fMRI. In this report, we propose a system for estimating complex sounds using 3DCNN, one of the deep learning methods. In the proposed system, to estimate complex sounds composed of multiple pitches, a two-output 3DCNN model that can identify only sound of specific pitch was created as a deep learning template for each pitches. And the scale of auditory stimulus is estimated combining the sound of specific pitch detected by the deep learning template for each pitches. As verification, 20 kinds of compound sounds with 3 sounds selected from 6 different pitches were estimated using the proposed system. The deep learning templates were created using brain image of one subject for every six pitches. As the result, the maximum estimation rate was 45.00%. And the average estimation rate was 34.72%. Although the estimation rate of each deep learning template needs to be improved, we think that the structure of superimposing a deep learning template on each pitches is useful.</p>

収録刊行物

  • 年次大会

    年次大会 2021 (0), J163-16-, 2021

    一般社団法人 日本機械学会

詳細情報 詳細情報について

問題の指摘

ページトップへ