An Automatic Synthesis of Video Looking Like Playing a Music

  • Yamamoto Tomohiro
    Information Engineering Section Department of Electric Communication, The University of Electro-Communications
  • Mizui Kenta
    Information Engineering Section Department of Electric Communication, The University of Electro-Communications
  • Okabe Makoto
    Department of Computer Science, The University of Electro-Communications
  • Onai Rikio
    Department of Computer Science, The University of Electro-Communications

Bibliographic Information

Other Title
  • 楽曲を演奏しているように見える動画の自動生成(メディア処理とバイオメトリクス及び一般)
  • 楽曲を演奏しているように見える動画の自動生成
  • ガッキョク オ エンソウ シテ イル ヨウニ ミエル ドウガ ノ ジドウ セイセイ

Search this article

Description

We propose the method to automatically synthesize a video, where a player looks like playing a user-specified music. Our current target performance is violin solo. We first create a video database of violin solo performance. For each video, we analyze its music and extract the timing of each note. Given an input music, we divide it into fragments and analyze timings of notes. For each fragment, the timing information is used to search for an appropriate video from the database. We render the final animation applying time warping. We demonstrate our method can synthesize a fake performance video of various types of violin solo music.

Journal

  • ITE Technical Report

    ITE Technical Report 34.54 (0), 21-24, 2010

    The Institute of Image Information and Television Engineers

References(8)*help

See more

Details 詳細情報について

Report a problem

Back to top