深層学習を用いた押下動作映像からの硬さ推定

書誌事項

タイトル別名
  • Softness Estimation Based on Images of Pushing Action Using Deep Learning
公開日
2018
DOI
  • 10.18974/tvrsj.23.4_239
公開者
特定非営利活動法人 日本バーチャルリアリティ学会

この論文をさがす

説明

<p>In this research, we propose a method that estimates the softness of an object based on the motion images of a hand and a forearm when a target object is pushed with a stick. The softness of the object is estimated from those images by using deep learning. For the motion recognition, we capture a series of RGB-D images with a depth camera. A subject pushes objects of different softness with a stick for collecting motion images for learning. Then the captured images are learned through Convolutional Neural Network and their characteristics are parameterized appropriately to achieve the softness estimation system. The results of softness estimation show that root mean square error of the estimated value of non-learned softness scores within 5 points in durometer hardness. It means that pushing motions of human beings include tactile information that leads to estimate the target object softness and our system can recognize it accurately. We also confirmed that using all the 3 types of images (RGB-image, depth image and Canny edge image) as the input results in the highest accuracy for both personalized and generalized networks.</p>

収録刊行物

詳細情報 詳細情報について

  • CRID
    1390001288106923136
  • NII論文ID
    130007599212
  • DOI
    10.18974/tvrsj.23.4_239
  • ISSN
    24239593
    1344011X
  • 本文言語コード
    ja
  • データソース種別
    • JaLC
    • CiNii Articles
  • 抄録ライセンスフラグ
    使用不可

問題の指摘

ページトップへ