{"@context":{"@vocab":"https://cir.nii.ac.jp/schema/1.0/","rdfs":"http://www.w3.org/2000/01/rdf-schema#","dc":"http://purl.org/dc/elements/1.1/","dcterms":"http://purl.org/dc/terms/","foaf":"http://xmlns.com/foaf/0.1/","prism":"http://prismstandard.org/namespaces/basic/2.0/","cinii":"http://ci.nii.ac.jp/ns/1.0/","datacite":"https://schema.datacite.org/meta/kernel-4/","ndl":"http://ndl.go.jp/dcndl/terms/","jpcoar":"https://github.com/JPCOAR/schema/blob/master/2.0/"},"@id":"https://cir.nii.ac.jp/crid/1360004236646582528.json","@type":"Article","productIdentifier":[{"identifier":{"@type":"DOI","@value":"10.1177/0278364915587923"}},{"identifier":{"@type":"URI","@value":"https://journals.sagepub.com/doi/pdf/10.1177/0278364915587923"}},{"identifier":{"@type":"URI","@value":"https://journals.sagepub.com/doi/full-xml/10.1177/0278364915587923"}}],"resourceType":"学術雑誌論文(journal article)","dc:title":[{"@value":"Statistical mutual conversion between whole body motion primitives and linguistic sentences for human motions"}],"description":[{"type":"abstract","notation":[{"@value":"<jats:p> This paper describes a novel approach to linguistic mutual inference, which enables robots not only to linguistically interpret the motion patterns in the form of sentences but also to generate the motions from the sentences. The inference can be established based on two modules, the motion language model and the natural language model. The motion language model stochastically represents an association structure between symbols of motion patterns and the words in sentences assigned to the motion. This is a statistical model with a three layered structure of motion symbols, latent states and words. The natural language model statistically represents a structure of sentences based on word bigrams. The motion language model and the natural language model correspond to semantics and syntax respectively. An approach to the integration of motion language model with the natural language model allows the linguistic mutual inference for the robots. The two kinds of inference can be made by solving search problems, search for a sequence of words corresponding to a motion and search for a symbol of motion pattern corresponding to a sentence. The proposed approach to interpretation of motion patterns as sentences and generation of motion patterns from the sentences through the integration of motion language model with the natural language model is validated by an experiment on the human behavioral data. </jats:p>"}]}],"creator":[{"@id":"https://cir.nii.ac.jp/crid/1420845751160891008","@type":"Researcher","personIdentifier":[{"@type":"KAKEN_RESEARCHERS","@value":"30512090"},{"@type":"NRID","@value":"1000030512090"},{"@type":"NRID","@value":"9000005879064"},{"@type":"NRID","@value":"9000392709226"},{"@type":"NRID","@value":"9000402795064"},{"@type":"NRID","@value":"9000401606278"},{"@type":"NRID","@value":"9000399367844"},{"@type":"NRID","@value":"9000397679449"},{"@type":"NRID","@value":"9000256277740"},{"@type":"NRID","@value":"9000411951380"},{"@type":"NRID","@value":"9000400158062"},{"@type":"NRID","@value":"9000397679333"},{"@type":"NRID","@value":"9000331421964"},{"@type":"NRID","@value":"9000022036674"},{"@type":"NRID","@value":"9000375893466"},{"@type":"NRID","@value":"9000409336831"},{"@type":"NRID","@value":"9000397676542"},{"@type":"NRID","@value":"9000410877520"},{"@type":"NRID","@value":"9000399368578"},{"@type":"NRID","@value":"9000293528712"},{"@type":"NRID","@value":"9000017503663"},{"@type":"NRID","@value":"9000240042979"},{"@type":"NRID","@value":"9000405879030"},{"@type":"NRID","@value":"9000397676379"},{"@type":"NRID","@value":"9000391913536"},{"@type":"NRID","@value":"9000402794311"},{"@type":"NRID","@value":"9000258630174"},{"@type":"NRID","@value":"9000020877606"},{"@type":"NRID","@value":"9000345430034"},{"@type":"NRID","@value":"9000397667250"},{"@type":"RESEARCHMAP","@value":"https://researchmap.jp/Wataru_Takano"}],"foaf:name":[{"@value":"Wataru Takano"}],"jpcoar:affiliationName":[{"@value":"Mechano-Informatics, The University of Tokyo, Japan"}]},{"@id":"https://cir.nii.ac.jp/crid/1380004236646582400","@type":"Researcher","foaf:name":[{"@value":"Yoshihiko Nakamura"}],"jpcoar:affiliationName":[{"@value":"Mechano-Informatics, The University of Tokyo, Japan"}]}],"publication":{"publicationIdentifier":[{"@type":"PISSN","@value":"02783649"},{"@type":"EISSN","@value":"17413176"}],"prism:publicationName":[{"@value":"The International Journal of Robotics Research"}],"dc:publisher":[{"@value":"SAGE Publications"}],"prism:publicationDate":"2015-07-24","prism:volume":"34","prism:number":"10","prism:startingPage":"1314","prism:endingPage":"1328"},"reviewed":"false","dc:rights":["https://journals.sagepub.com/page/policies/text-and-data-mining-license"],"url":[{"@id":"https://journals.sagepub.com/doi/pdf/10.1177/0278364915587923"},{"@id":"https://journals.sagepub.com/doi/full-xml/10.1177/0278364915587923"}],"createdAt":"2015-07-25","modifiedAt":"2025-02-27","project":[{"@id":"https://cir.nii.ac.jp/crid/1040000782313744256","@type":"Project","projectIdentifier":[{"@type":"KAKEN","@value":"26700021"},{"@type":"JGN","@value":"JP26700021"},{"@type":"URI","@value":"https://kaken.nii.ac.jp/grant/KAKENHI-PROJECT-26700021/"}],"notation":[{"@language":"ja","@value":"運動データベースからロボットの実世界運動制御への展開"},{"@language":"en","@value":"Motion Control of Humanoid Robots from Human Motion Database"}]}],"relatedProduct":[{"@id":"https://cir.nii.ac.jp/crid/1360004231326065280","@type":"Article","resourceType":"学術雑誌論文(journal article)","relationType":["isReferencedBy"],"jpcoar:relatedTitle":[{"@value":"Sequential Monte Carlo controller that integrates physical consistency and motion knowledge"}]},{"@id":"https://cir.nii.ac.jp/crid/1360004231444253952","@type":"Article","resourceType":"学術雑誌論文(journal article)","relationType":["isReferencedBy"],"jpcoar:relatedTitle":[{"@value":"Classification of Multi-class Daily Human Motion using Discriminative Body Parts and Sentence Descriptions"}]},{"@id":"https://cir.nii.ac.jp/crid/1360011143849207040","@type":"Article","relationType":["references"],"jpcoar:relatedTitle":[{"@value":"Discriminative and adaptive imitation in uni-manual and bi-manual tasks"}]},{"@id":"https://cir.nii.ac.jp/crid/1360011144279224320","@type":"Article","relationType":["references"],"jpcoar:relatedTitle":[{"@value":"Polynomial design of the nonlinear dynamics for the brain-like information processing of whole body motion"}]},{"@id":"https://cir.nii.ac.jp/crid/1360011145010375808","@type":"Article","relationType":["references"],"jpcoar:relatedTitle":[{"@value":"Online Segmentation and Clustering From Continuous Observation of Whole Body Motions"}]},{"@id":"https://cir.nii.ac.jp/crid/1360011145051224448","@type":"Article","relationType":["references"],"jpcoar:relatedTitle":[{"@value":"Two-way translation of compound sentences and arm motions by recurrent neural networks"}]},{"@id":"https://cir.nii.ac.jp/crid/1360021391885343360","@type":"Article","resourceType":"学術雑誌論文(journal article)","relationType":["isReferencedBy"],"jpcoar:relatedTitle":[{"@value":"Operative Action Captioning for Estimating System Actions"}]},{"@id":"https://cir.nii.ac.jp/crid/1360285707461821824","@type":"Article","resourceType":"学術雑誌論文(journal article)","relationType":["isReferencedBy"],"jpcoar:relatedTitle":[{"@value":"Planning of goal-oriented motion from stochastic motion primitives and optimal controlling of joint torques in whole-body"}]},{"@id":"https://cir.nii.ac.jp/crid/1360285709079314176","@type":"Article","resourceType":"学術雑誌論文(journal article)","relationType":["isReferencedBy"],"jpcoar:relatedTitle":[{"@value":"Spatial representation of context-dependent sentences and its application to sentence generation"}]},{"@id":"https://cir.nii.ac.jp/crid/1360292619409800448","@type":"Article","relationType":["references"],"jpcoar:relatedTitle":[{"@value":"Controlling humanoid robots with human motion data: Experimental validation"}]},{"@id":"https://cir.nii.ac.jp/crid/1360292619561912576","@type":"Article","relationType":["references"],"jpcoar:relatedTitle":[{"@value":"Mirror neurons and the simulation theory of mind-reading"}]},{"@id":"https://cir.nii.ac.jp/crid/1360574095061779584","@type":"Article","relationType":["references"],"jpcoar:relatedTitle":[{"@value":"Learning Semantic Combinatoriality from the Interaction between Linguistic                 and Behavioral Processes"}]},{"@id":"https://cir.nii.ac.jp/crid/1360574096318906880","@type":"Article","relationType":["references"],"jpcoar:relatedTitle":[{"@value":"Bag of multimodal LDA models for concept formation"}]},{"@id":"https://cir.nii.ac.jp/crid/1360580230637100672","@type":"Article","resourceType":"学術雑誌論文(journal article)","relationType":["isReferencedBy"],"jpcoar:relatedTitle":[{"@value":"Towards understanding and synthesis of contact-rich anthropomorphic motions through interactive cyber-physical human"}]},{"@id":"https://cir.nii.ac.jp/crid/1360848656256187520","@type":"Article","resourceType":"学術雑誌論文(journal article)","relationType":["isReferencedBy"],"jpcoar:relatedTitle":[{"@value":"Linking human motions and objects to language for synthesizing action sentences"}]},{"@id":"https://cir.nii.ac.jp/crid/1360848657322829952","@type":"Article","resourceType":"学術雑誌論文(journal article)","relationType":["isReferencedBy"],"jpcoar:relatedTitle":[{"@value":"Generating action descriptions from statistically integrated representations of human motions and sentences"}]},{"@id":"https://cir.nii.ac.jp/crid/1360849942196803200","@type":"Article","resourceType":"学術雑誌論文(journal article)","relationType":["isReferencedBy"],"jpcoar:relatedTitle":[{"@value":"Representation and classification of whole-body motion integrated with finger motion"}]},{"@id":"https://cir.nii.ac.jp/crid/1360855568452460416","@type":"Article","relationType":["references"],"jpcoar:relatedTitle":[{"@value":"Embodied Symbol Emergence Based on Mimesis Theory"}]},{"@id":"https://cir.nii.ac.jp/crid/1361137044662157696","@type":"Article","relationType":["references"],"jpcoar:relatedTitle":[{"@value":"Measurement of lower extremity kinematics during level walking"}]},{"@id":"https://cir.nii.ac.jp/crid/1361412895254613632","@type":"Article","resourceType":"学術雑誌論文(journal article)","relationType":["isReferencedBy"],"jpcoar:relatedTitle":[{"@value":"Sentence Generation from IMU-based Human Whole-Body Motions in Daily Life Behaviors"}]},{"@id":"https://cir.nii.ac.jp/crid/1361418518530015616","@type":"Article","relationType":["references"],"jpcoar:relatedTitle":[{"@value":"Self-organization of behavioral primitives as multiple attractor dynamics: A robot experiment"}]},{"@id":"https://cir.nii.ac.jp/crid/1361975845152688640","@type":"Article","resourceType":"学術雑誌論文(journal article)","relationType":["isReferencedBy"],"jpcoar:relatedTitle":[{"@value":"Action Description From 2D Human Postures in Care Facilities"}]},{"@id":"https://cir.nii.ac.jp/crid/1361981468792428032","@type":"Article","relationType":["references"],"jpcoar:relatedTitle":[{"@value":"Statistically integrated semiotics that enables mutual inference between linguistic and behavioral symbols for humanoid robots"}]},{"@id":"https://cir.nii.ac.jp/crid/1361981470618903296","@type":"Article","relationType":["references"],"jpcoar:relatedTitle":[{"@value":"Verbs and adverbs: multidimensional motion interpolation"}]},{"@id":"https://cir.nii.ac.jp/crid/1362262944395530624","@type":"Article","relationType":["references"],"jpcoar:relatedTitle":[{"@value":"Associative processes between behavioral symbols and a large scale language model"}]},{"@id":"https://cir.nii.ac.jp/crid/1362544418535662720","@type":"Article","relationType":["references"],"jpcoar:relatedTitle":[{"@value":"Interactive topology formation of linguistic space and motion space"}]},{"@id":"https://cir.nii.ac.jp/crid/1362544418892652928","@type":"Article","relationType":["references"],"jpcoar:relatedTitle":[{"@value":"Neurophysiological mechanisms underlying the understanding and imitation of action"}]},{"@id":"https://cir.nii.ac.jp/crid/1362544420556141184","@type":"Article","relationType":["references"],"jpcoar:relatedTitle":[{"@value":"Symbolic memory for humanoid robots using hierarchical bifurcations of attractors in nonmonotonic neural networks"}]},{"@id":"https://cir.nii.ac.jp/crid/1362825895713128320","@type":"Article","relationType":["references"],"jpcoar:relatedTitle":[{"@value":"Imitation Learning of Dual-Arm Manipulation Tasks in Humanoid Robots"}]},{"@id":"https://cir.nii.ac.jp/crid/1363107369415391744","@type":"Article","relationType":["references"],"jpcoar:relatedTitle":[{"@value":"Motion capture based human motion recognition and imitation by direct marker control"}]},{"@id":"https://cir.nii.ac.jp/crid/1363107370375962368","@type":"Article","relationType":["references"],"jpcoar:relatedTitle":[{"@value":"Motion synthesis from annotations"}]},{"@id":"https://cir.nii.ac.jp/crid/1363388843593180032","@type":"Article","relationType":["references"],"jpcoar:relatedTitle":[{"@value":"Learning from Observation Paradigm: Leg Task Models for Enabling a Biped                 Humanoid Robot to Imitate Human Dances"}]},{"@id":"https://cir.nii.ac.jp/crid/1363951793503048448","@type":"Article","relationType":["references"],"jpcoar:relatedTitle":[{"@value":"Active learning of confidence measure function in robot language acquisition framework"}]},{"@id":"https://cir.nii.ac.jp/crid/1364233268629260672","@type":"Article","relationType":["references"],"jpcoar:relatedTitle":[{"@value":"Bigram-based natural language model and statistical motion symbol model for scalable language of humanoid robots"}]},{"@id":"https://cir.nii.ac.jp/crid/1364233271211393280","@type":"Article","relationType":["references"],"jpcoar:relatedTitle":[{"@value":"Capture Database through Symbolization, Recognition and Generation of Motion Patterns"}]},{"@id":"https://cir.nii.ac.jp/crid/1390569923320570240","@type":"Article","relationType":["isReferencedBy"],"jpcoar:relatedTitle":[{"@language":"en","@value":"Measurement, Control and Language of Whole Body Motions"},{"@language":"ja","@value":"身体運動の計測・制御・言語化技術"},{"@language":"ja-Kana","@value":"シンタイ ウンドウ ノ ケイソク ・ セイギョ ・ ゲンゴカ ギジュツ"}]}],"dataSourceIdentifier":[{"@type":"CROSSREF","@value":"10.1177/0278364915587923"},{"@type":"KAKEN","@value":"PRODUCT-20668846"},{"@type":"OPENAIRE","@value":"doi_dedup___::926fa9bff97aa09b8184ae4f4e811167"},{"@type":"CROSSREF","@value":"10.1007/s10514-018-9815-5_references_DOI_XzI2focsESlefMjLH8F9nD4vUWw"},{"@type":"CROSSREF","@value":"10.1007/s11263-017-1053-3_references_DOI_XzI2focsESlefMjLH8F9nD4vUWw"},{"@type":"CROSSREF","@value":"10.1016/j.neunet.2016.03.001_references_DOI_XzI2focsESlefMjLH8F9nD4vUWw"},{"@type":"CROSSREF","@value":"10.1109/icra48891.2023.10161545_references_DOI_XzI2focsESlefMjLH8F9nD4vUWw"},{"@type":"CROSSREF","@value":"10.1080/01691864.2017.1351392_references_DOI_XzI2focsESlefMjLH8F9nD4vUWw"},{"@type":"CROSSREF","@value":"10.1109/lra.2020.2965394_references_DOI_XzI2focsESlefMjLH8F9nD4vUWw"},{"@type":"CROSSREF","@value":"10.1109/sii46433.2020.9026240_references_DOI_XzI2focsESlefMjLH8F9nD4vUWw"},{"@type":"CROSSREF","@value":"10.3389/frobt.2022.1019523_references_DOI_XzI2focsESlefMjLH8F9nD4vUWw"},{"@type":"CROSSREF","@value":"10.1007/s10514-018-9762-1_references_DOI_XzI2focsESlefMjLH8F9nD4vUWw"},{"@type":"CROSSREF","@value":"10.7210/jrsj.39.411_references_DOI_XzI2focsESlefMjLH8F9nD4vUWw"},{"@type":"CROSSREF","@value":"10.1016/j.robot.2019.103378_references_DOI_XzI2focsESlefMjLH8F9nD4vUWw"},{"@type":"CROSSREF","@value":"10.1016/j.robot.2017.01.013_references_DOI_XzI2focsESlefMjLH8F9nD4vUWw"}]}