Multimedia Description Language and Its Application to Intelligent Cross-media Referencing Systems

In general, it is very difficult for people to exploit necessary information from the immense multimedia contents over the WWW. It is still more difficult to search for desirable contents by queries in different media，for example，text queries for pictorial contents. In this case, intelligent systems facilitating cross-media reference are very helpful. Mental Image Directed Semantic Theory (MIDST) has proposed a cognitively motivated methodology for intermediate knowledge representation. This paper presents a formal language for describing multimedia contents， Lmd， whose syntax and semantics are based on MIDST and its application to cross-media reference between linguistic and pictorial expressions of space and time，which we think will serve as a good basis for more intelligent networking.

In general, it is very difficult for people to exploit necessary information from the immense multimedia contents over the WWW. It is still more difficult to search for desirable contents by queries in different media，for example，text queries for pictorial contents. In this case, intelligent systems facilitating cross-media reference are very helpful. Mental Image Directed Semantic Theory (MIDST) has proposed a cognitively motivated methodology for intermediate knowledge representation. This paper presents a formal language for describing multimedia contents， Lmd， whose syntax and semantics are based on MIDST and its application to cross-media reference between linguistic and pictorial expressions of space and time，which we think will serve as a good basis for more intelligent networking.