Contextualized Multi-Sense Word Embedding

DOI Web Site Web Site 17 References

Bibliographic Information

Other Title
  • 多義語分散表現の文脈化
  • タギゴ ブンサン ヒョウゲン ノ ブンミャクカ

Search this article

Abstract

<p>Currently, distributed word representations are employed in many natural language processing tasks. However, when generating one representation for each word, the meanings of a polysemous word cannot be differentiated because the meanings are integrated into one representation. Therefore, several attempts have been made to generate different representations per meaning based on parts of speech or the topic of a sentence. However, these methods are too unrefined to deal with polysemy. In this paper, we proposed two methods to generate more subtle multiple word representations. The first method involves generating multiple word representations using the word in a dependency relationship as a clue. The second approach involves employing a bi-directional language model in which a word representation that considers all the words in the context is generated. The results of the extensive evaluation of the Lexical Substitution task and Context-Aware Word Similarity task confirmed the effectiveness of our approaches to generate more subtle multiple word representations. </p>

Journal

References(17)*help

See more

Keywords

Details 詳細情報について

Report a problem

Back to top