Text normalization based on deep learning considering similarities in terms of strings and sounds
-
- KAWAMURA Riku
- Tokyo Institute of Technology
-
- AOKI Tatsuya
- Tokyo Institute of Technology
-
- KAMIGAITO Hidetaka
- Tokyo Institute of Technology
-
- TAKAMURA Hiroya
- Tokyo Institute of Technology National Institute of Advanced Industrial Science and Technology
-
- OKUMURA Manabu
- Tokyo Institute of Technology
Bibliographic Information
- Other Title
-
- 文字列・音の類似度を考慮した深層学習に基づくテキストの正規化
Abstract
<p>In this paper, we propose deep learning based models that can normalize text by considering the similarities of word strings and sounds. In the experiments, we compare the model that considers both the similarities of word strings and sounds, the model that considers only the similarity of word strings and of sounds, and the model without the similarities as a baseline model. As a result, all the proposed models achieved higher F1 score than the baseline model.</p>
Journal
-
- Proceedings of the Annual Conference of JSAI
-
Proceedings of the Annual Conference of JSAI JSAI2020 (0), 3Rin409-3Rin409, 2020
The Japanese Society for Artificial Intelligence
- Tweet
Keywords
Details 詳細情報について
-
- CRID
- 1390285300166233984
-
- NII Article ID
- 130007857138
-
- Text Lang
- ja
-
- Data Source
-
- JaLC
- CiNii Articles
-
- Abstract License Flag
- Disallowed