High Speed Morphological Analysis using DFA

MORI Shinsuke

Bibliographic Information

Other Title

DFAによる形態素解析の高速化

Description

Morphological analysis, which segments the input sentence into words and attaches parts of speech to them, is the most fundamental process of Japanese language processing. This process contains dictionary look-up of all substrings of input sentence. In this paper, we propose a method to convert the dictionary into a deterministic finite automaton and realize high-speed dictionary look-up. An advantage of our method is that it enables faster dictionary look-up and a disadvantage is that required memory space is larger than AC method-based dictionary look-up. The experimental results tells that our method requires 16.1 times as large memory space as AC method and is 11.7 times as fast as AC method in dictionary look-up.

Journal

IPSJ SIG Notes

IPSJ SIG Notes 114 101-107, 1996-07-18

Information Processing Society of Japan (IPSJ)

Keywords

Details 詳細情報について

CRID: 1570291227269265792

NII Article ID: 110002934947

NII Book ID: AN10115061

Text Lang: ja

Data Source

CiNii Articles

Export

Report a problem