High Speed Morphological Analysis using DFA

9 References

Bibliographic Information

Other Title
  • DFAによる形態素解析の高速化

Search this article

Abstract

Morphological analysis, which segments the input sentence into words and attaches parts of speech to them, is the most fundamental process of Japanese language processing. This process contains dictionary look-up of all substrings of input sentence. In this paper, we propose a method to convert the dictionary into a deterministic finite automaton and realize high-speed dictionary look-up. An advantage of our method is that it enables faster dictionary look-up and a disadvantage is that required memory space is larger than AC method-based dictionary look-up. The experimental results tells that our method requires 16.1 times as large memory space as AC method and is 11.7 times as fast as AC method in dictionary look-up.

Journal

  • IPSJ SIG Notes

    IPSJ SIG Notes 114 101-107, 1996-07-18

    Information Processing Society of Japan (IPSJ)

References(9)*help

See more

Keywords

Details 詳細情報について

  • CRID
    1570291227269265792
  • NII Article ID
    110002934947
  • NII Book ID
    AN10115061
  • Text Lang
    ja
  • Data Source
    • CiNii Articles

Report a problem

Back to top