単語とＮ－ｇｒａｍの各カテゴリにおける出現頻度の比の和を用いたテキスト自動分類手法

DOI Web Site Web Site 参考文献35件

書誌事項

タイトル別名
  • Text Classification Using the Sum of Frequency Ratios of Word andN-gram Over Categories
  • タンゴ ト N gram ノ カク カテゴリ ニ オケル シュツゲン ヒンド ノ ヒ ノ ワ オ モチイタ テキスト ジドウ ブンルイ シュホウ

この論文をさがす

抄録

In this paper, we consider the automatic text classification as a series of information processing, and propose a new classification technique, namely, “Frequency Ratio Accumulation Method (FRAM)”. This is a simple technique that calculates the sum of ratios of term frequency in each category. However, it has a desirable property that feature terms can be used without their extraction procedure. Then, we use “character N-gram” and “word N-gram” as feature terms by using this property of our classification technique. Next, we evaluate our technique by some experiments. In our experiments, we classify the newspaper articles of Japanese “CD-Mainichi 2002” and English “Reuters-21578” using the Naive Bayes (baseline method) and the proposed method. As the result, we show that the classification accuracy of the proposed method improves greatly compared with the baseline. That is, it is 89.6% for Mainichi, 87.8% for Reuters. Thus, the proposed method has a very high performance. Though the proposed method is a simple technique, it has a new viewpoint, a high potential and is language-independent, so it can be expected the development in the future.

収録刊行物

参考文献 (35)*注記

もっと見る

キーワード

詳細情報 詳細情報について

問題の指摘

ページトップへ