An Objective Method for Evaluating Speech Translation System : Using a Second Language Learner's Corpus
-
- YASUDA Keiji
- ATR Spoken Language Translation Research Laboratories
-
- SUGAYA Fumiaki
- KDDI R&D Laboratories
-
- TAKEZAWA Toshiyuki
- ATR Spoken Language Translation Research Laboratories
-
- KIKUI Genichiro
- ATR Spoken Language Translation Research Laboratories
-
- YAMAMOTO Seiichi
- ATR Spoken Language Translation Research Laboratories
-
- YANAGIDA Masuzo
- Faculty of Engineering, Doshisha University
Search this article
Description
In this paper we propose an objective method for assessing the capability of a speech translation system. It automates the translation paired comparison method, which gives a simple, easy to understand TOEIC score proposed by Sugaya et al., to succinctly evaluate a speech translation system. To avoid the expensive evaluation cost of the original method where large manual effort is required, the new objective method automates the procedure by employing an objective metric such as BLEU and DP-based measure. The evaluation results obtained by the proposed method are similar to those of the original method. Also, the proposed method is used to evaluate the usefulness of a speech translation system. It is then found that our speech translation system is useful in general, even to users with higher TOEIC score than the system's.
Journal
-
- IEICE Transactions on Information and Systems, D
-
IEICE Transactions on Information and Systems, D 88 (3), 569-577, 2005-03-01
The Institute of Electronics, Information and Communication Engineers
- Tweet
Details 詳細情報について
-
- CRID
- 1571135652465328000
-
- NII Article ID
- 110003214220
-
- NII Book ID
- AA10826272
-
- ISSN
- 09168532
-
- Text Lang
- en
-
- Data Source
-
- CiNii Articles
