-
- Aoki Kenichi
- Hiroshima Prefectural University
-
- Kanezashi Masakazu
- Hiroshima Prefectural University
Bibliographic Information
- Other Title
-
- 非線形方程式の求解によるニューラルネットの学習法
- ヒセンケイ ホウテイシキ ノ キュウカイ ニ ヨル ニューラル ネット ノ ガ
Search this article
Abstract
Backpropagation is most widely used learning algorithm for neural networks. It has some well known drawbacks. The most important drawback is the difficulty in the choice of the values of various learning parameters. Inadequate values will result in a very slow convergence. In the most serious case, backpropagation process will often encounter a local minimum and thus been anable to solve a learning problem. These drawbacks stem from that backpropagation is a gradient based optimization procedure without linear search.<br>In this paper, we propose a new learning algorithm, based on the use of solution method for nonlinear equations which represent the output errors. We basically use Newton method for nonlinear equations since it is superior in convergency. However, Newton method, in dependence on the initial point, does not ensure the global convergence. So, we employ the Homotopy continuation method, which is one of the parametric method, to overcome this drawback. The proposed method is tested for various learning problems. The computational results show that the proposed method is superior to backpropagation in convergency.
Journal
-
- IEEJ Transactions on Electronics, Information and Systems
-
IEEJ Transactions on Electronics, Information and Systems 113 (3), 219-225, 1993
The Institute of Electrical Engineers of Japan
- Tweet
Details 詳細情報について
-
- CRID
- 1390001204609457024
-
- NII Article ID
- 130006845011
-
- NII Book ID
- AN10065950
-
- ISSN
- 13488155
- 03854221
-
- NDL BIB ID
- 3803699
-
- Data Source
-
- JaLC
- NDL
- Crossref
- CiNii Articles
-
- Abstract License Flag
- Disallowed