Determining Optimal Number of Hidden Units for Multi-Layered Neural Networks.

DOI Web Site Web Site

Bibliographic Information

Other Title
  • 多層ニューラルネットの最適中間層ニューロン数決定方法
  • タソウ ニューラル ネット ノ サイテキ チュウカンソウ ニューロンスウ ケッ

Search this article

Abstract

Multi-layered neural networks have been widely applied to control and recognition systems. However, since there is no deterministic method to obtain an optimal number of hidden units, trial and error simulation is required to develop these systems, which is very time consuming. In this paper, a statistical algorithm based on linear regression analysis is proposed to determine the optimal number of hidden units. The optimal number defined here is the smallest one which is sufficient for the maximum generalization capability of the network. By using a trained network with enough number of hidden units, the developed method calculates the amount of linear correlation between their outputs and estimates the redundant number of hidden units corresponding to it. Finally by subtracting the redundant number from the initial one, the optimal number of hidden units can be obtained.<br>The developed method is applied to two typical neural network systems, i.e. a classification system (number recognition) and a non-linear approximation system (coagulant injection operation in a water purification plant), and demonstrated to be effective to estimate the optimal number of hidden units.

Journal

Keywords

Details 詳細情報について

Report a problem

Back to top