REGRESSION ANALYSIS USING LASSO RANDOM FOREST

Bibliographic Information

Other Title
  • Lasso調整型確率化平衡樹木による回帰解析
  • Lasso チョウセイガタ カクリツカ ヘイコウ ジュモク ニ ヨル カイキ カイセキ

Search this article

Abstract

Random Forest (RF) is one of tree-structured approaches, such as classification and regression trees, involved in ensemble learning method to predict outcome more precisely. In this paper we proposed an adjusted RF based on lasso (lasso-RF) for further predictive performance in regression analysis. In particular, we integrated lasso which use one of shrinkage estimators into the tree-structured model of RF. Practically we carried out two case studies and a small scale simulation with factors which influence prediction of outcome such as sample size {100, 200, 400}, methods {RF, lasso-RF} and bootstrap re-sampling times {100, 200, 400}, and evaluated predictive performance. Our case studies suggested that lasso-RF decreased the mean squared errors between true and estimate outcomes less than original RF. By our simulation study, we evaluated influencing factors on the mean squared errors based on analysis of variance with above three factors and their interaction, and showed that the factor of methods as fixed effect was significant at level 0.05 with proportion of variation 29.2%.

Journal

Related Projects

See more

Details 詳細情報について

Report a problem

Back to top