Penalized Maximum Likelihood Boosting with Predictive Measures

DOI Web Site 53 References

Search this article

Abstract

In this paper we use the penalized maximum likelihood and information criteria to propose a new boosting algorithm for various statistical models, including linear regression, generalized linear, and multi-class classification models. In contrast to previous studies, where the empirical goodness-of-fit measures were often used for model updating, information criteria, as a predictive measure of a model, are employed to select a model in each iteration of the proposed algorithms. In addition, the proposed algorithms select the smoothing parameter in each iteration whereas previous methods fixed the parameter for all iterations.<BR>We show that the penalized maximum likelihood L2 boosting is consistent for high-dimensional linear models under the conditions that (a) the true underlying regression function is sparse and (b) the number of predictor variables is allowed to grow exponentially. We then demonstrate the proposed boosting algorithms using both simulated and real data. Comparison with some existing methods shows that the proposed boosting algorithms work well.

Journal

  • Ouyou toukeigaku

    Ouyou toukeigaku 38 (2), 41-67, 2009

    Japanese Society of Applied Statistics

References(53)*help

See more

Keywords

Details 詳細情報について

Report a problem

Back to top