Nested model averaging on solution path for high‐dimensional linear regression
-
- Yang Feng
- Department of Biostatistics, School of Global Public Health New York University New York NY 10003 USA
-
- Qingfeng Liu
- Department of Economics Otaru University of Commerce Hokkaido 047‐8501 Japan
Description
<jats:p>We study the nested model averaging method on the solution path for a high‐dimensional linear regression problem. In particular, we propose to combine model averaging with regularized estimators (e.g., lasso, elastic net, and Sorted L‐One Penalized Estimation [SLOPE]) on the solution path for high‐dimensional linear regression. In simulation studies, we first conduct a systematic investigation on the impact of predictor ordering on the behaviour of nested model averaging, and then show that nested model averaging with lasso, elastic net and SLOPE compares favourably with other competing methods, including the infeasible lasso, elastic, net and SLOPE with the tuning parameter optimally selected. A real data analysis on predicting the per capita violent crime in the United States shows outstanding performance of the nested model averaging with lasso.</jats:p>
Journal
-
- Stat
-
Stat 9 (1), 2020-01
Wiley
- Tweet
Details 詳細情報について
-
- CRID
- 1360853567609495168
-
- DOI
- 10.1002/sta4.317
-
- ISSN
- 20491573
-
- Data Source
-
- Crossref
- KAKEN