Regression methods for high dimensional multicollinear data

被引:6
作者
Aucott, LS
Garthwaite, PH
Currall, J
机构
[1] Univ Aberdeen, Dept Math Sci, Aberdeen AB24 3UE, Scotland
[2] Univ Glasgow, Comp Serv, Glasgow G12 8QQ, Lanark, Scotland
关键词
biased regression; data reduction; high-dimensional data; latent root regression; near infrared spectra; partial feast squares; principal components regression; stepwise regression;
D O I
10.1080/03610910008813652
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
To compare their performance on high dimensional data, several regression methods are applied to data sets in which the number of exploratory variables greatly exceeds the sample sizes. The methods are stepwise regression, principal components regression, two forms of latent root regression, partial least squares, and a new method developed here. The data are four sample sets for which near infrared reflectance spectra have been determined and the regression methods use the spectra to estimate the concentration of various chemical constituents, the latter having been determined by standard chemical analysis. Thirty-two regression equations are estimated using each method and their performances are evaluated using validation data sets. Although it is the most widely used, stepwise regression was decidedly poorer than the other methods considered. Differences between the latter were small with partial least squares performing slightly better than other methods under all criteria examined, albeit not by a statistically significant amount.
引用
收藏
页码:1021 / 1037
页数:17
相关论文
共 13 条