Predicting multivariate responses in multiple linear regression

被引:331
作者
Breiman, L
Friedman, JH
机构
[1] STANFORD UNIV,DEPT STAT,STANFORD,CA 94305
[2] UNIV CALIF BERKELEY,BERKELEY,CA 94720
来源
JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-METHODOLOGICAL | 1997年 / 59卷 / 01期
关键词
canonical regression; cross-validation; curds and whey method; partial least squares; rank regression; ridge regression;
D O I
10.1111/1467-9868.00054
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
We look at the problem of predicting several response variables from the same set of explanatory variables. The question is how to take advantage of correlations between the response variables to improve predictive accuracy compared with the usual procedure of doing individual regressions of each response variable on the common set of predictor variables. A new procedure is introduced called the curds and whey method. Its use can substantially reduce prediction errors when there are correlations between responses while maintaining accuracy even if the responses are uncorrelated. In extensive simulations, the new procedure is compared with several previously proposed methods for predicting multiple responses (including partial least squares) and exhibits superior accuracy. One version can be easily implemented in the context of standard statistical packages.
引用
收藏
页码:3 / 37
页数:35
相关论文
共 19 条
[1]  
ANDERSON TW, 1957, INTRO MULTIVARIATE A
[2]  
BROWN PJ, 1982, SCAND J STAT, V9, P209
[3]   ADAPTIVE MULTIVARIATE RIDGE-REGRESSION [J].
BROWN, PJ ;
ZIDEK, JV .
ANNALS OF STATISTICS, 1980, 8 (01) :64-74
[4]  
BROWN PJ, 1980, BAYESIAN STAT, P247
[5]  
COPAS JB, 1987, J ROY STAT SOC B MET, V49, P175
[6]  
COPAS JB, 1983, J R STAT SOC B, V45, P311
[7]  
CRAVEN P, 1979, NUMER MATH, V31, P317
[8]   A STATISTICAL VIEW OF SOME CHEMOMETRICS REGRESSION TOOLS [J].
FRANK, IE ;
FRIEDMAN, JH .
TECHNOMETRICS, 1993, 35 (02) :109-135
[9]   AN INTERPRETATION OF PARTIAL LEAST-SQUARES [J].
GARTHWAITE, PH .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 1994, 89 (425) :122-127
[10]  
Golub GH, 1989, MATRIX COMPUTATIONS