GENERALIZED COLLINEARITY DIAGNOSTICS

Working in the context of the linear model y = X-beta + epsilon, we generalize the concept of variance inflation as a measure of collinearity to a subset of parameters in beta (denoted by beta-1 with the associated columns of X given by X1). The essential idea underlying this generalization is to examine the impact on the precision of estimation-in particular, the size of an ellipsoidal joint confidence region for beta-1-of less-than-optimal selection of other columns of the design matrix (X2), treating still other columns (X0) as unalterable, even hypothetically. In typical applications, X1 contains a set of dummy regressors coding categories of a qualitative variable or a set of polynomial regressors in a quantitative variable; X2 contains all other regressors in the model, save the constant, which is in X0. If sigma-2V denotes the realized variance of beta-1 and sigma-2U is the variance associated with an optimal selection of X2, then the corresponding scaled dispersion ellipsoids to be compared are E(V), = {x : x'V-1x less-than-or-equal-to 1} and E(U) = {x : x'U-1x less-than-or-equal-to 1}, where E(U) is contained in E(V). The two ellipsoids can be compared by considering the radii of E(V) relative to E(U), obtained through the spectral decomposition of V relative to U. We proceed to explore the geometry of generalized variance inflation, to show the relationship of these measures to correlation-matrix determinants and canonical correlations, to consider X matrices structured by relations of marginality among regressor subspaces, to develop the relationship of generalized variance inflation to hypothesis tests in the multivariate normal linear model, and to present several examples.