Parsimonious covariance matrix estimation for longitudinal data

被引:120
作者
Smith, M [1 ]
Kohn, R
机构
[1] Univ Sydney, Fac Econ & Business, Sydney, NSW 2006, Australia
[2] Univ New S Wales, Australian Grad Sch Management, Sydney, NSW 2052, Australia
关键词
Bayesian model; Cholesky decomposition; high-dimensional covariance matrix; Markov chain Monte Carlo; model averaging;
D O I
10.1198/016214502388618942
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
This article proposes a data-driven method to identify parsimony in the covariance matrix of longitudinal data and to exploit any such parsimony to produce a statistically efficient estimator of the covariance matrix. The approach parameterizes the covariance matrix through the Cholesky decomposition of its inverse. For longitudinal data this is a one-step-ahead predictive representation, and-the Cholesky factor is likely to have off-diagonal elements that are zero or close to zero. A hierarchical Bayesian model is used to identify any such zeros in the Cholesky factor, similar to approaches that have been successful in Bayesian variable selection. The model is estimated using a Markov chain Monte Carlo sampling scheme that is computationally efficient and can be applied to covariance matrices of high dimension. It is demonstrated through simulations that the proposed method compares favorably in terms of statistical efficiency with a highly regarded competing approach. The estimator is applied to three real examples in which the dimension of the covariance matrix is large relative to the sample size. The first two examples are from biometry and electricity demand modeling and are longitudinal. The third example is from finance-and highlights the potential of our method for estimating cross-sectional covariance matrices.
引用
收藏
页码:1141 / 1153
页数:13
相关论文
共 31 条
[1]  
Campbell J., 1997, The econometrics of financial markets
[2]   REFERENCE PRIORS FOR THE ORBIT IN A GROUP MODEL [J].
CHANG, T ;
EAVES, D .
ANNALS OF STATISTICS, 1990, 18 (04) :1595-1614
[3]   Nonconjugate Bayesian estimation of covariance matrices and its use in hierarchical models [J].
Daniels, MJ ;
Kass, RE .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 1999, 94 (448) :1254-1263
[4]  
DEMPSTER A.P., 1969, ELEMENTS CONTINUOUS
[5]   COVARIANCE SELECTION [J].
DEMPSTER, AP .
BIOMETRICS, 1972, 28 (01) :157-&
[6]  
Diggle P. J., 2002, ANAL LONGITUDINAL DA
[7]   SEMIPARAMETRIC ESTIMATES OF THE RELATION BETWEEN WEATHER AND ELECTRICITY SALES [J].
ENGLE, RF ;
GRANGER, CWJ ;
RICE, J ;
WEISS, A .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 1986, 81 (394) :310-320
[8]   Industry costs of equity [J].
Fama, EF ;
French, KR .
JOURNAL OF FINANCIAL ECONOMICS, 1997, 43 (02) :153-193
[9]   A RANDOM COEFFICIENT APPROACH TO THE ESTIMATION OF RESIDENTIAL END-USE LOAD PROFILES [J].
FIEBIG, DG ;
BARTELS, R ;
AIGNER, DJ .
JOURNAL OF ECONOMETRICS, 1991, 50 (03) :297-327
[10]   ANTE-DEPENDENCE ANALYSIS OF AN ORDERED SET OF VARIABLES [J].
GABRIEL, KR .
ANNALS OF MATHEMATICAL STATISTICS, 1962, 33 (01) :201-&