REGULARIZED RANK-BASED ESTIMATION OF HIGH-DIMENSIONAL NONPARANORMAL GRAPHICAL MODELS

被引:162
作者
Xue, Lingzhou [1 ]
Zou, Hui [1 ]
机构
[1] Univ Minnesota, Sch Stat, Minneapolis, MN 55455 USA
基金
美国国家科学基金会;
关键词
CLIME; Dantzig selector; graphical lasso; nonparanormal graphical model; rate of convergence; variable transformation; COVARIANCE ESTIMATION; VARIABLE SELECTION; DANTZIG SELECTOR; LASSO; BIOSYNTHESIS; LIKELIHOOD; PATHWAYS;
D O I
10.1214/12-AOS1041
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
A sparse precision matrix can be directly translated into a sparse Gaussian graphical model under the assumption that the data follow a joint normal distribution. This neat property makes high-dimensional precision matrix estimation very appealing in many applications. However, in practice we often face nonnormal data, and variable transformation is often used to achieve normality. In this paper we consider the nonparanormal model that assumes that the variables follow a joint normal distribution after a set of unknown monotone transformations. The nonparanormal model is much more flexible than the normal model while retaining the good interpretability of the latter in that each zero entry in the sparse precision matrix of the nonparanormal model corresponds to a pair of conditionally independent variables. In this paper we show that the nonparanormal graphical model can be efficiently estimated by using a rank-based estimation scheme which does not require estimating these unknown transformation functions. In particular, we study the rank-based graphical lasso, the rank-based neighborhood Dantzig selector and the rank-based CLIME. We establish their theoretical properties in the setting where the dimension is nearly exponentially large relative to the sample size. It is shown that the proposed rank-based estimators work as well as their oracle counterparts defined with the oracle data. Furthermore, the theory motivates us to consider the adaptive version of the rank-based neighborhood Dantzig selector and the rank-based CLIME that are shown to enjoy graphical model selection consistency without assuming the irrepresentable condition for the oracle and rank-based graphical lasso. Simulated and real data are used to demonstrate the finite performance of the rank-based estimators.
引用
收藏
页码:2541 / 2571
页数:31
相关论文
共 44 条
  • [1] Banerjee O, 2008, J MACH LEARN RES, V9, P485
  • [2] Bertsimas Dimitris, 1997, Introduction to linear optimization, V6
  • [3] SIMULTANEOUS ANALYSIS OF LASSO AND DANTZIG SELECTOR
    Bickel, Peter J.
    Ritov, Ya'acov
    Tsybakov, Alexandre B.
    [J]. ANNALS OF STATISTICS, 2009, 37 (04) : 1705 - 1732
  • [4] BOYD S., 2004, CONVEX OPTIMIZATION, DOI 10.1017/CBO9780511804441
  • [5] A Constrained l1 Minimization Approach to Sparse Precision Matrix Estimation
    Cai, Tony
    Liu, Weidong
    Luo, Xi
    [J]. JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2011, 106 (494) : 594 - 607
  • [6] Candes E, 2007, ANN STAT, V35, P2313, DOI 10.1214/009053606000001523
  • [7] Estimation of copula-based semiparametric time series models
    Chen, XH
    Fan, YQ
    [J]. JOURNAL OF ECONOMETRICS, 2006, 130 (02) : 307 - 335
  • [8] Efficient estimation of semiparametric multivariate copula models
    Chen, Xiaohong
    Fan, Yanqin
    Tsyrennikov, Viktor
    [J]. JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2006, 101 (475) : 1228 - 1240
  • [9] COVARIANCE SELECTION
    DEMPSTER, AP
    [J]. BIOMETRICS, 1972, 28 (01) : 157 - &
  • [10] ROBUST ESTIMATION AND OUTLIER DETECTION WITH CORRELATION-COEFFICIENTS
    DEVLIN, SJ
    GNANADESIKAN, R
    KETTENRING, JR
    [J]. BIOMETRIKA, 1975, 62 (03) : 531 - 545