Penalized spline estimation for partially linear single-index models

被引:462
作者
Yu, Y
Ruppert, D
机构
[1] Univ Cincinnati, Cincinnati, OH 45221 USA
[2] Cornell Univ, Ithaca, NY 14853 USA
基金
美国国家科学基金会;
关键词
asymptotics; consistency; dimension reduction; inference; ridge regression; sandwich formula;
D O I
10.1198/016214502388618861
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
Single-index models are potentially important tools for multivariate nonparametric regression. They generalize linear regression by replacing the linear combination alpha(0)(T)x with a nonparametric component, eta(0)(alpha(0)(T)x), where eta(0)(.) is an unknown univariate link function. By reducing the dimensionality from that of a general covariate vector x to a univariate index alpha(0)(T)x, single-index models avoid the so-called "curse of dimensionality." We propose penalized spline (P-spline) estimation of eta(0)((.))in partially linear single-index models, where the mean function has the form eta(0)(alpha(0)(T)x) + beta(0)(T)z. The P-spline approach offers a number of advantages over other fitting methods for single-index models. All parameters in the P-spline,single-index model can be estimated simultaneously by penalized nonlinear least squares. As a direct least squares fitting method, our approach is rapid and computationally stable. Standard nonlinear least squares software can be used. Moreover, joint inference for eta(0)(.), alpha(0), and beta(0) is possible by standard estimating equations theory such as the sandwich formula for the joint covariance matrix. Using asymptotics where the number of knots is fixed, though potentially large, we show squareroot of n consistency and asymptotic normality of the estimators of all parameters. These asymptotic results permit joint inference for the parameters. Several examples illustrate that the model and proposed estimation methodology can be effective in practice. We investigate inference based on the sandwich estimate through a Monte Carlo study. General L-q penalty functions can be readily implemented.
引用
收藏
页码:1042 / 1054
页数:13
相关论文
共 34 条
  • [1] Amemiya T., 1983, Handbook of Econometrics, V1, P333
  • [2] [Anonymous], 1961, Adaptive Control Processes: a Guided Tour, DOI DOI 10.1515/9781400874668
  • [3] [Anonymous], 1988, Nonlinear regression analysis and its applications
  • [4] BERRY S, 2002, IN PRESS J AM STAT A
  • [5] Brumback BA, 1999, J AM STAT ASSOC, V94, P794, DOI 10.2307/2669991
  • [6] Generalized partially linear single-index models
    Carroll, RJ
    Fan, JQ
    Gijbels, I
    Wand, MP
    [J]. JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 1997, 92 (438) : 477 - 489
  • [7] Carroll RJ., 1995, MEASUREMENT ERROR NO
  • [8] de Boor C., 1978, PRACTICAL GUIDE SPLI, DOI DOI 10.1007/978-1-4612-6333-3
  • [9] Efron B., 1993, INTRO BOOTSTRAP, V1st ed., DOI DOI 10.1201/9780429246593
  • [10] Flexible smoothing with B-splines and penalties
    Eilers, PHC
    Marx, BD
    [J]. STATISTICAL SCIENCE, 1996, 11 (02) : 89 - 102