Spline adaptation in extended linear models

被引:71
作者
Hansen, MH [1 ]
Kooperberg, C
机构
[1] Lucent Technol, Bell Labs, Murray Hill, NJ 07974 USA
[2] Fred Hutchinson Canc Res Ctr, Div Publ Hlth Sci, Seattle, WA 98109 USA
关键词
adaptive triangulations; AIC; BIC; density estimation; extended linear models; finite elements; free knot splines; GCV; linear splines; multivariate splines; regression;
D O I
10.1214/ss/1023798997
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
In many statistical applications, nonparametric modeling can provide insights into the features of a dataset that are not obtainable by other means. One successful approach involves the use of (univariate or multivariate) spline spaces. As a class, these methods have inherited much from classical tools for parametric modeling. For example, stepwise variable selection with spline basis terms is a simple scheme for locating knots (break-points) in regions where the data exhibit strong, local features. Similarly, candidate knot configurations (generated by this or some other search technique), are routinely evaluated with traditional selection criteria like AIC or BIC. In short, strategies typically applied in parametric model selection have proved useful in constructing flexible, low-dimensional models for nonparametric problems. Until recently, greedy, stepwise procedures were most frequently suggested in the literature. Research into Bayesian variable selection, however, has given rise to a number of new spline-based methods that primarily rely on some form of Markov chain Monte Carlo to identify promising knot locations. In this paper, we consider various alternatives to greedy, deterministic schemes, and present a Bayesian framework for studying adaptation in the context of an extended linear model (ELM). Our major test cases are Logspline density estimation and (bivariate) Triogram regression models. We selected these because they illustrate a number of computational and methodological issues concerning model adaptation that arise in ELMs.
引用
收藏
页码:2 / 20
页数:19
相关论文
共 47 条
[1]   NEW LOOK AT STATISTICAL-MODEL IDENTIFICATION [J].
AKAIKE, H .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 1974, AC19 (06) :716-723
[2]   Bayesian analysis of agricultural field experiments [J].
Besag, J ;
Higdon, D .
JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-STATISTICAL METHODOLOGY, 1999, 61 :691-717
[3]   HINGING HYPERPLANES FOR REGRESSION, CLASSIFICATION, AND FUNCTION APPROXIMATION [J].
BREIMAN, L .
IEEE TRANSACTIONS ON INFORMATION THEORY, 1993, 39 (03) :999-1013
[4]   THE PI METHOD FOR ESTIMATING MULTIVARIATE FUNCTIONS FROM NOISY DATA [J].
BREIMAN, L .
TECHNOMETRICS, 1991, 33 (02) :125-143
[5]  
Breiman L., 1984, BIOMETRICS, DOI DOI 10.2307/2530946
[6]  
Courant R., 1943, B AM MATH SOC, DOI [DOI 10.1090/S0002-9904-1943-07818-4, 10.1090/s0002-9904-1943-07818-4]
[7]  
de Boor C., 1978, PRACTICAL GUIDE SPLI, DOI DOI 10.1007/978-1-4612-6333-3
[8]  
Denison DGT, 1998, BIOMETRIKA, V85, P363
[9]   Automatic Bayesian curve fitting [J].
Denison, DGT ;
Mallick, BK ;
Smith, AFM .
JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-STATISTICAL METHODOLOGY, 1998, 60 :333-350
[10]   DATA DEPENDENT TRIANGULATIONS FOR PIECEWISE LINEAR INTERPOLATION [J].
DYN, N ;
LEVIN, D ;
RIPPA, S .
IMA JOURNAL OF NUMERICAL ANALYSIS, 1990, 10 (01) :137-154