Iatrogenic specification error: A cautionary tale of cleaning data

被引:42
作者
Bollinger, CR [1 ]
Chandra, A
机构
[1] Univ Kentucky, Lexington, KY 40506 USA
[2] Natl Bur Econ Res, Cambridge, MA 02138 USA
[3] Inst Study Labor, Bonn, Germany
[4] Dartmouth Coll, Hanover, NH 03755 USA
关键词
D O I
10.1086/428028
中图分类号
F [经济];
学科分类号
02 ;
摘要
It is common practice to use sensible rules of thumb for cleaning data. Measurement error is often the justification for removing (trimming) or recoding (winsorizing) observations where the dependent variable has values that lie outside a specified range. We consider a general measurement error process that nests many plausible models. Analytic results demonstrate that winsorizing and trimming are solutions for a narrow class of error processes. Indeed such procedures can induce or exacerbate bias. Monte Carlo simulations and empirical results demonstrate the fragility of cleaning. Even on root mean square error criteria, we cannot find generalizable justifications for these procedures.
引用
收藏
页码:235 / 257
页数:23
相关论文
共 20 条
[1]  
ANGRIST JD, 2000, HDB LABOR EC A, V3
[2]  
[Anonymous], 1995, Identification Problems in the Social Sciences
[3]  
BOLLINGER C, 2003, 289 NAT BUR EC RES
[4]   Measurement error in the current population survey: A nonparametric look [J].
Bollinger, CR .
JOURNAL OF LABOR ECONOMICS, 1998, 16 (03) :576-594
[5]   Measurement error in human capital and the black-white wage gap [J].
Bollinger, CR .
REVIEW OF ECONOMICS AND STATISTICS, 2003, 85 (03) :578-585
[6]   THE EXTENT OF MEASUREMENT ERROR IN LONGITUDINAL EARNINGS DATA - DO 2 WRONGS MAKE A RIGHT [J].
BOUND, J ;
KRUEGER, AB .
JOURNAL OF LABOR ECONOMICS, 1991, 9 (01) :1-24
[7]   WHAT WENT WRONG - THE EROSION OF RELATIVE EARNINGS AND EMPLOYMENT AMONG YOUNG BLACK-MEN IN THE 1980S [J].
BOUND, J ;
FREEMAN, RB .
QUARTERLY JOURNAL OF ECONOMICS, 1992, 107 (01) :201-232
[8]   CHANGES IN THE UNITED-STATES WAGE STRUCTURE 1963-1987 - APPLICATION OF QUANTILE REGRESSION [J].
BUCHINSKY, M .
ECONOMETRICA, 1994, 62 (02) :405-458
[9]   SCHOOL QUALITY AND BLACK-WHITE RELATIVE EARNINGS - A DIRECT ASSESSMENT [J].
CARD, D ;
KRUEGER, AB .
QUARTERLY JOURNAL OF ECONOMICS, 1992, 107 (01) :151-200
[10]   LINEAR-REGRESSION AFTER SELECTION [J].
GOLDBERGER, AS .
JOURNAL OF ECONOMETRICS, 1981, 15 (03) :357-366