How to lie with bad data

被引：33

作者：

De Veaux, RD ^{[1
]}

Hand, DJ

机构：

[1] Williams Coll, Bronfman Sci Ctr, Dept Math & Stat, Williamstown, MA 01267 USA

[2] Univ London Imperial Coll Sci & Technol, Dept Math, London SW7 2AZ, England

来源：

STATISTICAL SCIENCE | 2005年 / 20卷 / 03期

关键词：

data quality; data profiling; data rectification; data consistency; accuracy; distortion; missing values; record linkage; data warehousing; data mining;

D O I：

10.1214/088342305000000269

中图分类号：

O21 [概率论与数理统计]; C8 [统计学];

学科分类号：

020208 ; 070103 ; 0714 ;

摘要：

As Huff's landmark book made clear, lying with statistics can be accomplished in many ways. Distorting graphics, manipulating data or using biased samples are just a few of the tried and true methods. Failing to use the correct statistical procedure or failing to check the conditions for when the selected method is appropriate can distort results as well, whether the motives of the analyst are honorable or not. Even when the statistical procedure and motives are correct, bad data can produce results that have no validity at all. This article provides some examples of how bad data can arise, what kinds of bad data exist, how to detect and measure bad data, and how to improve the quality of data that have already been collected.

引用

页码：231 / 238

页数：8

共 32 条

[1]

[Anonymous], ENTERPRISE KNOWLEDGE

[2]

[Anonymous], IMA J MATH APPL BUS

[3] Reproducibility of SELDI-TOF protein patterns in serum: comparing datasets from different experiments [J].

Baggerly, KA ;

Morris, JS ;

Coombes, KR .

BIOINFORMATICS, 2004, 20 (05) :777-U710

[4] SOME SOURCES OF ERROR IN THE CODING OF BIRTH-WEIGHT [J].

BRUNSKILL, AJ .

AMERICAN JOURNAL OF PUBLIC HEALTH, 1990, 80 (01) :72-73

[5] Proteomics and cancer - Running before we can walk? [J].

Check, E .

NATURE, 2004, 429 (6991) :496-497

[6] CASE OF INDIANS AND TEEN-AGE WIDOWS [J].

COALE, AJ ;

STEPHAN, FF .

JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 1962, 57 (298) :338-&

[7] MODELING OF TOPOGRAPHIC EFFECTS ON ANTARCTIC SEA-ICE USING MULTIVARIATE ADAPTIVE REGRESSION SPLINES [J].

DEVEAUX, RD ;

GORDON, AL ;

COMISO, JC ;

BACHERER, NE .

JOURNAL OF GEOPHYSICAL RESEARCH-OCEANS, 1993, 98 (C11) :20307-20319

[8]

DEVEAUX RD, 2002, JOINT STAT M NEW YOR

[9]

DEVEAUX RD, 2002, STATS, V34, P3

[10]

Hand D.J, 2001, HDB CREDIT SCORING, P225

← 1 2 3 4 →