Evaluation (not validation) of quantitative models

被引:132
作者
Oreskes, N [1 ]
机构
[1] NYU, Gallatin Sch Individualized Study, New York, NY USA
关键词
model evaluation; model validation; quantitative models;
D O I
10.1289/ehp.98106s61453
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
The present regulatory climate has led to increasing demands for scientists to attest to the predictive reliability of numerical simulation models used to help set public policy, a process frequently referred to as model validation. But while model validation may reveal useful information, this paper argues that it is not possible to demonstrate the predictive reliability of any model of a complex natural system in advance of its actual use. Ail models embed uncertainties, and these uncertainties can and frequently do undermine predictive reliability. In the case of lead in the environment, we may categorize model uncertainties as theoretical, empirical, parametrical, and temporal. Theoretical uncertainties are aspects of the system that are not fully understood, such as the biokinetic pathways of lead metabolism Empirical uncertainties are aspects of the system that are difficult (or impossible) to measure, such as actual lead ingestion by an individual child. Parametrical uncertainties arise when complexities in the system are simplified to provide manageable model input, such as representing longitudinal lead exposure by cross-sectional measurements. Temporal uncertainties arise from the assumption that systems are stable in time. A model may also be conceptually flawed. The Ptolemaic system of astronomy is a historical example of a model that was empirically adequate but based on a wrong conceptualization. Yet had it been computerized-and had the word then existed-its users would have had every right to call it validated. Thus, rather than talking about strategies for validation, we should be talking about means of evaluation. That is not to say that language alone will solve our problems or that the problems of model evaluation are primarily linguistic. The uncertainties inherent in large, complex models will not go away simply because we change the way we talk about them. But this is precisely the point: calling a model validated does not make it valid. Modelers and policymakers must continue to work toward finding effective ways to evaluate and judge the quality of their models, and to develop appropriate terminology to communicate these judgments to the public whose health and safety may be at stake.
引用
收藏
页码:1453 / 1460
页数:8
相关论文
共 60 条
  • [1] [Anonymous], LEAD SOIL ISSUES GUI
  • [2] BALLS M, 1990, ATLA-ALTERN LAB ANIM, V18, P313
  • [3] BALLS M, 1995, ATLA-ALTERN LAB ANIM, V23, P129
  • [4] BANKES SC, 1992, N3093A RAND CORP
  • [5] BEER FA, 1993, SOC EPISTEMOL, V7, P85
  • [6] Validation of alternative methods for toxicity testing
    Bruner, LH
    Carr, GJ
    Chamberlain, M
    Curren, RD
    [J]. TOXICOLOGY IN VITRO, 1996, 10 (04) : 479 - 501
  • [7] BRUSH SG, 1996, TRANSMUTED PAST AGE
  • [8] BURCHFIELD JD, 1990, KELVIN AGE EARTH
  • [9] COHEN BL, 1983, SCI CASE NUCL ENERGY
  • [10] CURREN RD, 1995, ATLA-ALTERN LAB ANIM, V23, P211