Technical Note: Review of methods for linear least-squares fitting of data and application to atmospheric chemistry problems

被引:225
作者
Cantrell, C. A. [1 ]
机构
[1] Natl Ctr Atmospher Res, Div Atmospher Chem, Boulder, CO 80305 USA
关键词
D O I
10.5194/acp-8-5477-2008
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
The representation of data, whether geophysical observations. numerical model output or laboratory results. by a best fit straight line is a routine practice in the and other fields. While the literature is full of detailed analyses of procedures for fitting straight lines to values with uncertainties, a surprising number of scientists blindly use the standard least-squares method, such as found on calculators and in spreadsheet programs, that assumes no uncertainties in the x values. Here, the available procedures for estimating the best fit straight line to data, including those applicable to situations for uncertainties present in both the x and y variables, are reviewed. Representative methods that are presented in the literature for bivariate weighted fits are compared using several sample data sets, and guidance is presented as to when the somewhat more involved iterative methods are required, or when the standard least-squares procedure would be expected to be satisfactory. A spreadsheet-based template is made available that employs one method for bivariate fitting.
引用
收藏
页码:5477 / 5487
页数:11
相关论文
共 54 条
[31]  
MACTAGGART DL, 1992, J AOAC INT, V75, P608
[32]   Overview of total least-squares methods [J].
Markovsky, Ivan ;
Van Huffel, Sabine .
SIGNAL PROCESSING, 2007, 87 (10) :2283-2302
[33]   PARAMETERS VARIANCES OF A LEAST-SQUARES DETERMINED STRAIGHT-LINE WITH ERRORS IN BOTH COORDINATES [J].
MORENO, C ;
BRUZZONE, H .
MEASUREMENT SCIENCE AND TECHNOLOGY, 1993, 4 (05) :635-636
[34]   A least-squares-based method for determining the ratio between two measured quantities [J].
Moreno, C .
MEASUREMENT SCIENCE AND TECHNOLOGY, 1996, 7 (02) :137-141
[35]   ERROR-AFFECTED EXPERIMENTAL-DATA ANALYSIS - APPLICATION TO FITTING PROCEDURES [J].
NERI, F ;
PATANE, S ;
SAITTA, G .
MEASUREMENT SCIENCE AND TECHNOLOGY, 1990, 1 (10) :1007-1010
[36]   AN ACCURATE AND STRAIGHTFORWARD APPROACH TO LINE REGRESSION-ANALYSIS OF ERROR-AFFECTED EXPERIMENTAL-DATA [J].
NERI, F ;
SAITTA, G ;
CHIOFALO, S .
JOURNAL OF PHYSICS E-SCIENTIFIC INSTRUMENTS, 1989, 22 (04) :215-217
[37]   A reevaluation of airborne HOx observations from NASA field campaigns [J].
Olson, Jennifer R. ;
Crawford, James H. ;
Chen, Gao ;
Brune, William H. ;
Faloona, Ian C. ;
Tan, David ;
Harder, Hartwig ;
Martinez, Monica .
JOURNAL OF GEOPHYSICAL RESEARCH-ATMOSPHERES, 2006, 111 (D10)
[38]   Testing fast photochemical theory during TRACE-P based on measurements of OH, HO2, and CH2O -: art. no. D15S10 [J].
Olson, JR ;
Crawford, JH ;
Chen, G ;
Fried, A ;
Evans, MJ ;
Jordan, CE ;
Sandholm, ST ;
Davis, DD ;
Anderson, BE ;
Avery, MA ;
Barrick, JD ;
Blake, DR ;
Brune, WH ;
Eisele, FL ;
Flocke, F ;
Harder, H ;
Jacob, DJ ;
Kondo, Y ;
Lefer, BL ;
Martinez, M ;
Mauldin, RL ;
Sachse, GW ;
Shetter, RE ;
Singh, HB ;
Talbot, RW ;
Tan, D .
JOURNAL OF GEOPHYSICAL RESEARCH-ATMOSPHERES, 2004, 109 (D15) :D15S101-16
[39]   CORRECTION [J].
OREAR, J .
AMERICAN JOURNAL OF PHYSICS, 1984, 52 (03) :278-278
[40]   APPLICABILITY OF LEAST-SQUARES FORMULA [J].
PASACHOFF, JM .
AMERICAN JOURNAL OF PHYSICS, 1980, 48 (10) :800-800