Comparison of three multicriteria methods to predict known outcomes

被引:59
作者
Olson, DL [1 ]
机构
[1] Texas A&M Univ, Dept Informat & Operat Management, College Stn, TX 77843 USA
关键词
multiple criteria analysis; decision theory;
D O I
10.1016/S0377-2217(99)00416-6
中图分类号
C93 [管理学];
学科分类号
12 ; 1201 ; 1202 ; 120202 ;
摘要
Major approaches to selection decisions include multiattribute utility theory and outranking methods. One of the most frustrating aspects of research in the relative performance of these methods is that data where the final outcome is known is not available. In the US, a great deal of effort has been devoted to statistically recording detailed performance characteristics of major league professional baseball. Every year there has been two to four seasonal competitions, with known outcome in terms of the proportion of contests won. Successful teams often have diverse characteristics, emphasizing different characteristics. SMART, PROMETHEE, and a centroid method were applied to baseball data over the period 1901-1991. Baseball has undergone a series of changes in style over that period, and different physical and administrative characteristics. Therefore the data was divided into decades, with the first five years used as a training set, and the last five years used for data collection. Regression was used to develop the input for preference selection in each method. Single-attribute utilities for criteria performance were generated from the first five years of data from each set. Relative accuracy of multicriteria methods was compared over 114 competitive seasons for both selecting the winning team, as well as for rank-ordering all teams. All the methods have value in supporting human decision making. PROMETHEE II using Gaussian preference functions and SMART were found to be the most accurate. The centroid method and PROMETHEE II using ordinal data were found to involve little sacrifice in predictive accuracy. (C) 2001 Elsevier Science B.V. All rights reserved.
引用
收藏
页码:576 / 587
页数:12
相关论文
共 12 条
[1]  
[Anonymous], EUR J OPERA RES
[2]   A PREFERENCE RANKING ORGANIZATION METHOD - (THE PROMETHEE METHOD FOR MULTIPLE CRITERIA DECISION-MAKING) [J].
BRANS, JP ;
VINCKE, PH .
MANAGEMENT SCIENCE, 1985, 31 (06) :647-656
[3]   SMARTS AND SMARTER - IMPROVED SIMPLE METHODS FOR MULTIATTRIBUTE UTILITY MEASUREMENT [J].
EDWARDS, W ;
BARRON, FH .
ORGANIZATIONAL BEHAVIOR AND HUMAN DECISION PROCESSES, 1994, 60 (03) :306-325
[4]   HOW TO USE MULTIATTRIBUTE UTILITY MEASUREMENT FOR SOCIAL DECISIONMAKING [J].
EDWARDS, W .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS, 1977, 7 (05) :326-340
[5]   JUDGMENTAL ADJUSTMENT OF FORECASTS - A COMPARISON OF METHODS [J].
FLORES, BE ;
OLSON, DL ;
WOLFE, C .
INTERNATIONAL JOURNAL OF FORECASTING, 1992, 7 (04) :421-433
[6]  
LARICHEV OI, 1991, ALL UNION RES I SYST
[7]  
OLDS EG, 1939, ANN MATH STAT, V9
[8]  
Roy B., 1978, Cahiers du Centre d'Etudes de Recherche Operationelle, V20, P3
[9]  
Roy B., 1971, MATH PROGRAM, V1, P239, DOI [10.1007/BF01584088, DOI 10.1007/BF01584088]
[10]  
THORN J, 1995, TOTAL BASEBALL