Multiple Informant Methodology: A Critical Review and Recommendations

被引:84
作者
Wagner, Stephan M. [1 ]
Rau, Christian [2 ]
Lindemann, Eckhard [1 ]
机构
[1] Swiss Fed Inst Technol, Chair Logist Management, CH-8092 Zurich, Switzerland
[2] WHU Otto Beisheim Sch Management, Vallendar, Germany
关键词
multiple informant methodology; informant selection; interrater agreement; aggregation; organizational properties; INTERRATER AGREEMENT; ORGANIZATIONAL PERFORMANCE; MEASUREMENT ERROR; DECISION-MAKING; RELIABILITY; INDEXES; R(WG); CONSENSUS; STRATEGY; RATINGS;
D O I
10.1177/0049124110366231
中图分类号
O1 [数学]; C [社会科学总论];
学科分类号
03 ; 0303 ; 0701 ; 070101 ;
摘要
The value of multiple informant methodology for improving the validity in determining organizational properties has been increasingly recognized. However, the majority of empirical research still relies on single (key) informants. This is partly due to the lack of comprehensive methodological narratives and precise recommendations on the application of this important methodology. Therefore, the authors have developed a critical review and derived clear recommendations for the key challenges that researchers face in using multiple informants: (1) Which and how many informants should be considered? (2) How should the consensus among the informants be judged? (3) How are multiple responses combined into a single, organizational response to conduct further data analyses?
引用
收藏
页码:582 / 618
页数:37
相关论文
共 77 条
[31]   Clinical versus mechanical prediction: A meta-analysis [J].
Grove, WM ;
Zald, DH ;
Lebow, BS ;
Snitz, BE ;
Nelson, C .
PSYCHOLOGICAL ASSESSMENT, 2000, 12 (01) :19-30
[32]   STRATEGIC AWARENESS WITHIN TOP MANAGEMENT TEAMS [J].
HAMBRICK, DC .
STRATEGIC MANAGEMENT JOURNAL, 1981, 2 (03) :263-279
[33]   GROUP VERSUS INDIVIDUAL-PERFORMANCE - ARE N + 1 HEADS BETTER THAN ONE [J].
HILL, GW .
PSYCHOLOGICAL BULLETIN, 1982, 91 (03) :517-539
[34]   Buyer-supplier collaboration in product development projects [J].
Hoegl, M ;
Wagner, SM .
JOURNAL OF MANAGEMENT, 2005, 31 (04) :530-548
[35]  
Hsu LM., 2003, UNDERSTANDING STAT, V2, P205, DOI DOI 10.1207/S15328031US0203_03
[36]   RETROSPECTIVE REPORTS OF STRATEGIC-LEVEL MANAGERS - GUIDELINES FOR INCREASING THEIR ACCURACY [J].
HUBER, GP ;
POWER, DJ .
STRATEGIC MANAGEMENT JOURNAL, 1985, 6 (02) :171-180
[37]  
James L.R., 1988, Applications of interactionist psychology: Essays in honor of Saul B. Sells, P253
[38]  
James L.R., 1981, ESTIMATING INTERRATE
[39]   AGGREGATION BIAS IN ESTIMATES OF PERCEPTUAL AGREEMENT [J].
JAMES, LR .
JOURNAL OF APPLIED PSYCHOLOGY, 1982, 67 (02) :219-229
[40]   R(WG) - AN ASSESSMENT OF WITHIN-GROUP INTERRATER AGREEMENT [J].
JAMES, LR ;
DEMAREE, RG ;
WOLF, G .
JOURNAL OF APPLIED PSYCHOLOGY, 1993, 78 (02) :306-309