The Development and Testing of a New Version of the Cognitive Reflection Test Applying Item Response Theory (IRT)

被引:197
作者
Primi, Caterina [1 ]
Morsanyi, Kinga [2 ]
Chiesi, Francesca [1 ]
Donati, Maria Anna [1 ]
Hamilton, Jayne [2 ]
机构
[1] Univ Florence, Psychol Sect, Dept NEUROFARBA, Via S Salvi 12,Padiglione 26, I-50135 Florence, Italy
[2] Queens Univ Belfast, Sch Psychol, Belfast, Antrim, North Ireland
关键词
cognitive reflection; decision making; heuristics; item response theory; individual differences; test information function; validity; DECISION-MAKING; PROGRESSIVE MATRICES; NUMERACY SCALE; PERFORMANCE; MATHEMATICS; THINKING; ABILITY; STYLES; BIASES;
D O I
10.1002/bdm.1883
中图分类号
B849 [应用心理学];
学科分类号
040203 ;
摘要
The cognitive reflection test (CRT) is a short measure of a person's ability to resist intuitive response tendencies and to produce a normatively correct response, which is based on effortful reasoning. Although the CRT is a very popular measure, its psychometric properties have not been extensively investigated. A major limitation of the CRT is the difficulty of the items, which can lead to floor effects in populations other than highly educated adults. The present study aimed at investigating the psychometric properties of the CRT applying item response theory analyses (a two-parameter logistic model) and at developing a new version of the scale (the CRT-long), which is appropriate for participants with both lower and higher levels of cognitive reflection. The results demonstrated the good psychometric properties of the original, as well as the new scale. The validity of the new scale was also assessed by measuring correlations with various indicators of intelligence, numeracy, reasoning and decision-making skills, and thinking dispositions. Moreover, we present evidence for the suitability of the new scale to be used with developmental samples. Finally, by comparing the performance of adolescents and young adults on the CRT and CRT-long, we report the first investigation into the development of cognitive reflection. Copyright (C) 2015 John Wiley & Sons, Ltd.
引用
收藏
页码:453 / 469
页数:17
相关论文
共 47 条
[1]  
Albaity M, 2014, JUDGM DECIS MAK, V9, P148
[2]   Overcoming intuition: Metacognitive difficulty activates analytic reasoning [J].
Alter, Adam L. ;
Oppenheimer, Daniel M. ;
Epley, Nicholas ;
Eyre, Rebecca N. .
JOURNAL OF EXPERIMENTAL PSYCHOLOGY-GENERAL, 2007, 136 (04) :569-576
[3]  
[Anonymous], 2000, ITEM RESPONSE THEORY
[4]  
[Anonymous], 2001, ERIC Clearinghouse on Assessment and Evaluation
[5]  
[Anonymous], 2001, WOODCOCKJOHNSON TEST
[6]  
[Anonymous], 1991, FUNDAMENTALS ITEM RE
[7]   Math Performance in Stressful Situations [J].
Beilock, Sian L. .
CURRENT DIRECTIONS IN PSYCHOLOGICAL SCIENCE, 2008, 17 (05) :339-343
[8]   MARGINAL MAXIMUM-LIKELIHOOD ESTIMATION OF ITEM PARAMETERS - APPLICATION OF AN EM ALGORITHM [J].
BOCK, RD ;
AITKIN, M .
PSYCHOMETRIKA, 1981, 46 (04) :443-459
[9]  
Cai L., 2011, IRTPRO 2.1 for Windows: Item response theory for patient-reported outcomes
[10]   Does the cognitive reflection test measure cognitive reflection? A mathematical modeling approach [J].
Campitelli, Guillermo ;
Gerrans, Paul .
MEMORY & COGNITION, 2014, 42 (03) :434-447