The futility of utility analysis revisited: When even an expert fails

The effect of utility analysis on managerial decisions regarding the use of a valid selection test was investigated. Experienced managers (n = 41) were randomly assigned to one of three conditions. The control condition contained written advice to adopt new selection procedures from a hypothetical psychologist that included an explanation of validation procedures. The second condition contained the same written information and advice as the control condition plus written support of that advice from a hypothetical trusted adviser. The third condition contained all the material that was presented in the control condition plus a written explanation of utility analysis, an actual utility analysis showing that large financial benefits would flow from using the proposed procedures, and a video-taped presentation from an expert on utility analysis where the logic underlying utility analysis and its benefits were explained. The expert was then presented live to the audience to address any questions that might have arisen from the utility analysis or the video. An ANOVA revealed that the presentation of a positive utility analysis reduced support for implementing a valid selection procedure, even though the logic and merits of utility analysis as a decision-making tool were described by an internationally recognized authority.