Effects on preferences of violations of procedural invariance

Background. In studies of health preferences, utilities for hypothetical health states cannot always be successfully measured. One marker for unsuccessful measurement is violation of "procedural invariance": when the ranking of two health states varies across assessment procedures. Using preference values based on unsuccessful measurement may result in misinterpretation of patients' attitudes about health. Objective. The authors sought to determine whether people who violated procedural invariance had different preferences than people who satisfied it. Methods. They performed secondary analyses of three completed studies that used the same two assessment procedures, identifying participants who violated procedural invariance and comparing the mean standard gamble (SG) and visual analog scale (VAS) scores of violators and satisfiers. Participants. Experiment 1, 30 healthy volunteers and 30 patients with cardiac arrhythmias; experiment 2, 139 patients with depressive illness; experiment 3, 98 family members of patients with schizophrenia. Results. Rates of violation of procedural invariance ranged from 16% to 32%. Violation of procedural invariance was not associated with age, education level, race, or gender. Subjects with violations of procedural invariance had, in general, less ability to discriminate among states and less reliable VAS and SG measurements, and sometimes had different mean SG and VAS values. Conclusions. Violation of procedural invariance of preferences across scaling methods may be a signal for failure of the measurement process. Researchers should test for procedural invariance and consider reporting data separately for satisfiers and violators.