The discriminative power of patient experience surveys

被引:28
作者
de Boer, Dolf [1 ,2 ]
Delnoij, Diana [3 ]
Rademakers, Jany [1 ]
机构
[1] Netherlands Inst Hlth Serv Res, NIVEL, Utrecht, Netherlands
[2] Ctr Consumer Experiences Healthcare, CKZ, Utrecht, Netherlands
[3] Tilburg Univ, Sci Ctr Transformat Care & Welf Tranzo, Tilburg, Netherlands
关键词
CAHPS(R) HOSPITAL SURVEY; CONSUMER QUALITY INDEX; HEALTH-CARE; PSYCHOMETRIC PROPERTIES; STATISTICAL ISSUES; OF-CARE; INSTRUMENT; PLANS; QUESTIONNAIRE; PERSPECTIVE;
D O I
10.1186/1472-6963-11-332
中图分类号
R19 [保健组织与事业(卫生事业管理)];
学科分类号
100404 [儿少卫生与妇幼保健学];
摘要
Background: Comparisons of patient experiences between providers are increasingly used as an index of performance. The present study describes the ability of patient experience surveys to discriminate between healthcare providers for various patient groups and quality aspects, and reports the sample sizes required for reliable (comparisons of) provider scores. Method: The consumer quality index is a family of surveys that are tailored to specific patient groups. Data was used from patients who underwent cataract surgery, patients who underwent hip or knee surgery, patients suffering from spinal disc herniation and patients suffering from varicose veins. Multi-level regression models were fitted to assess the proportion of variance in patient experiences that is attributable to providers for various quality aspects. Results: The proportion of variance in patient experiences that is attributable to providers varied from 0.001 to 0.054. The required sample size for reliable estimates at the provider level varied from 41 to 1967 per provider. Differences in discriminative power between patient groups and/or quality aspects were inconsistent, with one exception: for all groups, the discriminative power of experiences regarding change in physical functioning was particularly limited. Conclusions: From a statistical point of view, the discriminative power appears limited. The sample sizes required for reliable estimates are often substantial and deserve careful consideration when setting up measurements. Future research should evaluate the discriminative power by validating differences between providers in patient experiences with other indices and should explore other, more sensitive measures of patient experiences regarding treatment-related changes in physical functioning.
引用
收藏
页数:11
相关论文
共 29 条
[1]
Patterns of intra-cluster correlation from primary care research to inform study design and analysis [J].
Adams, G ;
Gulliford, MC ;
Ukoumunne, OC ;
Eldridge, S ;
Chinn, S ;
Campbell, MJ .
JOURNAL OF CLINICAL EPIDEMIOLOGY, 2004, 57 (08) :785-794
[2]
[Anonymous], YOUR HOSP
[3]
Improving quality assessment through multilevel modeling: the case of nursing home compare [J].
Arling, Greg ;
Lewis, Teresa ;
Kane, Robert L. ;
Mueller, Christine ;
Flood, Shannon .
HEALTH SERVICES RESEARCH, 2007, 42 (03) :1177-1199
[4]
Browne J, 2007, ELECTIVE SURG
[5]
Epilogue -: Early lessons from CAHPS™ demonstrations and evaluations [J].
Carman, KL ;
Short, PF ;
Farley, DO ;
Schnaier, JA ;
Elliott, DB ;
Gallagher, PM .
MEDICAL CARE, 1999, 37 (03) :MS97-MS105
[6]
Using Multilevel Modeling to Assess Case-Mix Adjusters in Consumer Experience Surveys in Health Care [J].
Damman, Olga C. ;
Stubbe, Janine H. ;
Hendriks, Michelle ;
Arah, Onyebuchi A. ;
Spreeuwenberg, Peter ;
Delnoij, Diana M. J. ;
Groenewegen, Peter P. .
MEDICAL CARE, 2009, 47 (04) :496-503
[7]
Made in the USA:: The import of American Consumer Assessment of Health Plan Surveys (CAHPS®) into the Dutch social insurance system [J].
Delnoij, Diana M. J. ;
ten Asbroek, Guus ;
Arah, Onyebuchi A. ;
de Koning, Johan S. ;
Stam, Piet ;
Poll, Aldien ;
Vriens, Barbara ;
Schmidt, Paul ;
Klazinga, Niek S. .
EUROPEAN JOURNAL OF PUBLIC HEALTH, 2006, 16 (06) :652-659
[8]
The Dutch Consumer Quality Index: an example of stakeholder involvement in indicator development [J].
Delnoij, Diana M. J. ;
Rademakers, Jany J. D. J. M. ;
Groenewegen, Peter P. .
BMC HEALTH SERVICES RESEARCH, 2010, 10
[9]
Systematic review: The evidence that publishing patient care performance data improves quality of care [J].
Fung, Constance H. ;
Lim, Yee-Wei ;
Mattke, Soeren ;
Damberg, Cheryl ;
Shekelle, Paul G. .
ANNALS OF INTERNAL MEDICINE, 2008, 148 (02) :111-123
[10]
League tables and their limitations: Statistical issues in comparisons of institutional performance [J].
Goldstein, H ;
Spiegelhalter, DJ .
JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES A-STATISTICS IN SOCIETY, 1996, 159 :385-409