Stability of response characteristics of a Delphi panel: Application of bootstrap data expansion

被引：595

作者：

Akins R.B. ^{[1
]}

Tolson H. ^{[2
]}

Cole B.R. ^{[2
]}

机构：

[1] Quality and Patient Safety Initiatives, Rural and Community Health Institute, Texas A and M University System Health Science Center, College Station, TX

[2] Department of Educational Administration and Human Resource Development, Texas A and M University, College Station, TX

来源：

BMC Medical Research Methodology | / 5卷 / 1期

关键词：

Patient Safety; Delphi Method; Healthcare Institution; Delphi Study; Delphi Survey;

D O I：

10.1186/1471-2288-5-37

中图分类号：

学科分类号：

摘要：

Background: Delphi surveys with panels of experts in a particular area of interest have been widely utilized in the fields of clinical medicine, nursing practice, medical education and healthcare services. Despite this wide applicability of the Delphi methodology, there is no clear identification of what constitutes a sufficient number of Delphi survey participants to ensure stability of results. Methods: The study analyzed the response characteristics from the first round of a Delphi survey conducted with 23 experts in healthcare quality and patient safety. The panel members had similar training and subject matter understanding of the Malcolm Baldrige Criteria for Performance Excellence in Healthcare. The raw data from the first round sampling, which usually contains the largest diversity of responses, were augmented via bootstrap sampling to obtain computer-generated results for two larger samples obtained by sampling with replacement. Response characteristics (mean, trimmed mean, standard deviation and 95% confidence intervals) for 54 survey items were compared for the responses of the 23 actual study participants and two computer-generated samples of 1000 and 2000 resampling iterations. Results: The results from this study indicate that the response characteristics of a small expert panel in a well-defined knowledge area are stable in light of augmented sampling. Conclusion: Panels of similarly trained experts (who possess a general understanding in the field of interest) provide effective and reliable utilization of a small sample from a limited number of experts in a field of study to develop reliable criteria that inform judgment and support effective decision-making. © 2005 Akins et al; licensee BioMed Central Ltd.

引用

共 52 条

[1]

Williams P.L., Webb C., The Delphi technique: A methodological discussion, J Adv Nurs, 19, pp. 180-186, (1994)

[2]

Fischer R.G., The Delphi method: A description, review and criticism, J Acad Librariansh, 4, 2, pp. 64-70, (1978)

[3]

Wilhelm W.J., Alchemy of the Oracle: The Delphi technique, The Delta Pi Epsilon Journal, 43, 1, pp. 6-26, (2001)

[4]

Reid N.G., The Delphi technique: Its contribution to the evaluation of professional practice, Professional Competence and Quality Assurance in the Caring Professions, (1988)

[5]

Malone D.C., Abarca J., Hansten P.D., Grizzle A.J., Armstrong E.P., Van Bergen R.C., Duncan-Edgar B.S., Solomon S.L., Lipton R.B., Identification of serious drug-drug interactions: Results of the partnership to prevent drug-drug interactions, Am J Geriatr Pharmacother, 3, 2, pp. 65-76, (2005)

[6]

Strasser S., London L., Kortenbout E., Developing a competence framework and evaluation tool for primary care nurses in South Africa, Educ Health, 18, 2, pp. 133-144, (2005)

[7]

De Vet E., Brug J., De Nooijer J., Dijkstra A., De Vries N.K., Determinants of forward stage transitions: A Delphi study, Health Educ Res, 20, 2, pp. 195-205, (2005)

[8]

Howell S., Kemp C., Defining early number sense: A participatory Australian study, J Educ Psychol, 25, 5, pp. 555-571, (2005)

[9]

Nekolaichuk C.L., Fainsinger R.L., Lawlor P.G., A validation study of a pain classification system for advanced cancer patients using content experts: The Edmonton Classification System for cancer pain, Palliat Med, 19, pp. 466-476, (2005)

[10]

Armstrong D., Marshall J.K., Chiba N., Enns R., Fallone C.A., Fass R., Hollingworth R., Hunt R.H., Kahrilas P.J., Mayrand S., Moayyedi P., Paterson W.G., Sadowski D., Van Zanten S.J., Canadian consensus conference on the management of gastroesophageal reflux disease in adults - Update 2004, Can J Gastroenterol, 19, 1, pp. 15-35, (2005)

← 1 2 3 4 5 6 →