Can evaluation studies benefit from triangulation? A case study

Background: Information and communication technologies (ICTs) are increasingly being used in health care. Rigorous evaluations of ICT applications during both introduction and routine use are of great importance for decision makers and users. Within evaluation research, two main (and often rather distinct) traditions can be found: the objectivistic and the subjectivistic tradition. Methods: The theory of triangulation deals with the integration of methods and approaches as to conduct better evaluation studies. In evaluation research, triangulation in general means the multiple employment of various sources of data, observers, methods, and/or theories in investigations of the same phenomenon. We applied triangulation aspects in the analysis of the effects of a computer-based nursing documentation system. Results: We discuss, based on this case study, what benefits can be obtained from applying triangulation in an evaluation study. We show how both the validation of results and the completeness of results can be supported by triangulation. Discussion: The decision whether triangulation may be useful for a given research question, and how it may be correctly applied, requires-like other evaluation methods-intensive training and methodotogical experience. Medical informatics evaluation research may profit from this well-established theory. (C) 2003 Elsevier Ireland Ltd. All rights reserved.