The researcher's own therapy allegiances: A "wild card" in comparisons of treatment efficacy

This report examines a possible distortion in the results of comparative treatment studies due to the association of the researcher's treatment allegiances with outcomes of those treatments. In eight past reviews a trend appeared for significant associations between the researcher's allegiance and outcomes of treatments compared. In a new review of 29 studies of treatment comparisons, a similar trend appeared. Allegiance ratings were based not only on the usual reprint method, but also on two new methods: ratings by colleagues who knew the researcher well, and self-ratings by the researchers themselves. The two new allegiance methods intercorrelated only moderately, but each allegiance measure correlated significantly with outcomes of the treatments compared, and when combined, the three measures explained 69% of the variance in outcomes! Such an association can distort comparative treatment results. Our report concludes with how the researcher's allegiance may become associated with treatment outcomes and how studies should deal with these associations.