In this article, David Tolin looks at why some studies do not find cognitive-behavior therapies to be better than other forms of therapy. He identifies several sources of error variance (in other words, noisy data) that may hide any differences between the effectiveness of candidate psychotherapies. He then suggests ways to improve comparisons of such psychotherapeutic evaluations.
Abstract
The present qualitative and quantitative review examines the efficacy of CBT versus non‐CBT treatments for anxiety disorders and suggests that a prior failure (Baardseth et al., 2013, p. 395) to detect differences in outcome can easily be attributed to excessive error variance in the analysis, essentially burying the “signal” under “noise.” Several sources of error variance are identified, including type of comparison therapy, diagnosis, what outcome is being measured, and study quality. It is suggested that the “signal” of CBT versus other psychotherapies can easily be seen or not seen, depending on what one chooses to analyze. Recommendations are made for further study about the relative efficacy of different psychological treatments.
Citation
Tolin, D. F. (2014). Beating a dead dodo bird: Looking at signal vs. noise in cognitive‐behavioral therapy for anxiety disorders. Clinical Psychology: Science and Practice, 21(4), 351–362.