Has psychotherapy worked? There is a new method for finding it out

A group of researchers headed by Professor Paul Emmelkamp (Amsterdam) has published a new method for assessing psychotherapy outcome in the current issue of Psychotherapy and Psychosomatics.

Although randomized controlled trials are considered the best scientific proof of effectiveness, there is increasing concern about their feasibility in psychotherapy research.

This group of investigators discuss a quasi-experimental study design for situations in which a randomized controlled trial is not feasible. As an alternative strategy, the propensity score (PS) method was used to correct for selection bias. The investigators used data from a Dutch research project, SCEPTRE (Study on Cost-Effectiveness of Personality Disorder Treatment). The sample consisted of 749 psychotherapy patients with personality pathology. They tested whether the PS method was useful and applicable.They examined differences between 2 treatment groups (short vs. long treatment duration) in pretreatment characteristics before and after PS correction. This revealed the impact of the PS on outcome differences.
At the end of the investigation, the PS offered statistical control over observed pretreatment differences between patients in a non-randomized study.

The Authors concluded that when a randomized controlled trial is not possible, this quasi-experimental design using the PS could be a feasible alternative.

Its advantages and limitations are discussed. Implemented carefully, this method is promising for future effectiveness research.

Source: Bartak, A; Spreeuwenberg, M.D.; Andrea, H.; Busschbach,J.J.V.; Croon, M.A.; Verheul, R.; Emmelkamp,P.M.G.; Stijnen,T. The Use of Propensity Score Methods in Psychotherapy Research. Psychother Psychosom 2009;78:26-34. via Alpha Galileo