Blog

The Psychotherapy Practice Research Network (PPRNet) blog began in 2013 in response to psychotherapy clinicians, researchers, and educators who expressed interest in receiving regular information about current practice-oriented psychotherapy research. It offers a monthly summary of two or three published psychotherapy research articles. Each summary is authored by Dr. Tasca and highlights practice implications of selected articles. Past blogs are available in the archives. This content is only available in English.

October 2018

Super-shrinks and Pseudo-shrinks: Therapists Differ in Their Outcomes

Okiishi, J., Lambert, M. J., Nielsen, S. L., & Ogles, B. M. (2003). Waiting for supershrink: An empirical analysis of therapist effects. Clinical Psychology & Psychotherapy, 10(6), 361-373.

Much of psychotherapy research has focused on searching for effective psychotherapies rather than focusing on effective psychotherapists. Research on psychotherapies generally assumes that therapists are equally effective or relatively less important to patient outcomes than the interventions themselves. Therapists in clinical trials are trained to follow a manual in an attempt to reduce the therapists’ impact on patient outcomes, and to focus the study on the specific ingredients of the therapy itself. However, research indicates that the degree to which a therapist follows a manual has little bearing on patient outcomes, and that therapists do differ in terms of their patients’ outcomes. In one large study, between 33% and 65% of therapists was ineffective or harmful. Okiishi and colleagues asked if it is possible to identify highly effective therapists (“super-shrinks”) and highly ineffective therapists (“pseudo-shrinks”) based on their patients’ outcomes. The therapists were 56 men and women who treated 1779 clients in a university counselling centre. Each therapist saw at least 15 clients, so that there was a good sampling of therapists’ outcomes across a variety of clients. Therapists had a range of experience, training, and theoretical orientations. Clients were adults who had moderate to severe problems with anxiety, depression, or adjustment. Outcomes were measured after every session, and the average number of sessions was 5.16 (SD = 7.20). On average clients improved so that their level of distress significantly declined. Therapist characteristics (sex, experience, training background, theoretical orientation) did not predict patient outcomes. However, client change varied significantly, so that some clients improved at a faster rate than others, some did not change, and some got worse. There were no differences between therapists in their clients’ level of distress, so therapists had equivalent caseloads in terms of client initial distress. However, therapists significantly differed from each other in terms of their clients’ outcomes. For example, the top 3 therapists consistently had clients who got better (super-shrinks), and the bottom 3 therapists consistently had clients who got worse (pseudo-shrinks).

Practice Implications

One would hope that a loved one would get to see a “super-shrink” therapist, since these therapists seem to consistently have clients who do well in therapy. But what about the average or “pseudo-shrink” therapist– what can be done to elevate their skills and their patients’ outcomes? We’ve discussed in this blog several things therapists can do to improve their outcomes, including: using progress monitoring in their practice, receiving training focused on deliberate practice, and seeking out specific continuing education around developing, maintaining, and repairing the therapeutic alliance.
Psychotherapy for Eating Disorders

Grenon, R., Carlucci, S., Brugnera, A., Schwartze, D., … Tasca, G. A. (2018). Psychotherapy for eating disorders: A meta-analysis of direct comparisons, Psychotherapy Research, DOI: 10.1080/10503307.2018.1489162

Eating disorders can cause a great deal of physical and mental impairment because of the severity of the symptoms and because of comorbid conditions like depression, anxiety, substance use, and others. Anorexia nervosa (AN) occurs in about 0.5% of the population, bulimia nervosa (BN) occurs in about 1.5% of the population, and binge-eating disorder (BED) occurs in about 3.5% of the population. Treatment guidelines include both cognitive behavioral therapy (CBT) and interpersonal psychotherapy (IPT) as front line interventions for BN and BED. However, results from previous meta analyses of psychological treatments for eating disorders were confounded by not focusing exclusively on randomized controlled trials, mixing studies of adult and adolescent samples, combining an array of outcomes rather than separately reporting primary (eating disorder symptoms) and secondary (interpersonal problems, depression) outcomes, and not distinguishing between bona fide psychotherapies (like CBT, IPT, psychodynamic therapy, and others) from non-bona fide treatments (like self help, behavioral weight loss supportive counseling). Grenon and colleagues conducted a meta analysis of psychotherapies for eating disorders to examine if: psychotherapy is effective compared to a wait list, if bona fide psychotherapy and non-bona fide treatment differ in outcomes, and if one type of psychotherapy (i.e., CBT) was more effective than other bona fide psychotherapies (like IPT, behavior therapy, psychodynamic therapy, dialectical behavior therapy). Their meta analysis included 35 randomized controlled trials of direct comparisons. Psychotherapy was significantly more effective than a wait-list control at post treatment, so that 53.89% of patients were abstinent of symptoms after psychotherapy compared to only 8.92% who were abstinent in the wait-list group. Bona fide psychotherapies (51% abstinent) were significantly more effective than non-bona fide treatments (40% abstinent) at post treatment, and dropout in bona fide psychotherapies (17.5%) was significantly lower than in non-bona fide treatment (29.1%). Further, the difference between CBT and other bona fide psychotherapies was not significant.

Practice Implications

Psychotherapy for eating disorders are effective for patients with BN or BED. There were too few studies of those with AN to come to any conclusions about their treatment. Patients with BN or BED are best treated with a bona fide psychotherapy that involves face to face psychological therapy like CBT, IPT, psychodynamic therapy, dialectical behavior therapy, or behavior therapy. Non-bona fide treatments like self help, behavioral weight loss, and supportive counseling should only be used as an adjunct to bona fide psychotherapy for eating disorders.

August 2018

How Reliable is the Association Between Therapeutic Alliance and Patient Outcomes?

Flückiger, C., Del Re, A. C., Wampold, B. E., & Horvath, A. O. (2018). The alliance in adult psychotherapy: A meta-analytic synthesis. Psychotherapy. Advance online publication. http://dx.doi.org/10.1037/pst0000172

The therapeutic alliance is one of the most researched concepts in psychotherapy. The alliance, also called the working alliance or therapeutic alliance, consists of the collaborative agreement between patient and therapist on the tasks (what to do) and goals (what to achieve) of their therapeutic work together. Alliance also includes the relational or emotional bond between therapist and patient. It is different from therapist empathy, transference, countertransference, the real relationship and other concepts related to the therapeutic relationship. Researchers and clinicians have known for years about the importance of developing and maintaining an alliance to achieving patient outcomes. The growing research in this area now allows one to see how stable this finding is. Fluckiger and colleagues conducted a meta analysis of 306 studies with over 30,000 patients that assessed the alliance-outcome relationship. The research occurred in naturalistic settings (during regular clinical practice) and in randomized controlled trials. The overall effect size based on 295 independent comparisons was r = .278 (95% CI: .256, .299), indicating a statistically significant medium-sized association accounting for about 8% of treatment outcomes. To put this in perspective, this effect is as large as or larger than the effects of many common medical interventions. The type of therapy made no difference to this finding - the alliance was just as important to CBT as it was to psychodynamic, interpersonal, and emotionally focused therapies. The alliance-outcome correlation was somewhat smaller, though still significant among those with substance-use disorders, but otherwise was consistent for all other disorders tested (depression, anxiety, PTSD, borderline personality disorder). The alliance measure used, who rated the alliance, when it was assessed, and the outcome that was measured tended to have a small or no impact on the results. The alliance-outcome relationship was just as important to everyday clinical practice as it was in randomized controlled trials.

Practice Implications

The alliance-outcome association is highly reliable or stable across a number of therapies, diagnoses, measurements, and study designs. This very large body of research suggests that therapists should: (1) build and maintain an emotional bond, and agreement on tasks and goals with patients throughout therapy; (2) develop the alliance early by focusing on agreement on treatment and goals; (3) address ruptures in the alliance early and immediately; and (4) assess the strength and quality of the alliance regularly throughout treatment from the patient’s perspective using a well-known brief alliance measure.
The Partners for Change Outcome Monitoring System

Duncan, B. L., & Reese, R. J. (2015). The Partners for Change Outcome Management System (PCOMS): Revisiting the client’s frame of reference. Psychotherapy, 52(4), 391-401.

Generally, psychotherapy is effective for a wide variety of disorders, but regardless, many clients do not benefit. Further, the research shows that some therapists are more effective than others, but therapists tend to grossly over-estimate their effectiveness. In one large survey, therapists reported that their outcomes were better than 75% of their peers, no therapist rated themselves as below average, and therapists tended to over-estimate their effectiveness and under-estimate client deterioration. One way to evaluate patient outcomes and processes is to engage in progress monitoring and feedback. This involves repeated brief assessments of client outcomes followed by real-time feedback to therapists to gauge client progress and signal potential problems. Several such systems exist including the Outcome Questionnaire-45.2 and the Partners for Change Outcome Management System (PCOMS). The PCOMS is made up of the Outcome Rating Scale (ORS) and the Session Rating Scale (SRS). The ORS measures distress in 3 atheoretical domains (personal, family, social) not based on diagnosis. The SRS is a measure of therapeutic alliance. Both the ORS and SRS are very short 4-item scales that can be administered before (ORS) and after (SRS) each session of therapy. In this paper, Duncan and Reese review the research supporting the use of the PCOMS. A meta analysis found that clients whose therapists received feedback with the PCOMS were 3.5 times more likely to experience reliable change and had less than half the chance of experiencing deterioration. Five randomized controlled trials demonstrated the advantage of the PCOMS over treatment as usual, including by reducing drop outs and achieving reliable change in fewer sessions.

Practice Implications

A lot of research has demonstrated that most therapists over-estimate their effectiveness and that many are not able to identify clients who are getting worse. It is time for therapists to acknowledge this positive bias of their effectiveness and their need for quality information in order to make good clinical decisions. Progress monitoring and feedback systems are one means by which therapists can receive quality information. The repeated use of the PCOMS for example, can help to identify when clients begin to deteriorate and/or when problems emerge with the therapeutic alliance. Being able to identify these issues early may allow therapists to act quickly to avert client deterioration or drop out.
Why Therapists Tend Not To Use Progress Monitoring

Miller, S. D., Hubble, M. A., Chow, D., & Seidel, J. (2015). Beyond measures and monitoring: Realizing the potential of feedback-informed treatment. Psychotherapy, 52(4), 449-457.

Progress monitoring is the process of repeatedly assessing client functioning with validated measures and providing feedback to therapists. The feedback is designed to identify problems with the therapeutic relationship or with client deterioration by comparing client progress to similar clients. This allows therapists to change what they are doing, renegotiate aspects of therapy, or directly address the issues. Research is clear that progress monitoring significantly increases the proportion of clients who improve, reduces drop outs by a third, shortens the length of therapy, and reduces costs. Yet the research also indicates that only 12% of psychologists are using progress monitoring in their practice. If progress monitoring is so useful, then why aren`t more therapists using it? In this review, Miller and colleagues discuss some of the barriers and problems with using or adopting progress monitoring in clinical practice. They describe that even in the most favorable circumstances, it takes about two decades for new treatments to be integrated into routine care. Another issue is that recent surveys indicate that only about 33% of psychologists and 66% of training directors are aware of progress monitoring. Even for those who are aware, a common barrier might be cost and time to implement the procedures. Despite the brevity and low cost of the tools, like the PCOMS, they all place an additional burden on clinicians’ busy schedule. There is also the issue of staff turnover. As staff come and go, organizations may lose those who lead, train, and support the use of progress monitoring. Probably the biggest barrier is skepticism on the part of clinicians who might see the tools as too superficial, or who might be concerned that repeated measurement may somehow negatively affect the therapeutic relationship. However, research indicates that clients generally report positive experiences – they like being a more integral part of the assessment process, and they appreciate the ability to track their own progress. Finally, whereas clinicians may use progress monitoring to improve clinical decision-making, administrators may see it as a means of conducting performance reviews.

Practice Implications

In most health care fields, it can take 20 years for an innovation to make it into routine practice. That might be the case for progress monitoring. More clinicians need to know about it, be trained in its use, and see for themselves that the information is valid, of high quality, and that it can supplement their work in identifying clients who are not doing well. In particular, progress monitoring may be a means of enhancing the therapeutic alliance as it provides therapists and clients a vehicle to discuss how the therapy is going, what needs focus, and what to do if things go awry. Organizations need to treat progress monitoring as a means of helping therapists to improve their skills, and not as a means of auditing performance. Therapists need quality information upon which to make sound clinical decisions, and progress monitoring is one way of receiving this information.

July 2018

Are E-Health Interventions Useful for Weight Loss?

Podina, I. R., & Fodor, L. A. (2018). Critical review and meta-analysis of multicomponent behavioral e-health interventions for weight loss. Health Psychology, 37(6), 501-515.

Over 35% of Americans are overweight or obese, and this poses significant health-related challenges. Obesity likely contributes to heart disease, Type II diabetes, and some forms of cancer. Also, obesity is often co-morbid with mental health conditions including depression and binge-eating disorder. Practice guidelines list multicomponent behavioural interventions as state of the art treatment for weight loss. These include dietary counselling, increased physical activity, and behavioural methods to support behaviour change. However, such interventions often require direct in-person contact with a health or mental health professional, which can be expensive and create a barrier to accessing treatment for some. An option to increase access is to deliver the multicomponent behavioural intervention by internet or by another electronic format such as DVD. In this meta analysis, Podina and Fodor reviewed 47 randomized controlled studies representing over 1500 participants in which e-health interventions for weight loss in overweight or obese individuals were tested against in-person treatment or a control condition (no treatment or treatment as usual). E-health interventions were more effective than control conditions for weight loss outcomes at post-treatment, g = 0.34 (95% CI [0.24 to 0.44]). Similar results were found at follow-up. However, e-health interventions were significantly less effective than active in-person treatments, g = -0.31 (95% CI [-0.43 to -0.20]) for weight loss in overweight or obese individuals.

Practice Implications

E-health interventions (mostly internet delivered treatment) of multicomponent behavioral treatment for weight loss was more effective than no treatment or treatment as usual. However, e-health was significantly less effective than traditional face to face behavioral interventions to help people reduce their body weight. The authors raised concerns about the use of e-health interventions for weight loss as the first line treatment as the effects were small and the approach was less effective than in-person interventions.

This month...

Type of Research

Topics

October 2018

Practice Implications

Practice Implications

August 2018

Practice Implications

Practice Implications

Practice Implications

July 2018

Practice Implications

Psychotherapy Practice Research Network (PPRNet)