Blog

Jennissen, S., Huber, J., Ehrenthal, J.C., Schauenburg, H., & Dinger, U. (2018). Association between insight and outcome of psychotherapy: Systematic review and meta-analysis. The American Journal of Psychiatry. Published Online: https://doi.org/10.1176/appi.ajp.2018.17080847

For many authors, one of the purported mechanisms of change in psychotherapy is insight. In fact, the utility of insight for clients with mental health problems was first proposed over 120 years ago by Freud and Breuer. Briefly, insight refers to higher levels of self-understanding that might result in fewer negative automatic reactions to stress and other challenges, more positive emotions, and greater flexibility in cognitive and interpersonal functioning. Although insight is a key factor in some psychodynamic models, it also plays a role in other forms of psychotherapy. Experiential psychotherapy emphasises gaining a new perspective through experiencing, and for CBT insight relates to becoming more aware of automatic thoughts. Jennissen and colleagues defined insight as patients understanding: the relationship between past and present experiences, their typical relationship patterns, and the associations between interpersonal challenges, emotional experiences, and psychological symptoms. In this study, Jennissen and colleagues conducted a systematic review and meta analysis of the insight-outcome relationship, that is the relationship between client self-understanding and symptom reduction. They reviewed studies of adults seeking psychological treatment including individual or group therapy. The predictor variable was an empirical measure of insight assessed during treatment but prior to when final outcomes were evaluated. The outcome was some reliable and empirical measure related to symptom improvement, pre- to post- treatment. The review turned up 22 studies that included over 1100 patients mostly with anxiety or depressive disorders who attended a median of 20 sessions of therapy. The overall effect size of the association between insight and outcome was r = 0.31 (95% CI=0.22–0.40, p < 0.05), which represents a medium effect. Moderator analyses found no effect of type of therapy or diagnosis on this mean effect size, though the power of these analyses was low.

Practice Implications

The magnitude of the association between insight and outcome is similar to the effects of other therapeutic factors such as the therapeutic alliance. When gaining insight, patients may achieve a greater self-understanding, which allows them to reduce distorted perceptions of themselves, and better integrate unpleasant experiences into their conscious life. Symptoms may be improved by self-understanding because of the greater sense of control and master that it provides, and by the new solutions and adaptive ways of living that become available to clients.

Author email: Simone.Jennissen@med.uni-heidelberg.de

Reese, R. J., Duncan, B. L., Bohanske, R. T., Owen, J. J., & Minami, T. (2014). Benchmarking outcomes in a public behavioral health setting: Feedback as a quality improvement strategy. Journal of Consulting and Clinical Psychology, 82(4), 731-742.

Psychotherapy has demonstrated its efficacy in randomized controlled trials. But do these findings in highly controlled studies translate to everyday practice in publicly funded agencies that treat low income clients? Previous research in the US showed that outcomes of treatment-as-usual in public behavioural health agencies are generally not positive, so that only 20 to 35% of clients reliably improved. One approach to improving outcomes is to transport specific evidence-based treatments into practice settings. For example, research on applying CBT for panic and depression in a publicly funded agency resulted in similar outcomes to those achieved in randomized controlled trials. However, an alternative strategy of improving outcomes is to use continuous outcome monitoring, which involves repeated (weekly) measurement of client outcomes with reliable scales, and feedback to therapists on the client’s status relative to previous sessions and relative to other similar clients. Research has demonstrated that this strategy improves client outcomes and reduces the number of clients who deteriorate. In this study, Reese and colleagues examined the outcomes of a large public behavioural health service in the U.S. that treats low-income individuals. The service implemented repeated outcome monitoring of clients with feedback to therapists. Over 5,000 clients mainly with depression, mood, and anxiety disorders were treated by 84 therapists who were licensed at the masters degree or higher. The clients completed the Outcome Rating Scale (a measure of symptom outcome) prior to each session, and the Session Rating Scale (a measure of the therapeutic alliance) after each session. Therapists received two days of training on how to use these measures and on the continuous feedback they were provided in order to improve their treatment of clients and their outcomes. Outcomes from this public behavioural health service were compared to previous large studies in publicly funded settings that implemented specific evidence-based treatments. The findings were similar, with about 42% showing reliable pre- to post-treatment improvement. The results of implementing continuous outcome monitoring with feedback for depressive symptoms were also large and positive (d = 1.34). These effects were similar to benchmarks established in randomized controlled trials of specific psychotherapies.

Practice Implications

Continuous outcome feedback enables therapists to identify clients who are not benefiting
from a given treatment, so that clinicians may collaboratively design different interventions or change their interpersonal stances. The inclusion of outcome monitoring and feedback in this publicly funded psychotherapy system, resulted in outcomes that were: better than what is often seen in such public service settings, equivalent to those public systems that implemented specific evidence based treatments, and similar to those reported in highly controlled randomized trials. The authors concluded that adding routine outcome monitoring and feedback is a viable alternative to transporting specific evidence based treatments to publicly funded psychotherapy programs. The measures used in this study are available free for individuals to use at: betteroutcomesnow.com.

Author email: jeff.reese@uky.edu

Munder, T., Fluckiger, C., Leichsenring, F, Abbass, A.A., Hilsenroth, M.J., … Wampold, B.E. (2018). Is psychotherapy effective? A re-analysis of treatments for depression. Epidemiology and Psychiatric Sciences, 1-7.

Based on a deeply flawed review in 1952, Hans Eysenck declared that psychotherapy was no more effective than custodial care for treating mental disorders. Later, he qualified this by stating that behaviour therapy was effective and other forms of psychotherapy were not. These statements touched off decades of angst and debate in the psychotherapy community, and also resulted in a great deal of research about psychotherapy’s effectiveness. By the 1970s the new research technique of meta-analysis was developed and was applied to psychotherapy research. In their seminal meta analysis of controlled studies, Smith and Glass found that psychotherapy was useful and with large effects compared to no treatment. And yet the debate continues. In 2018, Cuijpers argued that waitlist control groups (i.e., a common control condition in psychotherapy studies in which patients receive no treatment) are an inappropriate comparison leading to exaggerated estimates of the effects of psychotherapy. Recently, Munder and colleagues argued that waitlist controls are a way of estimating the natural course of the disorder (what would happen with no treatment) plus the effect of expecting to receive treatment (client expectations of receiving treatment tend to have a positive impact on symptoms). In fact, research shows that pre- to post-study effect sizes for the waiting period is approximately g = .40, or a medium effect. In other words, waiting for therapy in a study results in a moderate proportion of individuals getting better on their own without treatment. Therefore, Munder and colleagues argued that comparing psychotherapy to a waitlist control is appropriate and may be a conservative estimate of psychotherapy’s effects (i.e., psychotherapy has to outperform the effects of clients expecting treatment to help them). In their meta analysis, Munder and colleagues re-analysed 71 studies of psychotherapy for depression compared to a waitlist control condition. They found that the effect size in favour of psychotherapy was g = 0.75 (SE = 0.09) indicating a moderate to large effect. Psychotherapy was also more effective than care as usual (i.e., compared to another intervention that was not psychotherapy), g = 0.31 (SE = 0.11). There were no differences between types of psychotherapy (CBT, IPT, PDT, etc.) for depression outcomes.

Practice Implications

Despite various attempts during the history of psychotherapy to downplay or disparage its efficacy, research continues to show that psychotherapy is in fact effective. The average effect size compared to the natural history of depression is moderate to large (and that is likely an under-estimate). Again, there is no evidence that one type of psychotherapy is superior to another for treating depression. It is time for the field to move beyond questions of efficacy of psychotherapy and of the relative efficacy of different treatments, and look to understanding therapist interpersonal stances, client characteristics, and relationship factors that may improve outcomes from psychotherapy.

Flückiger, C., Del Re, A. C., Wampold, B. E., & Horvath, A. O. (2018). The alliance in adult psychotherapy: A meta-analytic synthesis. Psychotherapy. Advance online publication. http://dx.doi.org/10.1037/pst0000172

The therapeutic alliance is one of the most researched concepts in psychotherapy. The alliance, also called the working alliance or therapeutic alliance, consists of the collaborative agreement between patient and therapist on the tasks (what to do) and goals (what to achieve) of their therapeutic work together. Alliance also includes the relational or emotional bond between therapist and patient. It is different from therapist empathy, transference, countertransference, the real relationship and other concepts related to the therapeutic relationship. Researchers and clinicians have known for years about the importance of developing and maintaining an alliance to achieving patient outcomes. The growing research in this area now allows one to see how stable this finding is. Fluckiger and colleagues conducted a meta analysis of 306 studies with over 30,000 patients that assessed the alliance-outcome relationship. The research occurred in naturalistic settings (during regular clinical practice) and in randomized controlled trials. The overall effect size based on 295 independent comparisons was r = .278 (95% CI: .256, .299), indicating a statistically significant medium-sized association accounting for about 8% of treatment outcomes. To put this in perspective, this effect is as large as or larger than the effects of many common medical interventions. The type of therapy made no difference to this finding - the alliance was just as important to CBT as it was to psychodynamic, interpersonal, and emotionally focused therapies. The alliance-outcome correlation was somewhat smaller, though still significant among those with substance-use disorders, but otherwise was consistent for all other disorders tested (depression, anxiety, PTSD, borderline personality disorder). The alliance measure used, who rated the alliance, when it was assessed, and the outcome that was measured tended to have a small or no impact on the results. The alliance-outcome relationship was just as important to everyday clinical practice as it was in randomized controlled trials.

Practice Implications

The alliance-outcome association is highly reliable or stable across a number of therapies, diagnoses, measurements, and study designs. This very large body of research suggests that therapists should: (1) build and maintain an emotional bond, and agreement on tasks and goals with patients throughout therapy; (2) develop the alliance early by focusing on agreement on treatment and goals; (3) address ruptures in the alliance early and immediately; and (4) assess the strength and quality of the alliance regularly throughout treatment from the patient’s perspective using a well-known brief alliance measure.

Duncan, B. L., & Reese, R. J. (2015). The Partners for Change Outcome Management System (PCOMS): Revisiting the client’s frame of reference. Psychotherapy, 52(4), 391-401.

Generally, psychotherapy is effective for a wide variety of disorders, but regardless, many clients do not benefit. Further, the research shows that some therapists are more effective than others, but therapists tend to grossly over-estimate their effectiveness. In one large survey, therapists reported that their outcomes were better than 75% of their peers, no therapist rated themselves as below average, and therapists tended to over-estimate their effectiveness and under-estimate client deterioration. One way to evaluate patient outcomes and processes is to engage in progress monitoring and feedback. This involves repeated brief assessments of client outcomes followed by real-time feedback to therapists to gauge client progress and signal potential problems. Several such systems exist including the Outcome Questionnaire-45.2 and the Partners for Change Outcome Management System (PCOMS). The PCOMS is made up of the Outcome Rating Scale (ORS) and the Session Rating Scale (SRS). The ORS measures distress in 3 atheoretical domains (personal, family, social) not based on diagnosis. The SRS is a measure of therapeutic alliance. Both the ORS and SRS are very short 4-item scales that can be administered before (ORS) and after (SRS) each session of therapy. In this paper, Duncan and Reese review the research supporting the use of the PCOMS. A meta analysis found that clients whose therapists received feedback with the PCOMS were 3.5 times more likely to experience reliable change and had less than half the chance of experiencing deterioration. Five randomized controlled trials demonstrated the advantage of the PCOMS over treatment as usual, including by reducing drop outs and achieving reliable change in fewer sessions.

Practice Implications

A lot of research has demonstrated that most therapists over-estimate their effectiveness and that many are not able to identify clients who are getting worse. It is time for therapists to acknowledge this positive bias of their effectiveness and their need for quality information in order to make good clinical decisions. Progress monitoring and feedback systems are one means by which therapists can receive quality information. The repeated use of the PCOMS for example, can help to identify when clients begin to deteriorate and/or when problems emerge with the therapeutic alliance. Being able to identify these issues early may allow therapists to act quickly to avert client deterioration or drop out.

Miller, S. D., Hubble, M. A., Chow, D., & Seidel, J. (2015). Beyond measures and monitoring: Realizing the potential of feedback-informed treatment. Psychotherapy, 52(4), 449-457.

Progress monitoring is the process of repeatedly assessing client functioning with validated measures and providing feedback to therapists. The feedback is designed to identify problems with the therapeutic relationship or with client deterioration by comparing client progress to similar clients. This allows therapists to change what they are doing, renegotiate aspects of therapy, or directly address the issues. Research is clear that progress monitoring significantly increases the proportion of clients who improve, reduces drop outs by a third, shortens the length of therapy, and reduces costs. Yet the research also indicates that only 12% of psychologists are using progress monitoring in their practice. If progress monitoring is so useful, then why aren`t more therapists using it? In this review, Miller and colleagues discuss some of the barriers and problems with using or adopting progress monitoring in clinical practice. They describe that even in the most favorable circumstances, it takes about two decades for new treatments to be integrated into routine care. Another issue is that recent surveys indicate that only about 33% of psychologists and 66% of training directors are aware of progress monitoring. Even for those who are aware, a common barrier might be cost and time to implement the procedures. Despite the brevity and low cost of the tools, like the PCOMS, they all place an additional burden on clinicians’ busy schedule. There is also the issue of staff turnover. As staff come and go, organizations may lose those who lead, train, and support the use of progress monitoring. Probably the biggest barrier is skepticism on the part of clinicians who might see the tools as too superficial, or who might be concerned that repeated measurement may somehow negatively affect the therapeutic relationship. However, research indicates that clients generally report positive experiences – they like being a more integral part of the assessment process, and they appreciate the ability to track their own progress. Finally, whereas clinicians may use progress monitoring to improve clinical decision-making, administrators may see it as a means of conducting performance reviews.

Practice Implications

In most health care fields, it can take 20 years for an innovation to make it into routine practice. That might be the case for progress monitoring. More clinicians need to know about it, be trained in its use, and see for themselves that the information is valid, of high quality, and that it can supplement their work in identifying clients who are not doing well. In particular, progress monitoring may be a means of enhancing the therapeutic alliance as it provides therapists and clients a vehicle to discuss how the therapy is going, what needs focus, and what to do if things go awry. Organizations need to treat progress monitoring as a means of helping therapists to improve their skills, and not as a means of auditing performance. Therapists need quality information upon which to make sound clinical decisions, and progress monitoring is one way of receiving this information.