Blog

The Psychotherapy Practice Research Network (PPRNet) blog began in 2013 in response to psychotherapy clinicians, researchers, and educators who expressed interest in receiving regular information about current practice-oriented psychotherapy research. It offers a monthly summary of two or three published psychotherapy research articles. Each summary is authored by Dr. Tasca and highlights practice implications of selected articles. Past blogs are available in the archives. This content is only available in English.

January 2019

Adapting Psychotherapy to Patient Resistance Level

Beutler, L. E., Edwards, C., & Someah, K. (2018). Adapting psychotherapy to patient reactance level: A meta‐analytic review. Journal of Clinical Psychology. Advance online publication.

This is another meta-analysis part of the Psychotherapy Relationships That Work series. In this study Beutler and colleagues looked at client resistance and its more extreme form, reactance. Resistance refers to a client avoiding to make changes advocated by the therapist, whereas reactance indicates not only that a client resists but also moves in a direction away from what the therapist is advocating. Social psychologists define resistance as a state of mind aroused by threat to one’s freedom and then attempts to restore one’s freedom. Resistance and reactance are relational concepts – that is, they are not only qualities of the client but defined by the therapeutic relationship. Therapists play a role in resistance by the degree to which they are directive, and by their ability to adjust their level of directiveness or control to the client’s characteristics. Therapist directiveness refers to the degree to which a therapist uses suggestion, interpretation, and assignments in therapy, such as: homework, setting topics, and leading the session. One way for a therapist to adjust their interpersonal stance is to reduce their level of directiveness with clients who are more resistant. In this meta-analysis, Beutler and colleagues reviewed 13 studies representing 1,028 clients. The aggregate effect size for the association between client reactance and therapist directiveness with client outcomes was d = 0.78 (SE = 0.1; p < .001; 95% CI: 0.60–0.97), which is large and significant. In other words, if a therapist adjusted their level of control by lowering it in the face of a resistant client, then client outcomes were better. The opposite was also true, if a therapist increased their directiveness for clients who were less resistant then those clients had better outcomes.

Practice Implications

The results indicate that if client resistance or reactance is not met with confrontation and control, but with acceptance and non-defensiveness, the client may have a better outcome. Resistant or reactant clients will likely do better in a therapy that is less directive, whereas clients with lower levels of resistance may do better with more directive interventions. Therapists may do well to assess routinely the level of a client’s resistance, and adjust their interventions accordingly. Highly resistant clients may need a more collaborative approach, and a transparent discussion that focuses on the impact of certain interventions and therapist interpersonal stances on the client’s sense of control and personal freedom in the therapy.

November 2018

Psychotherapy Relationships That Work: Becoming an Evidence-Based Therapist II

Norcross, J. C., & Lambert, M. J. (2018). Psychotherapy relationships that work III. Psychotherapy, 55(4), 303-315.

Relationship factors in psychotherapy are some of the most important predictors of patient outcomes. They outweigh factors like the type of therapy provided in determining whether patients get better after psychotherapy. In this second overview article, Norcross and Lambert provide a review of 17 meta-analyses of relationship factors in psychotherapy that contribute to positive outcomes. Like the review of patient factors also found in this blog and E-Newsletter, this article briefly outlines those evidence-based relationship factors that reliably predict patient outcomes in psychotherapy. The therapeutic relationship refers to how the therapist and patient relate to each other, or their interpersonal behaviors. By contrast, techniques or interventions refer to what is done by the therapist. Practice guidelines typically focus on interventions or therapeutic orientation. As the authors argue, what is missing from treatment guidelines are the person of the therapist and the therapeutic relationship – evidence for which is backed up by 5 decades of research. Even in studies of highly structured manualized psychotherapy for a specific disorder in which efforts were made to reduce the effect of individual therapist, up to 18% of outcomes (a moderate to large effect) could be attributed to the person of the therapist. By contrast somewhere between 0% and 10% of outcomes (a small to moderate effect) is attributable to specific treatment methods. So, which therapeutic relationship factors are reliably related to patient outcomes? These include: the therapeutic alliance in individual therapy (306 studies, g = .57) couple therapy (40 studies, g = .62), and adolescent psychotherapy (43 studies, g = .40), collaboration (53 studies, g = .61) and goal consensus (54 studies, g = .49), cohesion in group therapy (55 studies, g = .56), therapist empathy (82 studies, g = .58), collecting and delivering client feedback or progress monitoring (24 studies, g = .14 to .49), managing countertransference (9 studies, g = .84), and repairing therapeutic alliance ruptures (11 studies, g = .62) among others. Over the next few months, I will be reviewing these meta analyses in more detail to discuss how therapists can use this evidence base to improve their patients’ outcomes.

Practice Implications

The research as a whole indicates that therapists should make the creation and cultivation of the therapeutic relationship a primary goal of therapy. Factors such as managing the therapeutic alliance, repairing alliance ruptures, engaging in ongoing progress monitoring, managing countertransference and others should be used to modify treatments and interpersonal stances in order to maximize outcomes. When seeking out professional development and training, practitioners should focus on evidence-based relationship factors (managing the alliance, judicious self disclosure, managing emotional expression, promoting credibility of the treatment, collecting formal feedback, managing countertransference) in addition to focusing on evidence-based treatments.

October 2018

Super-shrinks and Pseudo-shrinks: Therapists Differ in Their Outcomes

Okiishi, J., Lambert, M. J., Nielsen, S. L., & Ogles, B. M. (2003). Waiting for supershrink: An empirical analysis of therapist effects. Clinical Psychology & Psychotherapy, 10(6), 361-373.

Much of psychotherapy research has focused on searching for effective psychotherapies rather than focusing on effective psychotherapists. Research on psychotherapies generally assumes that therapists are equally effective or relatively less important to patient outcomes than the interventions themselves. Therapists in clinical trials are trained to follow a manual in an attempt to reduce the therapists’ impact on patient outcomes, and to focus the study on the specific ingredients of the therapy itself. However, research indicates that the degree to which a therapist follows a manual has little bearing on patient outcomes, and that therapists do differ in terms of their patients’ outcomes. In one large study, between 33% and 65% of therapists was ineffective or harmful. Okiishi and colleagues asked if it is possible to identify highly effective therapists (“super-shrinks”) and highly ineffective therapists (“pseudo-shrinks”) based on their patients’ outcomes. The therapists were 56 men and women who treated 1779 clients in a university counselling centre. Each therapist saw at least 15 clients, so that there was a good sampling of therapists’ outcomes across a variety of clients. Therapists had a range of experience, training, and theoretical orientations. Clients were adults who had moderate to severe problems with anxiety, depression, or adjustment. Outcomes were measured after every session, and the average number of sessions was 5.16 (SD = 7.20). On average clients improved so that their level of distress significantly declined. Therapist characteristics (sex, experience, training background, theoretical orientation) did not predict patient outcomes. However, client change varied significantly, so that some clients improved at a faster rate than others, some did not change, and some got worse. There were no differences between therapists in their clients’ level of distress, so therapists had equivalent caseloads in terms of client initial distress. However, therapists significantly differed from each other in terms of their clients’ outcomes. For example, the top 3 therapists consistently had clients who got better (super-shrinks), and the bottom 3 therapists consistently had clients who got worse (pseudo-shrinks).

Practice Implications

One would hope that a loved one would get to see a “super-shrink” therapist, since these therapists seem to consistently have clients who do well in therapy. But what about the average or “pseudo-shrink” therapist– what can be done to elevate their skills and their patients’ outcomes? We’ve discussed in this blog several things therapists can do to improve their outcomes, including: using progress monitoring in their practice, receiving training focused on deliberate practice, and seeking out specific continuing education around developing, maintaining, and repairing the therapeutic alliance.
Patients’ Experiences With Routine Outcome Monitoring

Solstad, S.M., Castonguay, L.G., & Moltu, C. (2018). Patients’ experiences with routine outcome monitoring and clinical feedback systems: A systematic review and synthesis of qualitative empirical literature. Psychotherapy Research. doi=10.1080/10503307.2017.1326645.

Routine outcome monitoring or progress monitoring involves assessing client outcomes or the therapeutic alliance on a weekly basis in psychotherapy, and then giving feedback to the therapist about how the client is doing relative to the previous week and relative to similar clients. Research on progress monitoring indicates that it improves outcomes and it reduces by half the number of clients who might get worse. Despite its benefits, many therapists are not aware of progress monitoring or are reluctant to use the procedure. Some have expressed concerns that progress monitoring could interfere with the therapeutic relationship. However, very few studies have asked clients about their experiences of progress monitoring. In this synthesis of qualitative studies, Solstad and colleagues reviewed 16 studies in which clients were interviewed about their experiences of progress monitoring. The authors used a procedure in which they identified common themes across the studies and categorized client statements within those themes (e.g., thematic analysis). The authors were interested in identifying what were the hindering and helpful processes in clients’ experiences of their therapists’ use of progress monitoring. Four main themes emerged from the research. First, some clients voiced suspicion of how the progress monitoring data was going to be used and why the procedure was implemented. That is, clients sometimes felt that filling out questionnaires weekly was mainly a bureaucratic exercise, or possibly a means to justify reducing services. Second, some clients felt the questionnaires were not flexible enough to capture the complexity of mental health and of client concerns. The questionnaires often focused on symptoms, but clients were also interested in the therapeutic relationship, family, and social functioning. Third, some clients wanted to be more fully informed about the rationale for progress monitoring so that they could feel more empowered to define their own outcomes and treatment plans. Fourth, some clients found progress monitoring to help them to see graphically their own progress, to become more engaged in treatment planning, and to participate in collaborative and reflective discussions with their therapist.

Practice Implications

If psychotherapists choose to use progress monitoring in their practices, they should make sure that clients know what the data will be used for and that the exercise is not just a bureaucratic process. The practice of outcome or progress monitoring can be used to stimulate reflection not only in the therapist but also in the client. Reviewing the client data together might enhance conversations about therapy, the therapeutic relationship, and help to establish realistic goals for therapy. Therapists might consider not only measuring symptom progress repeatedly, but also measuring the working alliance on a regular basis.

August 2018

The Partners for Change Outcome Monitoring System

Duncan, B. L., & Reese, R. J. (2015). The Partners for Change Outcome Management System (PCOMS): Revisiting the client’s frame of reference. Psychotherapy, 52(4), 391-401.

Generally, psychotherapy is effective for a wide variety of disorders, but regardless, many clients do not benefit. Further, the research shows that some therapists are more effective than others, but therapists tend to grossly over-estimate their effectiveness. In one large survey, therapists reported that their outcomes were better than 75% of their peers, no therapist rated themselves as below average, and therapists tended to over-estimate their effectiveness and under-estimate client deterioration. One way to evaluate patient outcomes and processes is to engage in progress monitoring and feedback. This involves repeated brief assessments of client outcomes followed by real-time feedback to therapists to gauge client progress and signal potential problems. Several such systems exist including the Outcome Questionnaire-45.2 and the Partners for Change Outcome Management System (PCOMS). The PCOMS is made up of the Outcome Rating Scale (ORS) and the Session Rating Scale (SRS). The ORS measures distress in 3 atheoretical domains (personal, family, social) not based on diagnosis. The SRS is a measure of therapeutic alliance. Both the ORS and SRS are very short 4-item scales that can be administered before (ORS) and after (SRS) each session of therapy. In this paper, Duncan and Reese review the research supporting the use of the PCOMS. A meta analysis found that clients whose therapists received feedback with the PCOMS were 3.5 times more likely to experience reliable change and had less than half the chance of experiencing deterioration. Five randomized controlled trials demonstrated the advantage of the PCOMS over treatment as usual, including by reducing drop outs and achieving reliable change in fewer sessions.

Practice Implications

A lot of research has demonstrated that most therapists over-estimate their effectiveness and that many are not able to identify clients who are getting worse. It is time for therapists to acknowledge this positive bias of their effectiveness and their need for quality information in order to make good clinical decisions. Progress monitoring and feedback systems are one means by which therapists can receive quality information. The repeated use of the PCOMS for example, can help to identify when clients begin to deteriorate and/or when problems emerge with the therapeutic alliance. Being able to identify these issues early may allow therapists to act quickly to avert client deterioration or drop out.
Why Therapists Tend Not To Use Progress Monitoring

Miller, S. D., Hubble, M. A., Chow, D., & Seidel, J. (2015). Beyond measures and monitoring: Realizing the potential of feedback-informed treatment. Psychotherapy, 52(4), 449-457.

Progress monitoring is the process of repeatedly assessing client functioning with validated measures and providing feedback to therapists. The feedback is designed to identify problems with the therapeutic relationship or with client deterioration by comparing client progress to similar clients. This allows therapists to change what they are doing, renegotiate aspects of therapy, or directly address the issues. Research is clear that progress monitoring significantly increases the proportion of clients who improve, reduces drop outs by a third, shortens the length of therapy, and reduces costs. Yet the research also indicates that only 12% of psychologists are using progress monitoring in their practice. If progress monitoring is so useful, then why aren`t more therapists using it? In this review, Miller and colleagues discuss some of the barriers and problems with using or adopting progress monitoring in clinical practice. They describe that even in the most favorable circumstances, it takes about two decades for new treatments to be integrated into routine care. Another issue is that recent surveys indicate that only about 33% of psychologists and 66% of training directors are aware of progress monitoring. Even for those who are aware, a common barrier might be cost and time to implement the procedures. Despite the brevity and low cost of the tools, like the PCOMS, they all place an additional burden on clinicians’ busy schedule. There is also the issue of staff turnover. As staff come and go, organizations may lose those who lead, train, and support the use of progress monitoring. Probably the biggest barrier is skepticism on the part of clinicians who might see the tools as too superficial, or who might be concerned that repeated measurement may somehow negatively affect the therapeutic relationship. However, research indicates that clients generally report positive experiences – they like being a more integral part of the assessment process, and they appreciate the ability to track their own progress. Finally, whereas clinicians may use progress monitoring to improve clinical decision-making, administrators may see it as a means of conducting performance reviews.

Practice Implications

In most health care fields, it can take 20 years for an innovation to make it into routine practice. That might be the case for progress monitoring. More clinicians need to know about it, be trained in its use, and see for themselves that the information is valid, of high quality, and that it can supplement their work in identifying clients who are not doing well. In particular, progress monitoring may be a means of enhancing the therapeutic alliance as it provides therapists and clients a vehicle to discuss how the therapy is going, what needs focus, and what to do if things go awry. Organizations need to treat progress monitoring as a means of helping therapists to improve their skills, and not as a means of auditing performance. Therapists need quality information upon which to make sound clinical decisions, and progress monitoring is one way of receiving this information.

This month...

Type of Research

Topics

January 2019

Practice Implications

November 2018

Practice Implications

October 2018

Practice Implications

Practice Implications

August 2018

Practice Implications

Practice Implications

Psychotherapy Practice Research Network (PPRNet)