Blog
The Psychotherapy Practice Research Network (PPRNet) blog began in 2013 in response to psychotherapy clinicians, researchers, and educators who expressed interest in receiving regular information about current practice-oriented psychotherapy research. It offers a monthly summary of two or three published psychotherapy research articles. Each summary is authored by Dr. Tasca and highlights practice implications of selected articles. Past blogs are available in the archives. This content is only available in English.
This month...

…I blog about therapist variables leading to poor outcomes, aspects of the therapeutic relationship and outcomes, and psychological therapies and patient quality of life.
Type of Research
Topics
- ALL Topics (clear)
- Adherance
- Alliance and Therapeutic Relationship
- Anxiety Disorders
- Attachment
- Attendance, Attrition, and Drop-Out
- Client Factors
- Client Preferences
- Cognitive Therapy (CT) and Cognitive-Behavioural Therapy (CBT)
- Combination Therapy
- Common Factors
- Cost-effectiveness
- Depression and Depressive Symptoms
- Efficacy of Treatments
- Empathy
- Feedback and Progress Monitoring
- Group Psychotherapy
- Illness and Medical Comorbidities
- Interpersonal Psychotherapy (IPT)
- Long-term Outcomes
- Medications/Pharmacotherapy
- Miscellaneous
- Neuroscience and Brain
- Outcomes and Deterioration
- Personality Disorders
- Placebo Effect
- Practice-Based Research and Practice Research Networks
- Psychodynamic Therapy (PDT)
- Resistance and Reactance
- Self-Reflection and Awareness
- Suicide and Crisis Intervention
- Termination
- Therapist Factors
- Training
- Transference and Countertransference
- Trauma and/or PTSD
- Treatment Length and Frequency
September 2014
Psychotherapeutic Interventions to Promote Forgiveness
Wade, N.G., Hoyt, W.T., Kidwell, J.E., & Worthington, E.L. (2014). Efficacy of psychotherapeutic interventions to promote forgiveness: A meta-analysis. Journal of Consulting and Clinical Psychology, 82, 154-170.
Forgiveness can include reducing vengeful and angry thoughts and feelings, and may be accompanied by positive thoughts, feelings and motives towards the offending person. This does not necessarily include reconciliation with the offending person, nor does it require forgetting, condoning, or excusing the wrongdoing. Promoting forgiveness in psychotherapy includes helping clients move toward more positive and optimal functioning. There are two prominent empirically based models of forgiveness interventions. Enright’s model contains four phases: (1) uncovering negative thoughts about the offense, (2) decision to pursue forgiveness, (3) work toward understanding the offending person, and (4) discovery of unanticipated positive outcomes and empathy for the offending person. Worthington’s model has five steps: (1) recalling the hurt and emotions, (2) empathising with the offender, (3) altruistic view of forgiveness, (4) commitment to forgiveness, and (5) holding on to or maintaining forgiveness. Wade and colleagues conducted a meta analysis: to compare forgiveness outcomes and mental health outcomes of forgiveness interventions in general; to compare of forgiveness interventions to each other; and to compare forgiveness interventions to non-forgiveness psychotherapies or to control conditions. The meta analysis included 53 studies of 2,323 participants. Participants receiving forgiveness interventions reported significantly greater forgiveness compared to those not receiving treatment and compared to those who received alternative treatments that were not specific to forgiveness. Forgiveness interventions also resulted in greater positive changes in depression, anxiety, and hope compared to no-treatment conditions. There were no differences between Enright’s and Worthington’s approaches when duration of treatment and modality (individual vs group) were controlled. However, as an individual treatment, Enright’s model showed better outcomes. Longer duration of treatment was associated with greater forgiveness, and greater severity of the offense was also associated with greater forgiveness.
Practice Implications
Theoretically grounded forgiveness interventions may be the best choice to help a client to achieve resolution in the form of forgiveness. Other non-forgiveness therapeutic approaches may help but may not have as great an impact on forgiveness as those interventions that are specifically designed to improve forgiveness. Enright’s model delivered as an individual treatment was more effective than Worthington’s approach which is designed mostly as a group intervention. In addition to improving forgiveness, both approaches also had significant positive impact on depression, anxiety, and hope. The forgiveness interventions worked better if provided for longer duration and in the context of more severe offenses.
August 2014
Are Therapists or Clients Most Responsible for the Therapeutic Alliance-Outcome Relationship?
Del Re, A.C., Fluckiger, C., Horvath, A.O., Symonds, D., & Wampold, B.E. (2012). Therapist effects in the therapeutic alliance-outcome relationship: A restricted-maximum likelihood meta-analysis. Clinical Psychology Review, 32, 642-649.
The therapeutic alliance, defined as the agreement on tasks and goals and the bond between therapist and patient, is one of the most researched concepts in psychotherapy. A meta-analysis of over 200 studies showed that the association between the therapeutic alliance and patient outcomes is moderate but robust (i.e., consistent across studies, patient types, and therapy types). Some have stated that the importance of the therapeutic alliance as reported in studies is an under-estimate of its real impact on patient outcomes. Del Re and colleagues argue that the main reason for this underestimation is that while the therapist’s effect on the alliance-outcome relationship might be large, the client’s effect might be quite small, and so the average of these two effects (which is what most studies report) will be diminished. Del Re and colleagues conducted the first meta analysis to assess the relative size of therapist versus client effects across many studies. Their strategy was clever. They looked at the ratio of the number of patients to therapists (PTR) within a study as a “predictor” of the alliance-outcome relationship across studies. This allowed them to examine the relative contribution of therapists and clients to the alliance-outcome relationship. Two extreme examples illustrate this ratio. (1) In one study, many patients might have been seen by only one therapist, in which case the alliance-outcome correlation could only be attributed to differences between clients since there was only one therapist. (2) In another study, each client might have been seen by a different therapist (i.e., there were as many therapists as clients), in which case the alliance-outcome correlation could only be attributed to differences between the therapists; that is, there are no differences between clients seen by the same therapist as this did not occur. The patient to therapist ratio (PTR) captures the variability between these two extreme examples across studies. Del Re and colleagues included 69 studies that provided enough information about the number of patients and therapists. The overall correlation between alliance and outcome was moderate, r = .27, which was very similar to what was found in a previous large meta-analysis. PTR was significantly associated with the alliance-outcome relationship even after controlling for a number of possible confounding variables. Patients accounted for almost 0% of the alliance-outcome relationship, whereas the effect of therapists was substantially larger, r = .40, accounting for 16% of the alliance-outcome association.
Practice Implications
Therapists’ capacity to develop an alliance with their patients is associated with outcomes. We also know that some therapists demonstrate better patient outcomes than others. So, therapists who consistently are better at forming alliances with patients likely have patients with better treatment outcomes. The quality of the alliance between patients and therapists appears to be the result of what therapists do or bring to the therapy. And so, on average, the therapist’s role in the alliance is most important for achieving good patient outcomes. Del Re and colleagues note that they were not able to look at the interaction between therapist and patient factors. For example, it may be possible that some therapists might form better alliances some types of patients, but not others. Integrating feedback systems so therapists can monitor the therapeutic alliance and patient outcomes may help therapists identify areas in which they need more training or supervision.
July 2014
Is There Such a Thing as Expertise in Psychotherapy?
Tracey, T.J.G., Wampold, B.E., Lichtenberg, J.W., & Goodyear, R.K. (2014). Expertise in psychotherapy: An elusive goal? American Psychologist, 69, 218-229.
As I have reported many times in this blog, there is substantial evidence for the efficacy of psychotherapy. However, the quality of psychotherapy differs across therapists – that is, some therapists achieve better client outcomes than others. Tracey and colleagues (2014) ask: is it possible to demonstrate expertise in psychotherapy? They define expertise as “increased quality of performance that is gained with additional experience”. Professions that can demonstrate expertise include: astronomers, test pilots, chess masters, mathematicians, and accountants. But several professions may not demonstrate expertise, including: psychiatrists, college admissions officers, court judges, personnel selectors, and psychotherapists. The difference is that the former group has predictable outcomes and has access to quality feedback. In addition, Tracey and colleagues argue that psychotherapy lacks adequate models for how interventions produce benefits. As a result, adherence to treatment protocols (i.e., manuals) is not reliably associated with better patient outcomes. Further, more experienced therapists are not more effective than less experienced therapists. Experienced therapists might have more complete conceptualizations of client problems, but these conceptualizations may not be accurate. Finally, although therapists affect outcomes, client variables (e.g., motivation, severity of symptoms, expectations) likely explain the largest proportion of outcome variance. Tracey and colleagues argue that part of the problem is that psychotherapists do not engage in “deliberate practice”; that is, practice of a specific task (e.g., identifying a rupture in the alliance), receiving specific feedback (e.g., that a rupture was not identified), opportunity for repetition (e.g., to identify a subsequent rupture in the alliance), and opportunity for improvement afforded by error (e.g., better able to identify a future rupture and repairing that rupture). Generally the practice of psychotherapy provides little feedback about the accuracy of past clinical decisions. In other words there is a lack of quality information to help therapists develop into experts. Further, for a whole host of reasons, psychotherapists are notoriously poor at assessing client progress (i.e., like other humans, therapists engage in a number of biased evaluations of their performance). Quality information might be available from progress monitoring (i.e., continuous feedback to therapists about client outcomes), which has been shown to improve client outcomes. However, this may not aid therapists in developing expertise, since progress monitoring provides little information about what therapist behaviors are necessary to improve performance and client outcomes.
Practice Implications
Tracey and colleagues conclude that currently psychotherapy does not provide evidence that it is a profession with expertise. To achieve expertise, therapists need quality information not only about their patients’ outcomes but also about their own average outcomes (i.e. performance) relative to other therapists working with similar clients. And therapists need information on how to manage specific events in psychotherapy. Tracey and colleagues suggest therapists set aside time to generate hypotheses about one’s practice that can be disconfirmed, and then test these hypotheses. For example, if a therapist is experiencing a higher than average number of premature client terminations (which may follow a misunderstanding with the client), the therapist may hypothesize that he or she is not identifying key alliance ruptures. To test this hypothesis, the therapist could repeatedly assess the alliance (with a validated instrument) with some clients, use this information and not clinical judgement alone to identify alliance ruptures (i.e., a week to week severe downward trend in alliance scores), and implement an intervention to repair the alliance with these clients. Do clients with whom a therapist has implemented this procedure drop out at a lower rate? Does this process of deliberately identifying alliance ruptures and repairing them lead to enhanced therapist performance regarding alliance ruptures? This form of deliberate practice (testing disconfirmable hypotheses based on quality information) might lead to greater expertise in identifying alliance ruptures.
May 2014
Patients with High Levels of Resistance Respond Better to Less Directive Psychotherapy.
Beutler, L.E., Harwood, T.M., Michelson, A., Song, X., & Holman, J. (2011). Resistance/Reactance level. Journal of Clinical Psychology, 67, 133-142.
Patient resistance to psychotherapy is a persistent and perplexing problem. Resistance can be defined as patient behavior that is directly or indirectly contrary to therapist recommendations or to the health of the patient. However, the label “resistance” implies that the problem lies entirely within the patient, i.e., that the patient is the problem. Beutler and colleagues (2011) argue that it is more accurate to define the problem as “reactance”, which refers to the relational or co-constructed nature of psychotherapy. The notion of reactance (instead of resistance) suggests that the therapist also plays a role in the resistance, since the therapist is also responsible to create a context within which highly ambivalent clients do or do not thrive. Failure to thrive could be viewed as a poor fit between patient and therapy. Using social psychological theory, Beutler and colleagues conceptualized reactance as a state of mind aroused in the patients when he or she perceives their freedom to be limited by the therapy. A therapist may elicit resistant behavior from a patient by assuming more control of the patient’s behavior within and outside of the therapy sessions than is tolerable, by using confrontational techniques, and by creating and failing to repair alliance ruptures. Beutler and colleagues argued that therapist directiveness was a key factor in determining reactance in the therapy. Therapist directiveness refers to the extent to which a therapist dictates the pace and direction of therapy. Beutler and colleagues conducted a meta analysis to assess if therapist directiveness was associated with poorer outcome in patients who were more resistant in therapy. The meta analysis included 12 studies with 1,103 patients. They found that higher patient resistance was related to poorer outcomes, and the effect was moderate. The interaction between therapist directiveness and patient level of resistance directly affected outcomes, and this effect was significant and large. That is, greater therapist directiveness with patients who were more resistant resulted in poorer outcomes. Conversely, patients who were low in resistance responded well to more directive therapy.
Practice Implications
Therapists should view some manifestations of client resistance as a signal that they are using ineffective methods. A therapist’s response to resistant states in a patient requires: acknowledgement and reflection of the patient’s concerns; discussion of the therapeutic relationship; and renegotiation of the therapeutic contract regarding goals and therapeutic roles. These therapist responses are designed to provide the patient with a greater sense of control over the process. High reactance indicates that a treatment should: de-emphasize therapist authority and guidance, employ tasks that are designed to provide the patient with control and self-direction, and de-emphasize the use of rigid homework assignments. As Beutler and colleagues indicate, resistance is best characterized as a problem of the therapy relationship (not of the patient) and as such, becomes a problem for the therapist and patient to solve. The skilled therapist can find a way to stimulate change and reduce a patient’s fear of losing control or freedom.
January 2014
Is Therapeutic Alliance Really That Important?
Handbook of Psychotherapy and Behavior Change: Starting in March 2013 I will review one chapter a month from the Handbook of Psychotherapy and Behavior Change in addition to reviewing psychotherapy research articles. Book chapters have more restrictive copy right rules than journal articles, so I will not provide author email addresses for these chapters. If you are interested, the Handbook table of content and sections of the book can be read on Google Books.
Crits-Christoph, P., Connolly Gibbons, M.B., & Mukherjee, D. (2013). Psychotherapy process-outcome research. In M.E. Lambert (Ed.), Bergin and Garfield’s Handbook of Psychotherapy and Behavior Change, 6th Edition (pp. 298-340). New York: Wiley.
In their chapter in the Handbook, Crits-Christoph and colleagues (2013) review research in which psychotherapy processes are related to patient outcomes. I reported in the July 2013 PPRNet Blog that therapeutic alliance is reliably correlated with treatment outcomes in a variety of disorders and treatment types. Alliance refers to an agreement on tasks and goals of therapy, and the bond between therapist and client. The common assumption is that alliance is a necessary condition that in part causes change in client symptoms. However therapeutic alliance studies tend to be correlational, that is, the studies show a relationship but the study designs do not allow one to say that alliance causes good outcomes. What if the opposite were true; what if early experiences of symptom reduction caused the therapeutic alliance to improve? If that were the case, then alliance would be an artificial and not particularly important aspect of psychotherapy. Crits-Christoph and colleagues (2013) review the literature on this topic. Some studies of cognitive behavioural therapy (CBT), for example, found that prior change in symptoms predicted later therapeutic alliance, but prior alliance did not predict later symptom change. In a more sophisticated study, Crits-Christoph and colleagues (2011) found that previous change in the alliance was related to later change in outcomes, but not vice versa. In the same study, the authors noted that measuring patient alliance at a single early session accounted for only 4.7% of the outcome variance at post treatment, whereas averaging assessments of alliance across 6 early sessions accounted for almost 15% of the outcome variance. In other words, averaging assessments across many sessions produced a more dependable measurement of alliance. Several studies now report a reciprocal relationship between alliance and outcome, indicating that change in alliance and change in outcomes across therapy sessions progress in a mutually reinforcing spiral. That is, early change in alliance causes subsequent change in outcome, which in turn results in further change in alliance, which precipitates more change in symptoms, etc. The review by Crits-Christoph and colleagues (2013) also noted that the importance of alliance seems to be greater for patients with a disorder like depression, compared to anxiety disorders.
Practice Implications
Developing an early alliance with a client is related to treatment outcomes. Measuring alliance repeatedly (not just once) will give the best indicator of the state of the therapeutic relationship. Patients and therapists who have a genuine liking for each other, who agree on how therapy will be conducted and on the goals of therapy will improve the chances that psychotherapy will be successful. Alliance and symptom change may work together throughout therapy so that improvement in one will cause change in the other on an ongoing basis across therapy sessions. Alliance may be particularly important for patients with depressive disorders that are characterized by isolation from others, loneliness, and low self esteem.
December 2013
How Much Do Psychotherapists Differ in Their Outcomes and Why Does this Matter?
Handbook of Psychotherapy and Behavior Change: Starting in March 2013 I will review one chapter a month from the Handbook of Psychotherapy and Behavior Change in addition to reviewing psychotherapy research articles. Book chapters have more restrictive copy right rules than journal articles, so I will not provide author email addresses for these chapters. If you are interested, the Handbook table of content and sections of the book can be read on Google Books.
Baldwin, S. & Imel, Z.E. (2013). Therapist effects. In M.E. Lambert (Ed.), Bergin and Garfield’s Handbook of Psychotherapy and Behavior Change, 6th Edition (pp. 258-297). New York: Wiley.
Does it matter that some therapists are more effective than others? Can less effective therapists be trained to improve their outcomes and relationship quality with patients? These are important questions not only for our patients’ well-being but also for the long term survival of psychotherapy as a health enterprise. If we do not measure outcomes and help therapists who are less effective, stakeholders (i.e., clients, families, agencies, insurance companies) may stop paying for the services. In the September 2013 blog I discussed a large study that showed that a few therapists were reliably harmful and some therapists were reliably helpful to their patients. That study also reported that most therapists were effective in 5 of 12 problem domains for which their patients sought help. What these findings and the Handbook chapter by Baldwin and Imel (2013) show is that there are significant between-therapist effects (i.e., therapists differed from each other on patient outcomes) and within-therapist effects (i.e., therapist outcomes within their own caseload differed based on the patients’ problems). Baldwin and Imel (2013) reported on their meta analysis in which between-therapist differences accounted for 5% of the outcome variance. That seems small, but it’s not. One study, for example, estimated that for each 100 patients that would be treated, the worst therapist compared to the best therapist would have 6 more patients who deteriorated. I would prefer my loved ones to be seen by the best therapist, even if the difference between best and worst is only 5%. Nevertheless, 95% of the variance in outcomes is within the therapist’s caseload. That is, the patient, other contextual variables, and the therapist-patient relationship are by far the biggest contributors to outcome. As Baldwin and Imel point out, not only are some therapists are more effective for some patients and not others, but also some therapists are better at developing a therapeutic relationship with some patients than with others. Baldwin and Imel reported that, on average, 9% of the variance in the quality of the therapeutic alliance is associated with the therapist – that’s a clinically meaningful effect.
Practice Implications
As Baldwin and Imel (2013) state, ignoring therapist accountability is detrimental to patients and to the mental health field in general. If stakeholders do not see evidence of positive outcomes, then they will withdraw funding, and patients will have even less access to services. Therapists differ in their outcomes, and outcomes also differ within each therapist’s caseload. If a primary goal is to improve therapist performance and patient outcomes, then therapists need to measure outcomes and therapeutic relationship quality. This knowledge about performance with specific patients can help therapists seek continuing education and training to improve outcomes and therapeutic alliances with specific patients for whom the therapist is less effective. This may require continuous outcome monitoring and real-time feedback to therapists regarding their patients’ outcomes (see my September 2013 blog in identifying clients who might deteriorate).