Blog
The Psychotherapy Practice Research Network (PPRNet) blog began in 2013 in response to psychotherapy clinicians, researchers, and educators who expressed interest in receiving regular information about current practice-oriented psychotherapy research. It offers a monthly summary of two or three published psychotherapy research articles. Each summary is authored by Dr. Tasca and highlights practice implications of selected articles. Past blogs are available in the archives. This content is only available in English.
This month...

…I blog about psychotherapies for borderline personality disorder, reliability of research on CBT plus ERP for Obsessive-Compulsive Disorder, and hope and expectancy factors.
Type of Research
Topics
- ALL Topics (clear)
- Adherance
- Alliance and Therapeutic Relationship
- Anxiety Disorders
- Attachment
- Attendance, Attrition, and Drop-Out
- Client Factors
- Client Preferences
- Cognitive Therapy (CT) and Cognitive-Behavioural Therapy (CBT)
- Combination Therapy
- Common Factors
- Cost-effectiveness
- Depression and Depressive Symptoms
- Efficacy of Treatments
- Empathy
- Feedback and Progress Monitoring
- Group Psychotherapy
- Illness and Medical Comorbidities
- Interpersonal Psychotherapy (IPT)
- Long-term Outcomes
- Medications/Pharmacotherapy
- Miscellaneous
- Neuroscience and Brain
- Outcomes and Deterioration
- Personality Disorders
- Placebo Effect
- Practice-Based Research and Practice Research Networks
- Psychodynamic Therapy (PDT)
- Resistance and Reactance
- Self-Reflection and Awareness
- Suicide and Crisis Intervention
- Termination
- Therapist Factors
- Training
- Transference and Countertransference
- Trauma and/or PTSD
- Treatment Length and Frequency
July 2023
Therapeutic Relationship Factors that Do Not Work
Norcross, J.C. & Karpiak, C.P. (2023). Relationship factors. In S. D. Miller, D. Chow, S. Malins, and M. A. Hubble (Eds.) The Field Guide to Better Results: Evidence-Based Exercises to Improve Therapeutic Effectiveness. American Psychological Association. https://doi.org/10.1037/0000358-006
In their chapter, Norcross and Karpiak review the meta-analyses on therapeutic relationship factors that have a positive impact on patient outcomes. Aspects like therapist empathy, positive regard, genuineness, and developing and maintaining a therapeutic alliance have solid research support for their importance to patient outcomes. In fact, the research is clear that these relationship factors are more important (i.e., are better predictors of patient outcomes) than the brand of therapy conducted by the therapist. Part of this chapter by Norcross and Karpiak also identifies those therapist and relationship factors that do not work and that may be harmful to patients. One could simply reverse the effective behaviors identified in meta-analyses – so that low therapist empathy, poor therapeutic alliances, therapists who are incongruent in their words and actions, and who disregard alliance ruptures will have patients with worse outcomes. Research also identifies harmful behaviors by therapists. These might include rigidity in following prescriptions of an intervention, therapist overconfidence in their abilities, hostile behaviors, a confrontational style, and cultural arrogance. As an example, the authors discuss widespread policies mandating the use of specific treatment protocols, and training therapists in manualized treatments to the exclusion of relationship factors. Research shows that adherence or competence with treatment manuals is consistently unrelated to patient outcomes. By contrast relationship factors are highly related to patient outcomes. Research also suggests that therapist behaviors that blame patients, are sarcastic, critical, or hostile towards patients can lead to worse outcomes. Therapists whose assumptions about a patient that do not align with the patient’s experience, also tend to have patients who do not improve. Therapists may believe that they should know better, but if their knowledge does not fit the patient’s experience, then therapist and patient are not engaged in a collaborative endeavor. Finally, even if some therapies prescribe “confrontation” as a therapeutic stance, there is dubious evidence that using such an approach is helpful to patients.
Practice Implications
The research points to certain therapist behaviors that should be avoided when working with patients. Among these is rigid adherence to a treatment manual. Such rigid adherence by a therapist does not allow room for professional self-doubt, for aligning one’s approach to patient needs, and it might foster therapist over-confidence and a lack of humility. Each of these stances towards a patient reduces a therapist’s empathy and may put the patient in a position of reluctantly complying, feeling unheard and unappreciated, or dropping out of therapy.
Therapeutic Relationship Factors that Work
Norcross, J.C. & Karpiak, C.P. (2023). Relationship factors. In S. D. Miller, D. Chow, S. Malins, and M. A. Hubble (Eds.) The Field Guide to Better Results: Evidence-Based Exercises to Improve Therapeutic Effectiveness. American Psychological Association. https://doi.org/10.1037/0000358-006
Next to patient factors that affect outcomes in psychotherapy, the therapeutic relationship is the most important predictor or contributor to patient outcomes. The therapeutic relationship is important to in-person therapy and to therapy delivered virtually. There is no scientific doubt of the importance of the therapeutic relationship on patient outcomes. The relationship is managed and cultivated by the therapist’s attitudes and behaviors. And so, it is not surprising that therapists differ in their ability to facilitate the therapeutic relationship. However, it is also possible for therapists to improve their therapeutic relationship skills through training and supervision. The therapeutic relationship is important to all therapeutic orientations. In this part of the chapter, Norcross and Karpiak review the research on relationship factors that work including therapist empathy, positive regard, developing a therapeutic alliance, and repairing alliance ruptures when they occur. Empathy occurs when a patient experiences a therapist who perceives and expresses an accurate understanding of a patient’s feelings, perspectives, and experiences. Empathic responding is one of the strongest predictors of patient outcomes with effect sizes ranging from moderate to large (d = .58), but only when it is rated by the patient. Therapist ratings of their own empathy has a much lower association with patient outcomes. Positive regard is the therapist’s genuine liking and expressed appreciation for the patient as a person. That is, a therapist’s verbal and nonverbal expression that they value, care about, and believe in the patient. The key here is genuineness – that the therapist’s words are consistent with their intentions and feelings. Positive regard expressed in therapy is moderately related to patient outcomes (d = .57). The therapeutic alliance refers to the warm emotional bond between patient and therapist, and their collaborative agreement on the goals of therapy and how they will work towards those goals. More than 300 studies of over 30,000 patients indicate that the alliance is moderately related to patient outcomes (d = .57), and this is a highly reliable finding. Ruptures in the alliance are characterized by patient withdrawal from the therapist or therapy, or by confrontation in which the patient criticizes or is dissatisfied with the therapist or therapy. Therapists’ attempts to repair alliance ruptures is moderately related to positive patient outcomes (d = .62), and this skill is most important for newer therapists and therapists with a CBT orientation.
Practice Implications
A positive therapeutic relationship has a much bigger impact on patient outcomes than the specific type of therapy used by therapists. A therapist who narrowly focuses on the content of what a patient says and rigidly adheres to a treatment manual will reliably have patients who have worse outcomes. Therapists whom patients experience as truly empathic (not just expressing sympathy for a patient), who can genuinely feel and express positive regard for a patient, and who can develop and maintain a therapeutic alliance and repair alliance ruptures reliably will have patients who have better experiences of therapy and better outcomes. These therapist skills and capacities can be learned through deliberate practice, supervision, personal therapy, and by maintaining a stance of flexibility, openness, and humility.
Therapist Factors Related to Patient Outcomes
Nissen-Lie, H.A., Heinonen, E., & Delgadillo, J. (2023). Therapist factors. In S. D. Miller, D. Chow, S. Malins, and M. A. Hubble (Eds.) The Field Guide to Better Results: Evidence-Based Exercises to Improve Therapeutic Effectiveness. American Psychological Association. https://doi.org/10.1037/0000358-005.
The thing about therapists that people in the profession do not like to talk about is that some therapists are more effective than others. Meta-analyses indicate that about 5% of patient outcome variance can be explained by differences between therapists. Although this seems small, it accounts for about one-third of the total difference in outcomes among patients. One study found that patient recovery rates for the most effective therapists were twice that achieved by their least effective counterparts. In another study, 15% more patients recovered when they saw an “average” therapist compared to one of the least effective clinicians. One key problem is that therapists consistently over-estimate their own effectiveness, and consistently under-estimate the percentage of their patients who get worse. This makes it difficult for therapists to correct course when necessary or to engage in targeted professional and personal development. In this chapter, Niessen-Lie and colleagues review the research that identifies key therapist qualities that are related to better patient outcomes. It turns out that demographics of the therapist (sex, gender, ethnicity, age), experience level, profession, and education level are all unrelated to patient outcomes. In fact, there is some evidence that more experienced older therapists have slightly poorer outcomes than their younger counterparts. However, some therapist factors are important and known to be related to patient outcomes. For example, therapists who are consistently effective across different types of patients, patient severity, and diagnoses have the best outcomes. Another key therapist factor or attribute is interpersonal skill. This includes therapist empathy, warmth, the capacity to express emotions verbally, the ability to develop a therapeutic alliance with a variety of patients, and the capacity to tolerate and manage strong negative emotions in therapy. A third therapist factor is flexibility. Therapists who can be flexible in using therapeutic techniques within a given treatment tend to have patients with better outcomes. Finally, therapists who can maintain an attitude of humility tend to have better outcomes. Humility refers to an openness to other’s points of view, accepting that there is room for growth, and for pushing beyond one’s current skill level while taking care of oneself. Without this attitude, there is little motivation for continued learning, personal growth, and professional development.
Practice Implications
A therapist’s experience level, profession, experience, and other demographics have no bearing on their patients’ outcomes. However, we do know that being effective with a range of patients, interpersonal skills (empathy, verbal expression of emotions, and ability to tolerate strong emotions), flexibility in applying therapeutic interventions, and professional humility are related to patient outcomes. These therapist skills can be developed and improved during one’s career. Improving these skills require a therapist to be willing to examining when things do not go well in therapy (reviewing when patient outcomes are poor or a patient drops out), to reflect on one’s abilities, and to look for disconfirming evidence by asking “could I be wrong?” First, however, therapists must identify when therapy with a patient was ineffective. And for this, they may need the help of standardized assessments to monitor the state of the therapeutic relationship and patient progress.
May 2023
Multiple Microaggressions and Therapy Outcomes
DeBlaere, C., Zelaya, D. G., Dean, J.-A. B., Chadwick, C. N., Davis, D. E., Hook, J. N., & Owen, J. (2023). Multiple microaggressions and therapy outcomes: The indirect effects of cultural humility and working alliance with Black, Indigenous, women of color clients. Professional Psychology: Research and Practice, 54(2), 115–124. https://doi.org/10.1037/pro0000497
Many Black, Indigenous, Women of Color (BIWOC) underutilize mental health care partly because of lack of culturally competent care, and the anticipation of bias and discrimination often experienced by Black, Indigenous, People of Color (BIPOC). One way that such bias and discrimination is expressed in a therapy context is through racial microaggressions which are subtle, intentional, or unintentional messages that degrade BIPOC. Another way that bias and discrimination is expressed is through gender microaggressions which are intentional or unintentional behaviors that exclude, demean, oppress, or express indifference towards women. Research indicates that up to 89% of BIPOC clients and 53% of women experienced a microaggression from their therapist. Both racial and gender microaggressions committed by therapists are related to poorer therapeutic alliance and client outcomes. One might also consider BIWOC clients to be doubly susceptible to microaggressions due the intersecting nature of their identities as a person of color and as a woman. One way to limit the effects of microaggressions is for therapists to take a stance of cultural humility and to foster a therapeutic alliance. Cultural humility refers to a therapist’s way of being with a client that values the importance of culture in the client’s experience. In this study by DeBlaere and colleagues, the authors surveyed 288 BIWOC clients who were currently or recently in psychotherapy to assess the association between microaggressions and outcomes, and whether cultural humility and a therapeutic alliance might reduce the impact of microaggressions. The clients saw a female therapist 81% of the time and a White therapist 46% of the time. DeBlaere and colleagues found that 89% of the sample reported at least one instance of a racial microaggression by their therapist, and 43% reported some form of gender microaggression. White and male therapists were more likely to commit these microaggressions. The most common racial microaggression involved therapists avoiding discussing or addressing cultural issues, and the most common gender microaggression involved therapists encouraging female clients to be less assertive so that the client might not appear aggressive. Racial and gender microaggressions were both negatively related to therapy outcomes. The authors also found that cultural humility and therapeutic alliance both mediated and helped to explain the effects of microaggressions on outcomes. That is, the negative effects of a racial or gender microaggression on outcomes were reduced when the client experienced the therapist as having a higher level of cultural humility, which then led to a stronger therapeutic alliance, that in turn led to a better outcome.
Practice Implications
This study points to the potential of therapist cultural humility and their capacity to maintain a therapeutic alliance as key to reducing the impact of racial and gender microaggressions on client outcomes. The findings reinforce the importance of therapists examining their own cultural biases and making discussions of culture and racism explicit in therapy. This is especially important for White male therapists. Such a process might cultivate cultural humility in the therapist that will mitigate the negative impact of a microaggression should it occur.
Interpretations and Outcomes: A Systematic Review
Zilcha-Mano, S., Fisher, H., Dolev-Amit, T., Keefe, J. R., & Barber, J. P. (2023). A systematic review of the association between interpretations and immediate, intermediate, and distal outcomes. Psychotherapy. Advance online publication. https://doi.org/10.1037/pst0000479
Interpretation is a therapeutic technique that refers to a psychotherapist who recognizes and seeks to raise the patient’s awareness and understanding of recurrent maladaptive patterns. An interpretation goes beyond what the patient says or recognizes consciously and gives a new meaning or explanation for behaviours, thoughts, or feelings so that the patient sees their problems in a new way. In other words, the effect of an interpretation is to raise a patient’s insight into their problems. Interpretation is a transtheoretical technique, although it is often associated with psychodynamic therapies. Some interpretations are interpersonal in nature (focused on maladaptive relationship patterns inside and outside of the therapeutic relationship), and some are intrapersonal in nature (e.g., focused on the conflict between ones wishes/desires and how one ideally sees oneself). In this systematic review of the research on interpretation, Zilcha-Mano and colleagues included 18 studies that tested the association between interpretation and outcomes. Previous reviews found a mixed association between interpretation and outcomes possibly because of the different methods of assessing interpretation and different way of conceptualizing outcomes. What is unique about this review is that it categorized outcomes as immediate (e.g., in-session alliance, disclosure, emotional expression), intermediate (e.g., next-session alliance strength, session depth), and distal (e.g., change in symptoms from pre- to post-treatment). Since there were so few studies in each of these outcome categories (6 studies of immediate, 4 studies of intermediate, and 12 studies of distal outcomes), the authors did not conduct a meta-analysis, but rather counted studies that supported or did not support the use of interpretation for each of these categories of outcomes. For immediate outcomes, half of the studies reported a positive association with interpretation (whereas half of studies showed a neutral or negative association). That is, on average patients in those studies tended to react positively to therapist interpretations during the session with increased therapeutic alliance or emotional processing. For intermediate outcomes, half the studies reported a positive association with interpretation (as opposed to neutral or negative association). That is, on average the results suggested that interpretation in in a previous session was associated with patients experiencing a better alliance and session depth in the subsequent session. For distal outcomes, there was mixed evidence with most studies reporting a neutral effect of interpretation on pre- to post-symptom change.
Practice Implications
It is challenging to draw explicit practice implications from a research area that is complex and not yet large enough to allow for a meta-analysis. However, using a mixture of these research findings and clinical experience, Zilcha-Mano and colleagues suggest some therapeutic practices that may be helpful. They suggest, for example that therapists (1) observe the immediate and intermediate outcomes of an interpretation (i.e., does the patient rejected it or does it deepen the therapeutic work?), (2) check with patients about how they feel about the interpretation, (3) prioritize accurate and experience-near interpretation (those that the patient can immediately recognize and understand), (4) monitor the strength of the alliance before, during, and after an interpretation, (5) consider that an interpretation may be more beneficial for patients with poorer quality of relationships and self-concepts than for those with better relationship and self-functioning, and (6) be aware that interpretations may not be beneficial and could be harmful if delivered at the wrong time or if not attuned to the patient’s needs and capacities
May 2022
Do Psychotherapists Get Better with Experience and Training?
Wampold, B. & Owen, J. (2021). Therapist effects: History, methods, magnitude, and characteristics of effective therapists. In Barkham, W. Lutz, and L.G. Castonguay (Eds.) Bergin and Garfield’s Handbook of Psychotherapy and Behavior Change (7th ed.). Wiley. Chapter 9.
One of the defining characteristics of expertise is the overall improvement in skills and performance over the course of one’s career. We can identify, for example, that there are experts in chess, tennis, surgery, and musical performance based on performance. Expertise in these areas is explicitly developed partly because there is clear and immediate feedback regarding performance (i.e., a tennis player knows immediately that they missed a serve, and so they make an adjustment on the next serve). In psychotherapy, this is not so easy. Therapists rarely receive immediate feedback about their specific interventions or interpersonal responsiveness to a patient. In this part of the chapter, Wampold and Owen review the research on the relationship between therapist experience and training and patient outcomes. They focus on high quality studies that disentangled therapist from patient effects. Overall, the evidence does not support the notion that the more experience that a therapist accumulates the better their patients’ outcomes. In fact, one study that tracked therapists over time (up to 18 years) found that patients’ outcomes got slightly worse with more experience. Similar findings occur for training of student therapists. For the most part, more training that student therapists received over a 12-to-42-month period was not associated with better patient outcomes. There is some evidence that trainees can improve their capacity to develop a therapeutic alliance, and that with more deliberate practice (focused, immediate attention and feedback on specific skills) therapists can realize better outcomes with their patients.
Practice Implications
As a senior therapist who is very involved in training, I find these results discouraging. Nevertheless, the solutions offered by the research do provide a ray of hope. Providing therapists with specific and immediate feedback about patient outcomes and therapeutic processes (e.g., ratings of patient distress and of the alliance after every session), has the potential for helping therapists to inform their practice, make adjustments, and develop expertise. Deliberate practice of specific skills in psychotherapy (e.g., ways of addressing an alliance rupture or of responding to intense emotion) may also improve therapist expertise and patient outcomes. It is also quite possible that the focus on learning specific manualized protocols, which is often the goal of graduate and post-graduate training, may not be the most effective training and professional development.