Blog

The Psychotherapy Practice Research Network (PPRNet) blog began in 2013 in response to psychotherapy clinicians, researchers, and educators who expressed interest in receiving regular information about current practice-oriented psychotherapy research. It offers a monthly summary of two or three published psychotherapy research articles. Each summary is authored by Dr. Tasca and highlights practice implications of selected articles. Past blogs are available in the archives. This content is only available in English.

June 2016

Is Therapist Effectiveness a Stable Characteristic?

Kraus, D. R., Bentley, J. H., Alexander, P. C., Boswell, J. F., Constantino, M. J., Baxter, E. E., & Castonguay, L. G. (2016). Predicting therapist effectiveness from their own practice-based evidence. Journal of Consulting and Clinical Psychology, 84(6), 473-483.

There is lots of evidence that there are differences between therapists in their patients’ outcomes. Some studies estimate that 5% to 7% of patient outcomes can be attributed to differences between therapists’ abilities and style of delivering treatment. But most of these studies measured outcomes only once, and so they could not estimate if therapist effects are stable across time. Further, many of these studies used only a global measure of patient distress as an outcome and did not measure domain-specific outcomes (e.g., depression, anxiety, mania, alcohol dependence, etc.). In this study by Krauss and colleagues, 59 therapists who treated 3,540 patients were included. Therapists had on average 10 years of experience and were from a variety of professions (psychologists, psychiatrists, social workers, counsellors etc.). The settings included mental health clinics, independent practice, hospitals, and others. The authors went to some effort to control for case-mix variables such as client problem difficulty, length of treatment, caseload size, and other variables. Client outcomes were measured for 12 different domains ranging from depression to sexual dysfunction to substance abuse. First, outcomes were assessed for 30 patients of each therapist, and then these were compared to outcomes of the same therapist’s next 30 patients. Therapists were classified as “exceptional”, “average”, or “below average” based on their patients’ outcomes. Fifty-seven percent of therapists who were rated as exceptional with the first 30 patients were likely to remain exceptional or above average with the next 30 patients. In other words, effective therapists tended to remain effective over time. Therapists had better patient outcomes when it came to depression, suicidality, and substance abuse, but therapists tended not to have as good outcomes when it came to mania, and sexual functioning.

Practice Implications

Effective therapists tend to remain effective over time for particular client problem areas. However, therapists are seldom effective for more than 4 or 5 client presenting problems, and less than 10 % of therapists are effective with all client problem areas. Therefore patients with differing problems are likely to achieve better or worse outcomes depending on the particular therapist and his or her strengths. Therapists can regularly assess patient outcomes and use that information to help with continuing education to improve their practice for a particular problem area.
Are Therapists Uniformly Effective Across Patient Outcomes?

Nissen-Lie, H. A., Goldberg, S. B., Hoyt, W. T., Falkenström, F., Holmqvist, R., Nielsen, S. L., & Wampold, B. E. (2016). Are therapists uniformly effective across patient outcome domains? A study of therapist effectiveness in two different treatment contexts. Journal of Counseling Psychology. Advance online publication.

What characterizes more or less effective therapists? Are some therapists more effective for certain types of client mental health problems? In this study by Nissen-Lie and colleagues the authors look at whether therapists are skilled across patient problem domains. They conducted two studies with over 6000 patients and almost 200 therapists. Patients were assessed with common outcome measures of mental health domains that included: social functioning, work functioning, relationship functioning and symptom distress. Therapists included psychologists and social work professionals (70%) and trainees (30%) who saw at least 10 patients each. Theoretical orientations ranged from CBT, psychodynamic, and supportive psychotherapy. Patients were symptomatic at the start of therapy and primarily had problems with anxiety and depression. Patient symptoms on average improved so that psychotherapy had a moderate to large effect. Therapists did not differ in caseload mix regarding client severity. The authors reported that the client mental health domains (i.e., symptom severity, work functioning, social functioning, and interpersonal functioning) were relatively distinct or unrelated areas (i.e., the domains were largely uncorrelated). The authors then calculated change scores for each client domain area and used these change scores in a multilevel factor analysis. They wanted to see if a therapist’s clients achieved greater change in one client domain versus in another client domain. The results showed that if clients of a therapist changed in one domain (e.g., depression) then that outcome was highly related to change in another domain (e.g., interpersonal functioning). In other words, if a therapist was effective (or ineffective) in reducing client symptoms, then that therapist was also likely effective (or ineffective) in reducing, work, social, and relationship problems.

Practice Implications

The results support the notion of therapist uniformity in terms of client outcome domains. In other words effective therapists tend to be effective with many types of client problems (but perhaps not all client problems – see my blog this month of the Kraus et al. (2016) study). The authors argue that effective therapists have three key qualities: flexibility in adapting treatments to clients, sensitivity to differences between clients, and responsiveness to clients’ reactions to therapeutic interventions. That is, effective therapists are willing and able to self correct when required.

April 2016

Patient Experience of Negative Effects of Psychotherapy

Crawford, M.J., Thana, L., Farquharson, L., Palmer, L., Hancock, E.... Parry, G.D. (2016). Patient experience of negative effects of psychological treatment: results of a national survey. British Journal of Psychiatry, 208, 260-265.

There is lots of evidence that psychotherapy is effective for a wide variety of disorders. However, a number of studies report that between 5% and 10% of patients report higher levels of symptoms following treatment compared to when they started. Although the side effects and negative outcomes in pharmacological treatment studies are routinely reported, negative outcomes in psychological treatment studies are rarely reported and investigated. In this very large survey, Crawford and colleagues analysed data from an audit of state funded psychological therapies for depression and anxiety in England and Wales. Adult patients from 220 centers were invited to complete an anonymous service-user questionnaire that asked about their experiences of the processes and outcomes of psychotherapy. Some of the questions asked if clients experienced a “lasting bad effect” from the treatment. Nearly 15,000 individuals responded to the survey. More than half (51%) were treated with cognitive behavioral therapy, and most clients received only one treatment, which was predominantly individual therapy. Most (74.35%) received fewer than 10 sessions. Of the respondents, 763 (5.23%) reported that therapy had a “lasting bad effect”, and an additional 7.70% were “unsure” whether they experienced a lasting bad effect. People over 65 years old were less likely to have a lasting negative effect, and those from minority ethnic groups and non-heterosexuals were more likely to report lasting bad effects. In addition, those who did not know what type of therapy they received were more likely to have lasting bad effects.

Practice Implications

A substantial minority of patients reported lasting negative effects from their psychological treatment. With approximately a million Canadians receiving outpatient psychological treatment of one form or another each year, these findings imply that thousands of patients could have experienced a lasting negative effect. The findings suggest that psychotherapists need to be highly sensitive to cultural and ethnic minority issues and acquire cultural competence. The same is true when treating non-heterosexuals. Clinicians should also make sure to provide sufficient information to patients about the type of treatment they are receiving as part of the informed consent process. Attending to these issues may reduce the likelihood of therapeutic alliance ruptures that may be related to lasting negative effects.
Nonimproved Patients View Their Psychotherapy

Werbart, A., Von Below, C., Brun, J., & Gunnarsdottir, H. (2015). “Spinning one’s wheels”: Nonimproved patients view their psychotherapy. Psychotherapy Research, 25, 546-564.

The rate of patients who experience no change after receiving psychotherapy is about 35% to 40% in clinical trials. Further, about 5% to 10% get worse after treatment. So, in spite of the fact that psychotherapy is effective in general, a sizeable minority of patients do not benefit. There is also evidence that patients’ perception of therapy differs greatly from their therapists’. Therapists are often inaccurate in identifying or predicting patient outcomes, and patients’ judgements tend to better correspond with treatment outcomes. In this study, Werbart and colleagues evaluated outcomes of 134 patients who had elevated symptoms. The average age of patients was 22.4 years (range 18 – 26), so many were young adults. Almost all received a diagnosis ranging from depressive disorders, anxiety disorders, or personality disorders. The predominant treatment was psychoanalytic. Of the 134 patients, many experienced large improvements by the end of treatment. However, 20 patients remained clinically distressed and did not improve or deteriorated after receiving psychotherapy. The authors interviewed these 20 patients at termination and at three-year follow-up using a semi-structured interview. The interview asked patients for their experiences of therapy. The researchers transcribed the interviews and coded the transcripts using a known method of qualitative analysis called “grounded theory”. Three main themes related to poor outcomes were identified by these patients. (1) The therapy or therapist – in which: therapists were perceived by patients as passive or reticent, patients felt distant from the therapist, and patients did not understand the therapy method. (2) Outcomes of therapy – in which: the patient expected more from therapy, and symptoms and emotional problems remained in the “impaired” range at the end of treatment. (3) The impact of life circumstances – referring to negative impacts of events outside of the therapy.

Practice Implications

This is a small but unique study that interviewed patients who did not benefit from psychotherapy about their experiences of the treatment and therapist. Nonimproved patients described their therapist generally as too passive, distant, and uninvolved in the work of therapy. These patients described difficulty understanding the therapeutic method and the nature of the therapeutic relationship. The findings highlight the importance of the therapeutic alliance. To have a good alliance, patients and therapists have to agree on the tasks of therapy, agree on the goals that the therapy should achieve for the patient, and there should be a mutual liking or bond between patient and therapist. Those patients whose therapists pay attention to and foster a good alliance are more likely to experience good outcomes.

February 2016

Patients’ Experiences of Clinicians’ Crying During Psychotherapy

Tritt, A., Kelly, J., & Waller, G. (2015). Patients’ experiences of clinicians’ crying during psychotherapy for eating disorders. Psychotherapy, 52(3), 373-380.

Psychotherapy can be an emotionally intensive experience for both patients and therapists. In a large survey, more than 70% of therapists reported having cried in therapy, and 30% cried during the past month. Therapists who cried almost always saw the experience as positive or neutral (99.2%) for the patient and the therapeutic relationship. Do clients feel the same way about therapists who cry? In this study, Tritt and colleagues surveyed 188 adult patients with an eating disorder who were recently in psychotherapy. Of those, 107 (56.9%) reported that their therapist had cried during therapy. There was no association between frequency of therapist crying and therapist age, patient diagnosis, or type of psychotherapy (i.e., manual-based or not). Therapists who cried a moderate amount were seen by clients as having a positive demeanor (i.e., happy, firm, consistent), whereas therapists who cried more extremely were rated by clients as having a more negative demeanor (i.e., anxious, angry, bored). If therapists who cried were generally perceived by clients to have a positive demeanor, then therapist crying had a positive impact on therapy. That is, clients reported a greater respect for the therapist, greater willingness to express emotions, and higher willingness to undertake therapy in the future. However, if therapists who cried were generally perceived by clients to have a negative demeanor, then therapist crying had a negative impact on therapy. That is, clients were less willing to express emotions in therapy and to undertake therapy in the future. Further, if the therapist who cried was rated as having a negative demeanor, the client experienced more self blame, assumed that there was something wrong in the therapist’s life, and that the therapist and client did not share the same perspective on the client’s life and treatment.

Practice Implications

This small but unique and interesting survey sheds some light on clients’ experiences of therapists who cry during therapy. More than half of clients experienced their therapist crying during therapy. In contrast to surveys of therapists who tend to evaluate therapist crying as exclusively positive or neutral, this survey found that many but not all clients experienced therapist crying as positive. It depends on how the client perceives the therapist as a person. Therapists who are seen by clients as happy, firm, and consistent may assume that patients will experience their crying as a positive indicator of the therapeutic relationship. However, therapists who are seen by clients as anxious, bored, or angry cannot assume that clients will see their tears as being positive for therapy.

November 2015

Does Duration of Therapy Affect Patient Outcomes?

Stiles, W.B., Barkham, M., & Wheeler, S. (2015). Duration of psychological therapy: Relation to recover and improvement rates in UK routine practice. British Journal of Psychiatry, 207, 115-122.

In this very large study from the UK National Health Service (NHS), Stiles and colleagues assessed whether more therapy is better. That is, do people continue to get better with more sessions or do patients reach a certain level of improvement and terminate therapy regardless of number of sessions. The “dose-effect model” of psychotherapy suggests that patients continue to improve with more sessions, although the rate of improvement slows down after 18 sessions. However, large naturalistic studies from the UK health system show that patients have similar rates of recovery regardless of the number of sessions they attend (i.e., up to 20 sessions). These findings suggest that patient improvement may follow a good-enough or “responsive regulation model” of improvement, in which patients responsively regulate the number of sessions that they need. This could have implications for policies regarding how many sessions are prescribed to patients. In this study, Stiles and colleagues drew data from the NHS data base of over 26,000 adult patients who were seen by 1,450 therapists. These were patients who provided enough reliable outcome data, who attended 40 or fewer sessions, and who had a planned ending. Many patients had multiple problems including anxiety, depression, bereavement, and trauma and abuse. Patients who were selected for the study had initial symptom scores in the clinical range. The most common therapy approaches included integrative, psychodynamic, CBT, and supportive. Patient “recovery” was defined as no longer scoring in the clinical range at the end of therapy. Patient “improvement” was defined as a reliable drop in symptom scores on a psychometric measure. Patients received an average of 8.3 sessions, 60% recovered, and an additional 19% improved but did not recover. Rates of reliable improvement were negatively correlated (r = -.58) with number of sessions, and the effect was large. That is, patients who stayed in therapy longer had lower rates of recovery. These patients were more symptomatic at the outset.

Practical Implications

The results of this very large naturalistic study suggest that therapists and clients should regularly monitor improvement and adjust the treatment duration based on whether clients improve to a satisfactory level. The authors refer to this as “responsive regulation” of treatment duration. In practice, this means that therapists and clients end treatment when patients have improved to a “good-enough” level, which is likely balanced against costs and alternatives. These findings should encourage therapists and agencies to shift their attention away from prescribing a pre-specified length of treatment at the beginning of therapy towards evaluating on an ongoing basis what constitutes good-enough gains for each client.

This month...

Type of Research

Topics

June 2016

Practice Implications

Practice Implications

April 2016

Practice Implications

Practice Implications

February 2016

Practice Implications

November 2015

Practical Implications

Psychotherapy Practice Research Network (PPRNet)