Blog

The Great Psychotherapy Debate: Since in April, 2015 I review parts of The Great Psychotherapy Debate (Wampold & Imel, 2015) in the PPRNet Blog. This is the second edition of a landmark, and sometimes controversial, book that surveys the evidence for what makes psychotherapy work. You can view parts of the book in Google Books.

Wampold, B.E. & Imel, Z.E. (2015). The great psychotherapy debate: The evidence for what makes psychotherapy work (2^nd edition). New York: Routledge.

In this part of the chapter on efficacy, Wampold and Imel provide convincing evidence from numerous reviews of meta analyses that the average effect size of psychotherapy across diverse treatments and patients is about d = .80. This is a reliable figure and is considered a “large” effect by commonly accepted standards. Put another way, the average psychotherapy patient is better off than 79% of untreated clients, psychotherapy accounts for 14% of the outcome variance, and for every 3 patients who receive psychotherapy, one will have a better outcome than had they not received psychotherapy. In other words, psychotherapy is remarkably efficacious. These effect size estimates are mostly drawn from randomized clinical trials that are highly controlled (i.e., therapists are highly trained and supervised, patients are sometimes selected to have no co-morbid problems, treatment fidelity to a manual is closely monitored, etc.). Some argue that the context of these trials renders them artificial, and that findings from these trials reveal little about psychotherapy practiced in the real world with complex patients. How do findings from controlled clinical trials compare to everyday clinical practice? Wampold and Imel review the evidence from three areas of research: clinical representativeness, benchmarking, and comparisons to treatment as usual. With regard to clinical representativeness, a meta analysis (k > 1,000 studies) coded the studies for type of treatment setting, therapist characteristics, referral sources, use of manuals, client heterogeneity, etc. The meta analysis found that therapies that were most representative of typical practice had similar effects to what is observed in highly controlled studies. With regard to benchmarking, a large study (N > 5,700 patients) compared treatment effects observed in naturalistic settings to clinical trial benchmarks. Benchmarks were defined as scores on an outcome (e.g., on a depression scale) that are within 10% of scores reported in clinical trial research. Treatment effects in naturalistic settings were equivalent to and sometimes better than those achieved using clinical trial benchmarks. Further, therapists in practice settings achieved the same outcomes in fewer sessions than in clinical trials. With regard to comparisons to treatment as usual, a meta analysis (k = 30 studies) for personality disorders looked at studies that compared evidence-based treatments tested in clinical trials to treatment as usual. The meta analysis found that evidence-based treatments were significantly more effective than treatment as usual with moderate effects. These results suggest that when it comes to personality disorders, special training and supervision, which are common in clinical trials, might be beneficial.

Practice Implications

Wampold and Imel argue that psychotherapy as tested in clinical trials is remarkably effective such that the average treated patient is better off than 79% of untreated controls. The evidence also suggests that psychotherapy practiced in clinical settings is effective and probably as effective as psychotherapy tested in controlled clinical trials. It is possible that therapists who treat those with personality disorders may benefit from additional training and supervision to improve patient outcomes in everyday practice.

Erlangsen, A., Lind, B. D., Stuart, E. A., Qin, P., Stenager, E., Larsen, K. J., ... & Nordentoft, M. (2014). Short-term and long-term effects of psychosocial therapy for people after deliberate self-harm: A register-based, nationwide multicentre study using propensity score matching. The Lancet Psychiatry. Early Online Publication: doi:10.1016/S2215-0366(14)00083-2.

Between 9 million and 35 million suicide attempts occur yearly in the world, and suicide accounts for over 800,000 deaths every year worldwide. Suicide attempts are associated with future attempts and with mortality. Within the first year, 16% of people attempt suicide again. Despite the occurrence of suicide attempts and its effects, there has been inconclusive evidence of the effectiveness of interventions to reduce future attempts and death. That is why this Danish nationwide study by Erlangsen is so important. Another impressive aspect of this study is its size and scope. Since 1992, psychological therapies have been offered to people at risk of suicide in specialized clinics throughout Denmark. The aim of Erlangsen and colleagues’ study was to assess if those who received these psychological interventions had a reduced risk of suicidal behavior and mortality compared to people who did not receive the interventions. The authors collected data from 1992 to 2010 from Danish national health registries. This procedure was possible in Denmark because the health system is nationally coordinated and each individual has a traceable national health ID. In order to be included in the study, those who were offered specialized psychological interventions had to receive at least one session of treatment. Therapy included cognitive behavioral therapy, problem solving therapy, dialectical behavior therapy, psychodynamic therapy, systemic therapy and others. The interventions consisted of up to 8 to 10 individual outpatient sessions. The comparison group received “standard care” that consisted of admission to hospital, referral to a general practitioner, or discharge with no referral. The primary outcomes were: repeated self-harm, death by suicide, and death by any other cause. Of the people receiving psychotherapy, 5,678 had useable data. The “standard care” sample was much larger and consisted of 58,281 individuals who were matched to the psychological intervention group on many variables including sex, age, education, antidepressant medications, and psychiatric diagnosis. For those receiving psychotherapy, the rate of repeated suicide attempts in the first year was 6.7% and 15.5% at 10 years. For those receiving standard care, rate of repeated suicide attempts in the first year was 9.0% and 18.4% at 10 years. The odds of another suicide attempt one year post treatment was 73% lower among those receiving psychotherapy. Death by any other cause at the 10 year mark was also significantly lower in the psychological therapy group (5.3%) versus the no-therapy group (7.9%). The authors estimated that over the 20 year span of their data, psychological therapy: prevented repeated suicide attempts in 145 people, prevented deaths by any other cause in 153 people, and prevented 30 suicide deaths. Psychosocial interventions were associated with fewer repeated suicide attempts in women but not in men, and adolescents and young adults benefited most from psychological therapies.

Practice Implications

This is the largest long term follow up study ever of psychological interventions after a suicide attempt. Psychotherapy was associated with reduced risk of self-harm and mortality in the short and long term. This was especially true for women and in adolescents and young adults. Those receiving psychotherapy might have been a select group resulting in biased results. However, the extensive matching of the psychotherapy group to the no-therapy control group reduced the likelihood that factors other than psychotherapy influenced the findings. The study indicates strong support for providing psychological interventions to people at risk of suicide.

Puig, A., Yoon, E., Callueng, C., An, S., & Lee, S. M. (2014). Burnout syndrome in psychotherapists: A comparative analysis of five nations. Psychological Services, 11(1), 87-96.

Psychotherapists can experience severe stress when working with some clients. The stress can be the result of work conditions like budget cuts and increased therapy caseloads, and from characteristics of the work itself like remaining compassionate with clients who experience significant emotional pain and trauma. In the May 2014 blog, I reported on research on secondary trauma experienced by therapists as an occupational hazard of working with traumatized patients. Although secondary trauma is distinct from burnout, the accumulation of these experiences by therapists coupled with other demands of the work can lead to burnout. Burnout syndrome is often defined as the failure to perform clinical tasks well because of discouragement, apathy, and the experience of emotional or physical drain. Burnout can affect both the therapist’s well being and patient outcomes. In this study by Puig and colleagues, the Counsellor Burnout Inventory (CBI) was given to therapists in five countries. The CBI measures therapist Exhaustion, sense of Incompetence, Negative Work Environment, and Deterioration in Personal Life. The samples of therapists were from countries that included the United States (n = 750), Korea (n = 382), Japan (n = 257), Philippines (n = 218), and Hong Kong (n = 222). Puig and colleagues argue that countries like the US may be characterized by a more individualistic cultural context, whereas other countries in Asia may have more collectivistic values. These cultural values and differing professional practice contexts may affect the experience of burnout by psychotherapists. The majority of therapists were female (67.3% to 85.3%) with average experience ranging from 5.34 years in Korea to 12.33 years in the US. Puig and colleagues translated the CBI from English and then conducted a confirmatory factor analysis that showed that the CBI is reliable and valid within each of these samples of therapists from different countries. Therapists in Hong Kong and the US had the highest scores on the Exhaustion scale. Puig and colleagues suggested that burnout in Hong Kong and US may be most affected by demands of the work that psychotherapists do in those countries. Psychotherapists from Japan reported highest levels on the Incompetence scale, suggesting that burnout in Japanese therapists might be most affected by a sense of low self efficacy and efficiency. Of all the nations, US therapists perceived their working environments most negatively. Deterioation in Personal Life scores were highest in Korea suggesting that burnout may contribute to low personal quality of life for Korean psychotherapists. All therapists reported low mean scores on the Devaluing Client scale, but those in the US and Philippines had the lowest mean scores. It appears that burnout is least affected by negative relationships with clients for all therapist groups.

Practice Implications

Therapists, policymakers, and administrators need to attend to increased stress related to psychotherapists’ work, the environment, and characteristics of clients who experience trauma. The impact of stress and burnout can be seen in therapists’ performance their personal lives and well-being. In addition, burnout can affect patient outcomes. Puig and colleagues suggest that psychotherapists can participate in professional development activities (e.g., workshops) to enhance their knowledge and skills in managing stress and maintaining a healthy and balanced work and personal life. Organizations should consider restructuring the social and work environment (e.g., workload), and clarifying and reassessing their expectations of therapists in order to prevent conflict and ambiguity. On his web site, Ken Pope provides a list of resources for therapist well-being and preventing burnout, and he discusses the ethics of therapist self-care.

Afifi, T. O., MacMillan, H. L., Boyle, M., Taillieu, T., Cheung, K., & Sareen, J. (2014). Child abuse and mental disorders in Canada. Canadian Medical Association Journal, cmaj-131792.

Childhood adversity, including physical abuse, sexual abuse, neglect, witnessing violence, and loss of an attachment figure early in life is well known to result in a number of health and mental health problems later in life. Afifi and colleagues refer to child abuse at a significant public health problem worldwide. Despite the well known effects of child abuse, until recently there has been little research on the estimates of abuse and its outcomes in Canada. In their study, Afifi and colleagues looked at three types of child abuse (physical abuse, sexual abuse, and intimate partner violence) and its effects on 14 mental conditions including suicide and substance abuse. The authors used data from the 2012 Canadian Community Health Survey that included a representative sample of respondents aged 15 years and older living in the 10 provinces representing over 25,000 Canadians. The household survey response rate was close to 80%, and those over the age of 18 (N = 23,395) were asked about child abuse that occurred before the age of 16. Physical abuse was defined as any instances of being slapped, punched, kicked, burned etc. Sexual abuse was defined as being forced into any unwanted sexual activity by being threatened. Exposure to partner violence was classified as having seen or heard parents, step-parents, or guardians hitting each other. The prevalence of any of these 3 types of child abuse was 32.1%, with physical abuse being most common (26.1%), followed by sexual abuse (10.1%) and exposure to intimate partner violence (7.9%). Women were more likely than men to have experienced childhood sexual abuse (14.4% versus 5.8%) and exposure to intimate partner violence (8.9% versus 6.9%) as children. Men were more likely than women to have experienced child physical abuse (31.0% versus 21.3%). All forms of child abuse were associated with an increase in later mental illness, such that those who experienced any form of child abuse were over 3 times more likely to have a later mental illness. Obsessive–compulsive disorder was associated specifically with sexual abuse, eating disorders were specifically associated with physical abuse, post traumatic stress disorder was specifically associated with sexual abuse and certain types of physical abuse. All 3 types of abuse were associated with drug abuse/dependence, suicidal ideation, and suicide attempts. Exposure to a higher number of abuse types (i.e., sexual abuse, physical abuse, and intimate partner violence) was associated with more mental illnesses, and the effect was worse for women.

Practice Implications

Child abuse is an important public health problem in Canada and is associated with a number of mental health problems in adulthood. Health care providers should be aware of the relation between specific types of child abuse and certain mental conditions. Clinicians working in the mental health field should acquire skills in assessing patients for exposure to abuse, and should understand the implications for treatment.

Werbarta, A., Andersson, H., & Sandell, R. (2014). Dropout revisited: Patient- and therapist-initiated discontinuation of psychotherapy as a function of organizational instability. Psychotherapy Research, Online first publication: DOI: 10.1080/10503307.2014.883087.

Premature termination of psychotherapy in mental health care is a problem both in terms of patient outcomes and in terms of financial consequences for providers. Drop out rates for psychotherapy in general range from 20% to 75% with an average of 50%. In my April, 2013 blog I reported on a meta analysis by Swift and Greenberg (2012) in which they reported an overall drop out rate of 20% in randomized control trials; but the average drop out rate could be up to 38% in randomized trials depending on how premature termination was defined (failure to complete a treatment, attending less than half of sessions, stopping attending, or therapist judgment). Drop outs are commonly believed to represent therapeutic failures. Much of the research to predict psychotherapy non-completion has focused on patient variables like age, gender, symptom severity and others. This implicitly puts the responsibility for dropping out on the patient. Swift and Greenberg (2012) found that on average young, male, single patients with a personality disorder diagnosis were more likely to drop out. Therapist variables are less frequently studied, and the only therapist variable related to lower drop out was greater experience. Therapeutic orientations were not related to more or less dropping out. Very few studies have examined work conditions or organizational variables as predictors of premature terminations. Werbata and colleagues (2014) conducted a large study in 8 clinics in Sweden with 750 patients treated by 140 therapists. The clinics were three psychiatry outpatient units, three specialized psychotherapy units, one young adult psychotherapy unit, and one primary care setting that provided psychotherapy. Drop out was defined as unilateral termination in which either the patient or therapist discontinued the treatment. Of the patients who started therapy, 66% completed treatment and 34% terminated prematurely (19.7% of patients terminated the therapy, 14.3% were terminated by therapists). On average, clients were in their mid-30s, and most had a psychiatric diagnosis. The most common therapy was psychodynamic (59.1%) followed by integrative (19.0%), and cognitive behavioral (17.1%). The authors looked at patient variables (e.g., symptom severity), therapist variables (e.g., age, gender, etc.), and organizational stability. Ratings of organizational stability of the clinic were based on: the transparency of the clinic structure, the suitability of the organization to provide psychotherapy, the clarity of rules and decision-making policies regarding providing psychotherapy, and the clinic’s financial stability. Client variables such as: older age, greater level of psychopathology, and tendency to act out were moderately predictive of dropping out. Receiving treatment at a less stable clinic made it almost four times more likely for patients to initiate dropping out than to remain in therapy. Organizational instability was more important than patient factors in accounting for premature termination.

Practice Implications

Drop outs were almost four times higher in unstable clinics. Instability in organizations can create anxiety, cynicism, and disengagement in staff, which may have consequences for patient care. Financial and political problems within a clinic or institution, internal conflict related to treatment policy or disruptive administrative routines may affect the therapeutic relationship, which is generally more intimate and more important than in other health care contexts. Organizational instability can result in shortened or interrupted treatment, change in therapists, or therapists who are not fully engaged due to clinic stresses. For patients, these terminations may resemble earlier life losses or neglect that may have precipitated their need for therapy in the first place.

McAleavey, A.A., Castonguay, L.G., & Goldfried, M.R. (2014). Clinical experiences in conducting cognitive-behavioral therapy for social phobia. Behavior Therapy, 45, 21-35.

It might come as a surprise to some that social phobia (also called social anxiety disorder) is the most commonly diagnosed anxiety disorder, with a lifetime prevalence of about 12%. Symptoms include negative self-view, fear of embarrassment or criticism, and fear and/or avoidance of social situations. Cognitive behavioral therapy (CBT) is an effective treatment for social phobia with effects as large as pharmacotherapies. Despite this, there are several potential barriers to implementing CBT for social phobia in clinical practice. CBT involves exposure to feared situations (in vivo or simulated), identifying and altering maladaptive thoughts during exposure, producing testable hypotheses, and identifying cognitive errors.  CBT is not uniformly effective for all patients with social phobia, exposure techniques are linked to dropping out and failure to initiate treatment, and there can be an increase in missed sessions and non-completion of homework related to avoidance. In this study, McAleavy and colleagues surveyed 276 psychotherapists who provided CBT for social phobia to assess problems or barriers clinicians encountered when applying CBT in practice. Possible barriers listed in the survey were derived from extensive interviews with experts who developed and researched CBT interventions for anxiety disorders. Survey respondents were mostly Ph.D. level clinical psychologists (59%), women (61%), who practiced in outpatient clinics or private practice, and had on average 12 years of post-degree experience. Many therapists reported using behavioral interventions, including developing a fear/avoidance hierarchy, in-session exposures, focusing on behavior in social situations, and specifically focusing on behavioral avoidance. Most also used cognitive homework (i.e., interventions focused on exploring or altering attributions or cognitions).  The most frequent therapist endorsed barriers to implementing CBT for social phobia included: patient symptoms (i.e., severity, chronicity, and poor social skills); other patient characteristics (i.e., resistance to directiveness of treatment, inability to work independently between sessions, avoidant personality disorder, limited premorbid functioning, poor interpersonal skills, depressed mood); patient expectations (i.e., that therapist will do all the work; pessimism regarding therapy); patient specific beliefs (i.e., belief that fears are realistic, or that social anxiety is part of their personality); patient motivation (i.e., premature termination, attribution that gains are due to medications); and patient social system (i.e., social system endorses dependency, social isolation). A minority of CBT therapists endorsed a weak therapeutic alliance or aspects of the CBT intervention itself as posing a barrier.

Practice Implications

CBT therapists identified a number of barriers, mainly patient related, that might impede the implementation of CBT for social phobia. Given these barriers the authors suggested that therapists: (1) consider more intense, longer, or more specific treatments for more severe cases; (2) incorporate assessment of patient severity to guide decisions; (3) consider tailoring the level of treatment directiveness based on patient characteristics – i.e., more resistant patients may require a less directive approach and more control over the type and pace of interventions; (4) prepare patients on what to expect in the treatment before therapy begins; (5) find a balance between validating/accepting patients’ problematic beliefs that their fears might be realistic with encouragement to change; (6) add motivational interviewing for patients who are less motivated; (6) complete a thorough functional analysis of patients’ social systems at the start of therapy. McAleavey and colleagues noted that while therapeutic alliance difficulties was an infrequently endorsed barrier by therapists, such difficulties remain clinically important, especially in light of findings that indicate that negative reactions to patients are under-reported by therapists. Developing and maintaining a good alliance remains a key aspect of CBT for panic disorder.