Blog

Chow, D. L., Miller, S. D., Seidel, J. A., Kane, R. T., Thornton, J. A., & Andrews, W. P. (2015). The role of deliberate practice in the development of highly effective psychotherapists. Psychotherapy, 52(3), 337.

In 2014, Tracey and colleagues caused a stir when they claimed that there was no evidence of expertise in psychotherapy (see my July, 2014 blog). They defined expertise as increased quality of performance that is gained with additional experience – and they concluded that psychotherapy research has not provided evidence that therapist performance improves with experience. The issue is important because differences between therapists account for over 5% of patient outcomes. This seems small, but it is larger than variance in outcomes accounted for by the use of empirically supported treatments (0% - 4%), and almost as large as the variance accounted for by client-rated alliance (5% - 15%). Across a wide variety of professions (e.g., music, medicine, chess, sports), professionals’ engagement in deliberate practice results in improvement and superior performance. However, there is little evidence of this in psychotherapy. In this article by Chow and colleagues, the authors look specifically at “deliberate practice” defined as individualized training activities to improve one’s performance through repetition and refinement. To be effective, deliberate practice has to be focused on achieving specific targets and guided by conscious monitoring of outcomes over a long period of time. The authors collected a sample of 69 therapists who worked across a number of organizations and practice areas, and these therapists provided data related to 4,850 patients. Seventeen of the 69 therapists who treated 1,632 clients also provided data on professional development activities. Therapists were multidisciplinary (i.e., counsellors, psychologists, marital therapists, social workers, psychotherapists) with an average of over 8 years of experience, who worked mainly in private practice or within the national health service in the U.K., and who primarily treated adult patients with depression or anxiety disorders. Patient outcomes were measured repeatedly with a valid standardized scale, and deliberate practice was self reported by therapists using a measure that asked about the frequency and time therapists engaged in 25 activities outside of work aimed at improving therapeutic skills. On average, clients improved by the end of treatment and the effect was large (d = 1.22). As expected therapists differed in their patient outcomes (i.e., some therapists were reliably more effective than others). Therapist demographic variables, theoretical orientation, years of experience, and practice setting were not related to patient outcomes. However, the amount of time in deliberate practice activities was associated with a reduction in client distress. Compared to the less effective therapists (2.62 hrs/wk in deliberate practice), the best performing therapists (7.39 hrs/wk in deliberate practice) spent about 2.81 times more time on deliberate practice. Therapists rated the following deliberate practice activities as the most relevant to their patients’ outcomes: reviewing challenging cases, attending training workshops, reflecting on past sessions, and reflecting on what to do in future sessions.

Practice Implications

Although this is a single study with a relatively small sample of therapists, it is one of those rare studies to assess the effects of therapist deliberate practice on patient outcomes. As is the case with other professions, reviewing one’s performance can play an important role in identifying errors, altering course, and remediating problems. As Tracey and colleagues indicated, therapists need good quality information in order to learn from their errors and make adjustments so that clients can improve. Quality information might be available from progress monitoring (i.e., continuous feedback to therapists about client outcomes), which has been shown to improve client outcomes especially for at-risk cases. Chow and colleagues go further to suggest targeted learning by using standardized clients within training and supervision contexts. Deliberate practice is not only for newer or less experienced therapists, since experienced therapists also vary in their ability to engage and help clients. Highly effective therapists spend more time engaging in activities outside of their practice specifically aimed at improving their performance.

Abbass, A., Kisely, S., Rasic, D., Town, J.M., & Johansson, R. (2015). Long-term healthcare cost reduction with Intensive Short-term Psychodynamic Psychotherapy in tertiary psychiatric care. Journal of Psychiatric Research, http://dx.doi.org/10.1016/j.jpsychires.2015.03.001

Several years ago Lazar (2010) published a book detailing the cost-effectiveness of psychotherapy for a variety of disorders. That is, her systematic review found that on most economic indicators (lost income, decreased disability, decreased health utilization) psychotherapy resulted in an immediate cost reduction over and above the cost of the treatment. In this study from Halifax, Canada, Abbass and colleagues looked at the effects of psychotherapy, specifically of Intensive Short-term Dynamic Psychotherapy (ISTDP), on the long-term reduction in hospital costs and physician visits. Abass and colleagues argue that adverse childhood events are an important determinant of adult mental health problems and of increased costs to the health system likely because of the consequence of problems with emotion regulation. Psychotherapies like ISTDP specifically address issues that are a consequence of childhood maltreatment and so might reduce some of the consequent health care costs. Abbass and colleagues provided ISTDP to 890 patients in the Halifax health care system who were referred to the psychotherapy service from emergency departments, physicians, and mental health providers. These patients’ outcomes were compared to 192 patients not seen by the clinic for various reasons. Most common diagnoses of the total sample were: somatoform disorder, anxiety disorder, personality disorder, and depressive disorder. Participant completed measures of psychological distress, and the research team were able to access provincial health usage data tracked over 3 years. Fifty eight therapists of various skill levels (psychiatrists, psychologists, family physicians, trainees) provided ISTDP. The average patient attended 7.3 sessions which cost $708 (estimated by salaries in 2006). Patients receiving psychotherapy had physician and hospital costs that decreased from $3,224 to $4759 in Canadian dollars per year over three years (again in 2006 dollars). Patients in the control condition not receiving ISTDP showed health care costs that increased from $368 to $2,663 per year. These trajectories of health care costs were significantly different. Yearly physician and health care costs for patients prior to being treated with ISTDP were greater than those of the general Canadian population, but 3 years post ISTDP their health care costs were less than the general Canadian population. In addition, compared to control patients those treated with psychotherapy showed a significant reduction in psychological distress.

Practice Implications

This study by Abbass and colleagues demonstrates that short term psychotherapy provided to a broad range of patients and targeting health and illness behaviors related to problems with emotion regulation can reduce health care costs. These reductions in hospital and physician visits occurred in the short term and were sustained over several years. Some patients may require longer treatment, but the evidence suggests that short term interventions should be tried first.

Author email: allan.abbass@dal.ca

Puig, A., Yoon, E., Callueng, C., An, S., & Lee, S. M. (2014). Burnout syndrome in psychotherapists: A comparative analysis of five nations. Psychological Services, 11(1), 87-96.

Psychotherapists can experience severe stress when working with some clients. The stress can be the result of work conditions like budget cuts and increased therapy caseloads, and from characteristics of the work itself like remaining compassionate with clients who experience significant emotional pain and trauma. In the May 2014 blog, I reported on research on secondary trauma experienced by therapists as an occupational hazard of working with traumatized patients. Although secondary trauma is distinct from burnout, the accumulation of these experiences by therapists coupled with other demands of the work can lead to burnout. Burnout syndrome is often defined as the failure to perform clinical tasks well because of discouragement, apathy, and the experience of emotional or physical drain. Burnout can affect both the therapist’s well being and patient outcomes. In this study by Puig and colleagues, the Counsellor Burnout Inventory (CBI) was given to therapists in five countries. The CBI measures therapist Exhaustion, sense of Incompetence, Negative Work Environment, and Deterioration in Personal Life. The samples of therapists were from countries that included the United States (n = 750), Korea (n = 382), Japan (n = 257), Philippines (n = 218), and Hong Kong (n = 222). Puig and colleagues argue that countries like the US may be characterized by a more individualistic cultural context, whereas other countries in Asia may have more collectivistic values. These cultural values and differing professional practice contexts may affect the experience of burnout by psychotherapists. The majority of therapists were female (67.3% to 85.3%) with average experience ranging from 5.34 years in Korea to 12.33 years in the US. Puig and colleagues translated the CBI from English and then conducted a confirmatory factor analysis that showed that the CBI is reliable and valid within each of these samples of therapists from different countries. Therapists in Hong Kong and the US had the highest scores on the Exhaustion scale. Puig and colleagues suggested that burnout in Hong Kong and US may be most affected by demands of the work that psychotherapists do in those countries. Psychotherapists from Japan reported highest levels on the Incompetence scale, suggesting that burnout in Japanese therapists might be most affected by a sense of low self efficacy and efficiency. Of all the nations, US therapists perceived their working environments most negatively. Deterioation in Personal Life scores were highest in Korea suggesting that burnout may contribute to low personal quality of life for Korean psychotherapists. All therapists reported low mean scores on the Devaluing Client scale, but those in the US and Philippines had the lowest mean scores. It appears that burnout is least affected by negative relationships with clients for all therapist groups.

Practice Implications

Therapists, policymakers, and administrators need to attend to increased stress related to psychotherapists’ work, the environment, and characteristics of clients who experience trauma. The impact of stress and burnout can be seen in therapists’ performance their personal lives and well-being. In addition, burnout can affect patient outcomes. Puig and colleagues suggest that psychotherapists can participate in professional development activities (e.g., workshops) to enhance their knowledge and skills in managing stress and maintaining a healthy and balanced work and personal life. Organizations should consider restructuring the social and work environment (e.g., workload), and clarifying and reassessing their expectations of therapists in order to prevent conflict and ambiguity. On his web site, Ken Pope provides a list of resources for therapist well-being and preventing burnout, and he discusses the ethics of therapist self-care.

Afifi, T. O., MacMillan, H. L., Boyle, M., Taillieu, T., Cheung, K., & Sareen, J. (2014). Child abuse and mental disorders in Canada. Canadian Medical Association Journal, cmaj-131792.

Childhood adversity, including physical abuse, sexual abuse, neglect, witnessing violence, and loss of an attachment figure early in life is well known to result in a number of health and mental health problems later in life. Afifi and colleagues refer to child abuse at a significant public health problem worldwide. Despite the well known effects of child abuse, until recently there has been little research on the estimates of abuse and its outcomes in Canada. In their study, Afifi and colleagues looked at three types of child abuse (physical abuse, sexual abuse, and intimate partner violence) and its effects on 14 mental conditions including suicide and substance abuse. The authors used data from the 2012 Canadian Community Health Survey that included a representative sample of respondents aged 15 years and older living in the 10 provinces representing over 25,000 Canadians. The household survey response rate was close to 80%, and those over the age of 18 (N = 23,395) were asked about child abuse that occurred before the age of 16. Physical abuse was defined as any instances of being slapped, punched, kicked, burned etc. Sexual abuse was defined as being forced into any unwanted sexual activity by being threatened. Exposure to partner violence was classified as having seen or heard parents, step-parents, or guardians hitting each other. The prevalence of any of these 3 types of child abuse was 32.1%, with physical abuse being most common (26.1%), followed by sexual abuse (10.1%) and exposure to intimate partner violence (7.9%). Women were more likely than men to have experienced childhood sexual abuse (14.4% versus 5.8%) and exposure to intimate partner violence (8.9% versus 6.9%) as children. Men were more likely than women to have experienced child physical abuse (31.0% versus 21.3%). All forms of child abuse were associated with an increase in later mental illness, such that those who experienced any form of child abuse were over 3 times more likely to have a later mental illness. Obsessive–compulsive disorder was associated specifically with sexual abuse, eating disorders were specifically associated with physical abuse, post traumatic stress disorder was specifically associated with sexual abuse and certain types of physical abuse. All 3 types of abuse were associated with drug abuse/dependence, suicidal ideation, and suicide attempts. Exposure to a higher number of abuse types (i.e., sexual abuse, physical abuse, and intimate partner violence) was associated with more mental illnesses, and the effect was worse for women.

Practice Implications

Child abuse is an important public health problem in Canada and is associated with a number of mental health problems in adulthood. Health care providers should be aware of the relation between specific types of child abuse and certain mental conditions. Clinicians working in the mental health field should acquire skills in assessing patients for exposure to abuse, and should understand the implications for treatment.

Werbarta, A., Andersson, H., & Sandell, R. (2014). Dropout revisited: Patient- and therapist-initiated discontinuation of psychotherapy as a function of organizational instability. Psychotherapy Research, Online first publication: DOI: 10.1080/10503307.2014.883087.

Premature termination of psychotherapy in mental health care is a problem both in terms of patient outcomes and in terms of financial consequences for providers. Drop out rates for psychotherapy in general range from 20% to 75% with an average of 50%. In my April, 2013 blog I reported on a meta analysis by Swift and Greenberg (2012) in which they reported an overall drop out rate of 20% in randomized control trials; but the average drop out rate could be up to 38% in randomized trials depending on how premature termination was defined (failure to complete a treatment, attending less than half of sessions, stopping attending, or therapist judgment). Drop outs are commonly believed to represent therapeutic failures. Much of the research to predict psychotherapy non-completion has focused on patient variables like age, gender, symptom severity and others. This implicitly puts the responsibility for dropping out on the patient. Swift and Greenberg (2012) found that on average young, male, single patients with a personality disorder diagnosis were more likely to drop out. Therapist variables are less frequently studied, and the only therapist variable related to lower drop out was greater experience. Therapeutic orientations were not related to more or less dropping out. Very few studies have examined work conditions or organizational variables as predictors of premature terminations. Werbata and colleagues (2014) conducted a large study in 8 clinics in Sweden with 750 patients treated by 140 therapists. The clinics were three psychiatry outpatient units, three specialized psychotherapy units, one young adult psychotherapy unit, and one primary care setting that provided psychotherapy. Drop out was defined as unilateral termination in which either the patient or therapist discontinued the treatment. Of the patients who started therapy, 66% completed treatment and 34% terminated prematurely (19.7% of patients terminated the therapy, 14.3% were terminated by therapists). On average, clients were in their mid-30s, and most had a psychiatric diagnosis. The most common therapy was psychodynamic (59.1%) followed by integrative (19.0%), and cognitive behavioral (17.1%). The authors looked at patient variables (e.g., symptom severity), therapist variables (e.g., age, gender, etc.), and organizational stability. Ratings of organizational stability of the clinic were based on: the transparency of the clinic structure, the suitability of the organization to provide psychotherapy, the clarity of rules and decision-making policies regarding providing psychotherapy, and the clinic’s financial stability. Client variables such as: older age, greater level of psychopathology, and tendency to act out were moderately predictive of dropping out. Receiving treatment at a less stable clinic made it almost four times more likely for patients to initiate dropping out than to remain in therapy. Organizational instability was more important than patient factors in accounting for premature termination.

Practice Implications

Drop outs were almost four times higher in unstable clinics. Instability in organizations can create anxiety, cynicism, and disengagement in staff, which may have consequences for patient care. Financial and political problems within a clinic or institution, internal conflict related to treatment policy or disruptive administrative routines may affect the therapeutic relationship, which is generally more intimate and more important than in other health care contexts. Organizational instability can result in shortened or interrupted treatment, change in therapists, or therapists who are not fully engaged due to clinic stresses. For patients, these terminations may resemble earlier life losses or neglect that may have precipitated their need for therapy in the first place.

Johnson, S.M, Burgess Moser, M., Beckes, L., Smith, A., Dalgliesh… Coan, J.A. (2013). Soothing the threatened brain: Leveraging contact comfort with emotionally focused therapy. PLoS ONE 8(11): e79314. doi:10.1371/journal.pone.0079314.

Attachment theory argues that a felt sense of connection to others provides a secure base and safe haven, thus increasing one’s tolerance for uncertainty and threat. Improved access to and experience of social resources likely help us regulate negative emotions thus reducing our perception of threat. In a previous study, women in a couple were confronted with a threat (the possibility of a shock to the ankle) while their brain was scanned by functional magnetic resonance imaging (fMRI). These women were either holding the hand of their spouse or the hand of a stranger. Women with the highest quality relationships showed lower threat response in the brain especially while they held the hand of their spouse. Holding the hand of a spouse with whom they had a loving relationship reduced the fear response in these women measured directly in the brain by fMRI. In the study by Johnson and colleagues (2013) the authors wanted to see if improving attachment relationship between couples following Emotionally Focused Couples Therapy (EFT) would result reduced responses to threat measured in the brain. Twenty-three couples completed a course of EFT (23 sessions on average) with experienced therapists. EFT is an evidence based couples treatment that conceptualizes couple distress as caused by unmet attachment needs. When feeling emotionally disconnected, partners in a couple may be anxiously blaming or withdrawing, and this pattern exacerbates relationship distress and threat. EFT focuses on repairing attachment bonds between spouses. In this trial, EFT significantly improved couples’ self reported distress from pre to post therapy. The brain of the female member of the couple was scanned in an fMRI before and after EFT. An electrode was fixed to her ankle, and she was threatened with a mild shock. This procedure took place while she was on her own and while she held her partner’s hand. Threat response was measured by activity in the prefrontal cortex and dorsal anterior cingulate cortex, both of which are associated with processing threat cues and negative affect. EFT resulted in a decrease activity in these areas of the brain from pre to post couples treatment, and these results were especially prominent during hand holding with the partner.

Practice Implications

There is emerging evidence that the effects of psychotherapy like EFT for couples, has a direct impact on the brain that correlates with patients’ self report. In addition, EFT appears to increase the attachment bond between couples and this helps them to regulate their emotions and to moderate their reactions to threat. This study by Johnson and colleagues (2013) also supports some fundamental tenets of attachment theory – that increasing attachment security is possible with psychotherapy and doing so improves affect regulation as measured in the brain. This has broad implications because strong social and attachment bonds help us live longer and enjoy better health.

Author email: jcoan@virginia.edu