Blog

Erekson, D. M., Janis, R., Bailey, R. J., Cattani, K., & Pedersen, T. R. (2017). A longitudinal investigation of the impact of psychotherapist training: Does training improve client outcomes? Journal of Counseling Psychology, 64(5), 514-524.

The research on the effects of therapist training on client outcomes has not been very encouraging. Most studies indicate that more therapist training, better adherence to and competence in a treatment manual, and greater experience are not related to improved client outcomes. The profession would like to think that therapists affect client outcomes so that more training and experience might be related to better outcomes. One could argue that the research in this area is hampered by many studies not following the same therapists across time over stages of training. That is, many studies compare client outcomes between novices and licensed professionals – but these studies do not really address the question “does an individual therapist get better as he or she accumulates more years of training and experience?” In this unique study, Erekson and colleagues track client outcomes of 22 therapists over a 10 year period starting from the therapists’ early training in a doctoral program in psychology to their first years as licensed psychologists working in a counselling centre. On average, the psychotherapists saw 183.95 (SD = 103.23) student clients during that time (range: 62 to 449 clients). The clients primarily had clinically impairing problems with anxiety and depression. Stages of training were defined as: graduate trainee, intern, post-doctoral fellow, and licensed professional. The average client moderately improved (d = .72) in terms of symptoms from the start to the end of their therapy. When looking at therapists’ effects across stages of training, the authors controlled for client initial severity and size of therapist caseload. The results indicated that 4 of the 22 therapists improved in their client outcomes over stages of training, 10 remained the same, and 8 therapists worsened over time. On average, client outcomes remained the same across a therapist’s stage of training. However, average client rate of change (i.e., how quickly a therapist’s client improved) became slower as therapists achieved more training and experience.

Practice Implications

This study adds to the weight of evidence that therapist training and experience as currently conceptualized do not result in better outcomes among clients. One possible explanation for why psychotherapist trainees do as well or better than when they are licensed professionals may lie in the structure of training programs. Trainees in graduate school and internships typically receive a high level of supervision and learning experiences, and must deliberately report client progress on an ongoing basis. Therapists who are licensed professionals are not required to maintain these practices, and so they may not be practicing deliberately. Researchers and clinical writers identify deliberate practice as an important means by which practicing psychotherapists can maintain and improve their skills in interpersonal effectiveness and therapeutic alliance.

Author email: david_erekson@byu.edu

Owen, J., Wampold, B. E., Kopta, M., Rousmaniere, T., & Miller, S. D. (2016). As good as it gets? Therapy outcomes of trainees over time. Journal of Counseling Psychology, 63, 12-19.

Does psychotherapy training improve trainees’ knowledge and skills? Do trainees improve in their ability to produce positive client outcomes over time? The research on training psychotherapists is mostly inconclusive. Some studies show little or no difference between trainees and experienced therapists, and others found no association between level of experience and client outcomes. On the other hand, some researchers have found a relationship between training and competence in delivering a particular type of treatment. Overall, the research seems to show that there is a lot of variability between therapists in their outcomes and on how training affects their practice and their clients’ outcomes. However, rarely do these studies assess outcomes within the same trainee over time as they accumulate more training. In this study, Owen and colleagues evaluate if psychotherapy trainees’ client outcomes improved with training over time. They assessed 114 psychology trainees at different levels of training in 47 clinics across the U.S. These training therapists saw over 1100 clients over at least a 12-month period, and many therapists were followed for three years. The average client improved, but with small effects (d = .31, CIs not reported). Therapists were more effective with clients who were more distressed (d = .66) than clients who were less distressed (d = .10), probably because more distressed clients had more room to improve. Trainees’ outcomes improved significantly over time, although their average improvement over time was small. Most importantly, trainees’ improvements over time varied so that the researchers were able to identify four patterns of change over a three year period of training: (1) one group of trainees started out with moderately good outcomes and their outcomes remained moderately good over time; (2) a second group started out with small positive effects in their client outcomes and they improved to achieve moderately good outcomes by their third year; (3) a third group of trainees started out with small positive client outcomes but their outcomes got worse by their third year; and (4) a fourth group started out with poor outcomes and improved to achieve small positive outcomes by year 3 of their training.

Practice Implications

Trainees appear to have various trajectories in their ability to foster positive client outcomes over time, and, at times, that trajectory is negative. Trainees whose outcomes get worse over time (group 3) or who do not achieve at least moderately good outcomes (group 4) may need specific training to foster better interpersonal effectiveness, empathy, management of countertransference, and humility. In general, therapists should assess their clients’ outcomes with progress monitoring tools in order to use the feedback to improve their outcomes over time. If outcomes are not positive on average, then therapists should consider remediation, further training, or consultation.

Westmacott, R. & Hunsley, J. (2017). Psychologists’ perspectives on therapy termination and the use of therapy engagement/retention strategies. Clinical Psychology and Psychotherapy, 24, 687–696.

The average psychotherapy client attends a median of about 3 to 5 sessions, which is substantially less than the number of sessions the average client needs to realize a clinically significant decline in symptoms. Premature termination (clients ending therapy unilaterally) occurs in 19% of cases in research trials and in as many as 38% of clients in community practices. And so premature termination is mental health problem for clients and an economic problem for therapists and agencies. Clients terminate therapy prematurely for a variety of reasons including: dissatisfaction with therapy or the therapist, achieving their goals, and practical barriers (appointment times, travel, cost). Therapists tend to underestimate the proportion of unilateral terminations from their practice, and underestimate negative outcomes and client negative perceptions of therapy and therapists. In this study, Westmacott and Hunsley, surveyed psychologists who provide psychotherapy (N=269) on their perspectives on their clients’ reasons for termination and the strategies they use to retain their clients in therapy. Therapists reported that 33.3% of their clients terminated prematurely, which is somewhat lower than the percentage reported in previous research. Most psychologists (65.7%) tended to attribute the most important reasons for premature termination before the third session to clients’ lack of motivation to change (rated as very important or important on a scale). A much smaller percentage (15.8%) attributed waiting too long for services as the most important reason for premature termination before session 3. The most important reason for premature termination after the third session was most often attributed to clients reaching their treatment goals (54.8%). Regarding strategies to retain clients - almost all psychologists (96.8%) indicated that they fostered a strong alliance, 74.3% indicated that they negotiated at treatment plan, 58.0% prepared clients for therapy, 38.7% used motivational enhancement strategies, 33.0% used client outcome monitoring, and 17.8% used appointment reminders.

Practice Implications

This survey of psychologists suggests that psychotherapists may somewhat underestimate the number of clients who prematurely terminate therapy. Psychotherapists may also overly attribute dropping out to client-focused factors (low motivation, achieving outcomes), rather than therapist-focused factors (dissatisfaction with therapist or therapy), setting-focused factors (negative impression of the office and staff), or practically-focused factors (appointment times, cost). Many therapists reported using alliance-building and negotiating a treatment plan to retain clients. However, few therapists used other evidence-based methods like systematic outcome monitoring, and fewer still used appointment reminders. Therapists should consider therapist-focused and setting-focused reasons for client termination, and to use outcome monitoring and appointment reminders to reduce drop-outs from their practices.

Wampold, B. E., Baldwin, S. A., Holtforth, M. G., & Imel, Z. E. (2017). What characterizes effective therapists. In L.G. Castonguay and C.E. Hill (Eds.) How and why are some therapists better than others? Understanding therapist effects. Washington, DC: American Psychological Association.

The research on therapist effects indicates that some therapists are more effective than others. Previous research showed that therapist characteristics like age, race, ethnicity, gender, and experience are not consistently related to patient outcomes. Neither is therapist competence and adherence to a treatment approach. In this chapter, Wampold and colleagues ask the question: what characterizes effective therapists? The research is complicated because it is difficult to disentangle therapist effects from patient factors. That is, it is possible that some clients (i.e., those who are more motivated, likeable, and psychologically minded) might create favorable conditions for some therapists to be more effective. However, recent advances in statistical methods have allowed researchers to isolate the effects of therapist characteristics from patient factors. Based on this new research, Wampold and colleagues identified four characteristics of effective therapists. (1) The ability to form an alliance across a range of patients. The therapeutic alliance is defined as the agreement on tasks and goals of therapy, and the affective bond between therapist and patient. Alliance is reliably associated with good patient outcomes. Research shows that therapists and not clients are primarily responsible for the alliance-outcome relationship. (2) Facilitative interpersonal skills – which includes verbal fluency, warmth, empathy, and emotional expression. These skills in a therapist are a strong predictor of patient outcomes. (3) Professional self doubt – or healthy skepticism about one’s abilities and skills leading to self-reflective practice has also been found to predict positive patient outcome. (4) Deliberate practice - defined as individualized training activities especially designed to improve specific aspects of an individual’s performance through repetition and successive refinement. The amount of time outside of therapy that therapists engage in improving targeted therapeutic skills predicted patient outcomes.

Practice Implications

Some therapists are better than others - and demographics, professional affiliation, training, and adherence to a manual do not differentiate better therapists. Four factors are emerging as indicators of better therapists. Ability to develop, maintain, and repair a therapeutic alliance is well known to predict patient outcomes and it appears that therapists are largely responsible for the condition of the alliance. Therapists’ ability to be verbal, warm, and empathic is also key to patient outcomes. Professional skepticism about one’s abilities that lead to reflective practice is also an important characteristic in order to continually improve one’s abilities and monitor one’s outcomes. And, finally therapists who spend time outside of therapy deliberately and repetitively practicing skills will achieve better patient outcomes.

Maljanen, T., Knekt, P., Lindfors, O., Virtala, E., Tillman, P., et al. (2016). The cost-effectiveness of short-term and long-term psychotherapy in the treatment of depressive and anxiety disorders during a 5-year follow-up. Journal of Affective Disorders, 190, 254-263.

There is substantial evidence that short-term psychotherapy is effective for depressive and anxiety disorders, including at follow-up. There are also a few meta-analyses showing the effectiveness of longer term therapy. Although there is research indicating the cost-effectiveness of short-term treatments, less research has evaluated the cost-effectiveness of longer term therapy, and even less research at long term follow-ups. In this study from the Helsinki Psychotherapy Study Group, the authors evaluated the cost-effectiveness of short-term therapy (solution-focused therapy [12 sessions] or short-term dynamic therapy [20 sessions]) versus long term dynamic psychotherapy (2-3 sessions weekly for up to 3 years). Participants (N = 326) with anxiety or mood disorders were randomized to one of the three therapies. Symptoms and work ability were assessed at pre-treatment, post-treatment, and several times during a 5 year follow-up period. A previous publication with this sample showed that long-term treatment resulted in greater recovery with regard to symptoms and work ability (recovery for both outcomes exceeding 60%) compared to short-term treatment (50% recovered). For this study the authors asked: is long-term treatment cost-effective – in other words, is the better outcome from long-term treatment justified by greater cost? Both direct costs (health care utilization) and indirect costs (lost productivity) were calculated in this study using standard econometrics. Long-term therapy cost 3 times as much as short-term treatments. This amount was smaller than expected because those who received short-term treatments had higher auxiliary costs (i.e., the need for other treatments after the short term therapy ended). Shorter therapies were equally cost-effective, but both were more cost-effective than the longer treatment. That is, despite being more effective and requiring less auxiliary treatment, the longer-term therapy was more costly per unit of improvement with regard to symptoms and productivity compared to the shorter treatments.

Practice Implications

From an economic point of view, short-term treatments make the most sense. However, given that many patients needed other treatments after the end of short-term therapy, and given that on average the longer-term therapy was more effective in the long run, a clinician may want to weigh the economics with the specific needs and preferences of each patient.

Vasiliadis, H-M., Dezetter, A., Latimer, A., Drapeau, M., & Lesage, A. (2017). Assessing costs and benefits of insuring psychological services as part of Medicare for depression in Canada. Psychiatric Services in Advance.

About 20% of the population have a mental disorder like depression during their lifetime, and depression is associated with a number of negative health outcomes like mortality, health system costs, and low quality of life. Most patients prefer psychotherapy over medications, but there are significant barriers to accessing psychotherapy, with cost as the biggest barrier. Recently in the United Kingdom, a cost-benefit analysis was used to argue that the development of the Improving Access to Psychological Therapies (IAPT) program would pay for itself in five years. The IAPT is a system of reimbursing psychological therapies through the publicly funded National Health Service in the UK. Similar models are in place in France and Australia. Vasiliadis and colleagues also conducted an economic study in Canada to evaluate the cost-effectiveness of providing psychological services as part of Canada`s Medicare system. They did so by using economic modeling of incidences of depression among patients over a 40-year period, and assessing the relative costs and outcomes of increasing publicly funded access to psychotherapy compared with the status quo. They used known incidence rates for depression in the adult population (2.9%), and estimated health service use from the Canadian Community Health Survey (CHS), and estimated costs (hospitalizations, GP visits, specialist visits, seeing a psychologist or counsellor, antidepressant prescriptions) from provincial health billing manuals. They also used the existing research literature to estimate the average effects of psychotherapy for depression on various outcomes (quality of life, suicide and attempts, health service use, etc.). Adequate mental health services for depression was defined as either 8 sessions of psychotherapy or use of antidepressants. They found that 36.7% of Canadians with depression did not use mental health services, and only 67.4% of those who did access treatment received adequate care. In the economic models that were tested, increasing access to care resulted in a projected decrease in depression, suicidality, health system and societal costs. Increasing access would cost an additional $123 million per year, but savings to society in terms of reduced health system costs and increased productivity was $246 million per year. In other words, for every $1 spent by Medicare on psychotherapy, Canada would recoup $2 in reduced costs and increased productivity.

Practice Implications

The findings of this Canadian study echo those of similar economic studies done in the UK, France, and Australia. Increasing access to psychotherapy for depression through Medicare is more effective and less costly than the status quo. In fact this Canadian study may underestimate potential gains because it did not account for the increased use of the health system by depressed people with chronic medical conditions. Currently, public expenditures for mental health and addictions in Canada account for only 7.2% of the total health budget. An increase of 0.07% of the total health budget to cover psychological services would result in health care cost savings, improved mental health, reductions in disability, and increased productivity among Canadians.