Blog

Swift, J. K., Callahan, J. L., Ivanovic, M., & Kominiak, N. (2013, March 11). Further examination of the psychotherapy preference effect: A meta-regression analysis. Journal of Psychotherapy Integration. Advance online publication. doi: 10.1037/a0031423

Client preferences consist of preferences regarding the type of treatment offered (e.g., preference for psychotherapy or medication, preference for a behavioral approach to treatment or an insight oriented one), desires for a certain type of therapist or provider (e.g., preference for an older therapist, a female provider, or a therapist who has a nurturing personality style), and preferences about what roles and behaviors will take place in session (e.g., preference for the therapist to take a listening role or an advice giving role). In a previously published meta analysis Swift and colleagues (2011) reviewed data from 35 studies that compared preference-matched and non-matched clients. A small but significant preference outcome effect was found, indicating that preference-matched clients show greater improvements over the course of therapy, and that clients whose preferences were not matched were almost twice as likely to discontinue treatment prematurely. In this follow up meta regression study, Swift and colleagues assessed whether preference accommodation is more or less important for types of disorders, types of treatments, or different demographics like sex or age. (Meta regression involves accumulating data from across many studies to assess predictors [e.g., sex, age, diagnosis, treatment type, etc.] of the preference effect). For example, some research has indicated that men prefer therapists with more feminine traits and that men prefer pharmacological interventions. But does accommodating these preferences affect outcomes and drop out rates? Is matching preferences essential for younger clients? Is matching preferences more important for women or ethnic minorities? The authors analysed data from 33 studies representing 6,058 clients to address some of these questions. The only variable that predicted the influence that preferences have on rates of premature termination was the length of the intervention. That is, it may be more important to accommodate client preferences for briefer therapies. Perhaps, as clients continue in therapy for longer durations, other variables such as the therapeutic alliance play a bigger role in determining whether or not one drops out prematurely. It is also possible that as treatment continues, clients may experience a shift in preferences to more closely match the treatment conditions that they were given. Once this shift in preferences has occurred, preferences are no longer mismatched, and the risk of dropping out may be diminished.

Practice Implications

This study provides evidence that incorporating client preferences may be important for all types of clients. Generally, when client preferences are accommodated, clients show greater improvements while in treatment and are less likely to discontinue the intervention prematurely. As much as is practical, practitioners might collaboratively work with clients to identify what preferences they hold for treatment, and to discuss those preferences in the context of what is the most effective treatment that is available. This is particularly important for psychotherapies of shorter duration..

Author email: joshua.keith.swift@gmail.com

Niemeyer, H., Musch, J., & Pietrowsky, R. (2013). Publication bias in meta-analyses of the efficacy of psychotherapeutic interventions for depression. Journal of Consulting and Clinical Psychology, 81, 58-74.

Meta-analyses are important ways of summarizing effects of medical and psychological interventions by aggregating effect sizes across a large number of studies. (Don’t stop reading, I promise this won’t get too statistical). The aggregated effect size from a meta analysis is more reliable than the findings of any individual study. That is why practice guidelines almost exclusively rely on meta analyses when making practice recommendations (see for example the Resources tab on this web site). However meta analyses are only as good as the data (i.e., studies) that go into them (hence, the old adage: “garbage in, garbage out”). For example, if the studies included in a meta analysis are a biased representation of all studies, then the meta analysis results will be unreliable leading to misleading practice guidelines. One problem that leads to unreliable meta analyses is called publication bias. Publication bias often refers to the tendency of peer reviewed journals not to publish studies with non-significant results (e.g., a study showing a treatment is no better than a control condition). Publication bias may also refer to active suppression of data by researchers or industry. Suppression of research results may occur because an intervention’s effects were not supported by the data, or the intervention was harmful to some study participants. In medical research, publication bias can have dire public health consequences (see this TED Talk). There is lots of evidence that publication bias has lead to a significant over-estimation of the effects of antidepressant medications (see Turner et al (2008) New England Journal of Medicine). Does publication bias exist in psychotherapy research, and if so does this mean that psychotherapy is not as effective as we think? A recent study by Niemeyer and colleagues (2013) addressed this question with the most up to date research and statistical techniques. They collected 31 data sets each of which included 6 or more studies of psychotherapeutic interventions (including published and unpublished studies) for depression. The majority of interventions tested were cognitive behavioral therapy, but interpersonal psychotherapy, and brief psychodynamic therapy were also included. The authors applied sophisticated statistical techniques to assess if publication bias existed. (Briefly, there are ways of assessing if the distribution of effect sizes across data sets fall in a predictable pattern called a “funnel plot” – specific significant deviations from this pattern indicate positive or negative publication bias). Niemeyer and colleagues found minimal evidence of publication bias in published research of psychotherapy for depression. This minimal bias had almost no impact on the size of the effect of psychotherapy for depression.

Practice Implications

This is a very important result indicating that despite a minor tendency toward a selective publication of positive results, the efficacy of all reviewed psychotherapy interventions for depression remained substantial, even after correcting for the publication bias. Niemeyer and colleagues’ findings demonstrate that publication bias alone cannot explain the considerable efficacy of psychotherapy for depression. Psychotherapeutic interventions can still be considered efficacious and recommended for the treatment of depression.

Author email address: helen.niemeyer@hhu.de

Swift, J.K. & Greenberg, R.P. (2012). Premature discontinuation in adult psychotherapy: A meta analysis. Journal of Consulting and Clinical Psychology, 80, 557-589.

Premature termination or drop out from psychotherapy has long been a significant problem for the practice of psychotherapy. Drop out can be variously defined as: not completing the course of treatment, unilateral termination on the patient’s part without therapist input, and not attending a specified number of sessions, among others. One of the largest meta analyses on the topic was done in 1993, and at that time the average drop out rate was 46.86%. This is a serious problem for a number of reasons. First, the average patient needs approximately 18 sessions to improve, and so early dropping out means that these patients do not benefit. Second, therapists can become demoralized at such drop out rates, and therapists who are not confident in their procedures are less likely to be effective. Third, the agency or practice loses important sources of funding or revenue. And fourth, society in general continues to manage the burden of a significant portion of its population not being at their best. The meta analysis by Swift and Greenberg (2012) is the largest of its kind, comprising 669 studies representing 83, 834 patients. The average drop out rate, largely defined as not completing treatment and unilateral termination without therapist input, was 19.79%. This appears to be a substantial drop from the previous 1993 number of 46.86%, but still represents one in five psychotherapy patients. Swift and Greenberg suggest that perhaps the more recent focus on evidence based treatments and short term treatments, and more systematic and consistent reporting of drop outs from studies may account for the lower numbers. No differences were found in drop out rates between treatment orientations (e.g., CBT vs others) and no differences in treatment format (e.g., individual vs group). Time-limited (20.7%) and manualized (18.3%) treatments tended to have lower drop out rates than non-time-limited (29%) and non-manualized (28.3%) treatments. Patients with eating disorders (29.3%) and personality disorders (25.6%) had the highest drop out rates. As did patients who were younger and less educated. Drop out rates in effectiveness studies (26%), that are more similar to everyday clinical practice, was higher than highly controlled randomized trials (17%). Trainee therapists (26.6%) tended to have higher drop out rates than experienced therapists (17.2%).

Practice Implications

At least one in five clients are likely to drop out of psychotherapy. Clinicians should particularly work on retention with younger clients and those with a personality or eating disorder diagnosis. Extra efforts to prevent dropout should also be emphasized for trainees and in university-based clinic settings. A number of strategies for reducing premature discontinuation in therapy have been identified, including discussing expectations regarding therapy roles and behaviors, providing education about adequate treatment duration, addressing motivation, repairing alliance ruptures, using therapist feedback, addressing client preferences, providing time-limited interventions, and increasing perspective convergence in the psychotherapy dyad. A number of these are described in greater detail in the following blog entry.

Author email: Joshua.Keith.Swift@gmail.com

Handbook of Psychotherapy and Behavior Change: The Handbook of Psychotherapy and Behavior Change is perhaps the most important compendium of psychotherapy research covering a large number of research areas. The Handbook is updated approximately every 10 years, and the most recent 6^th edition was published in January 2013. In the coming months I will review one chapter a month in addition to commenting on psychotherapy research articles. Book chapters have more restrictive copy right rules about distributing content, so I will not provide author email addresses for these chapters. If you are interested, you can view the table of contents on Amazon.

Lambert, M.J. (2013). The efficacy and effectiveness of psychotherapy. In M.J. Lambert (Ed.) Bergin and Garfield’s handbook of psychotherapy and behaviour change (6^th ed.), pp169-218. Hoboken, N.J.: Wiley.

This comprehensive chapter in the Handbook reviews research on the efficacy and effectiveness of psychotherapy. Lambert’s reviews focus on meta-analyses, which is a way of summarizing effect sizes in a research area. The bottom line is that psychotherapy is effective so that 40% to 60% of clients show substantial benefit in controlled research trials, though the effect is likely smaller in routine practice.  Concurrently, a consistent proportion of adults (5% to 10%) deteriorate during psychotherapy. Patients who receive formal treatment are better off than those who receive no treatment, and bona fide treatments are superior to control conditions that provide only some aspects of effective treatment. When psychotherapy is offered by skilful therapists, on average clients experience appreciable gains and return to normal functioning. Fifty percent of patients achieve clinically significant gains after 8 sessions, and 50% achieve recovery after about 20 sessions of psychotherapy. The effects of psychotherapy tend to be long lasting. For example, only 25% treated depressed patients relapse, whereas 50% of those who receive antidepressants relapse. Research continues to support those therapies that have been rigorously tested, and differences in effectiveness between therapy types (e.g., cognitive behavioural therapy (CBT), psychodynamic, interpersonal, etc.) tend to be small or negligible for many disorders. Cognitive behavioural therapy is still the most tested therapy modality, though other treatments are also accumulating evidence of efficacy. Treatment is likely facilitated by a therapeutic relationship that is characterized by trust, understanding, acceptance, kindness, and warmth. The effect of the therapist providing the therapy is at least as large as the effect of different therapy techniques. That is, some therapists are unusually effective, whereas others may not help the majority of patients who seek their services. Continuous monitoring of outcomes and providing regular feedback to the therapist improves the therapy’s effectiveness.

Practice Implications

Providers and patients can be assured that a broad range of formally defined and tested psychotherapies when provided by skilful therapists are likely to result in appreciable gains in clients including a return to normal functioning. Therapy relationships characterized by trust, understanding, acceptance, and warmth can greatly facilitate change in depression, anxiety, inadequacy, and inner conflicts. When making a decision about which therapy to choose, clients would be wise to consider the therapist as a person at least as much as the type of therapy being offered. Treatment efforts should be based on the best evidence available for treatment types, therapist behaviors, and relationship factors. Routinely monitoring the effects of therapy with each patient will give the therapist ongoing information about their effectiveness and may improve their patients’ outcomes.

Town, J. M., Diener, M. J., Abbass, A., Leichsenring, F., Driessen, E., & Rabung, S. (2012). A meta-analysis of psychodynamic psychotherapy outcomes: Evaluating the effects of research-specific procedures. Psychotherapy, 49, 276-290.

One of the main reasons that some clinicians do not participate in research is that they argue that doing so will have a negative impact on the therapeutic relationship, the therapy process, and patient outcomes. Although I have heard this from clinicians of many theoretical orientations, this opinion is perhaps most strongly held by some colleagues with a psychodynamic orientation. I identify with psychodynamic theory and practice, so this opinion about research held by some of my colleagues has been very disconcerting to me. Up to now, the best I could say in defense of practice-based research of psychodynamic therapy was to talk about my own experiences, which have been highly positive and rewarding. A recent meta analysis by Town and colleagues from Dalhousie University changes all that. (First, a note about meta analysis. Meta analysis is a statistical way of combining the effects of many studies, each of which has a number of participants, into a common metric called an effect size. By combining studies, the end result is more meaningful and more reliable than the results of any single study on its own.). The meta analysis by Town and colleagues had 45 independent samples and over 1600 patients. Results indicated that psychodynamic treatments for a variety of disorders (e.g., depression, anxiety, personality disorders) showed a significant large positive treatment effect – this is not new. What is new is that compared to conditions in which no research-specific protocols were introduced, conditions that did use research protocols were no different in terms of patient outcomes up to one year post treatment. There was even a significant small positive effect of these research protocols on outcomes from post treatment to one year post treatment. Research-specific protocols included video recordings of therapy sessions, therapists following treatment manuals, fidelity checks to make sure therapists were accurately doing psychodynamic therapy, and psychometric measurements of processes and outcomes

Practice Implications

Research protocols do not have a negative impact on psychodynamic therapy outcomes. Perhaps research protocols should be introduced into all therapies to improve longer term outcomes in addition to studying therapy procedures and processes that work.

Author email: joel.town@dal.ca

Oldham, M., Kellett, S., Miles, E., & Sheeran, P. (2012). Interventions to increase attendance at psychotherapy: A meta-analysis of randomized controlled trials. Journal of Consulting and Clinical Psychology, 80, 928-939.

A great deal of clinical time can be wasted because of patient nonattendance at scheduled psychotherapy appointments. The financial costs of nonattendance are also high, and patients who need help but do not attend are not receiving help. Premature termination from psychotherapy is associated with poor outcomes. Previous reviews reported that premature termination rates in regular clinical practice ranged from 40% to 46.8%. Clearly this is a big problem for many psychotherapists and patients. Oldham and colleagues (2012) conducted a meta analysis of interventions to increase psychotherapy attendance. Their meta analysis included 33 randomized controlled trials (RCTs) representing 4422 patients. Interventions had a significant moderate effect on reducing premature termination and increasing attendance. Effective interventions included: giving patients a choice of appointment times, giving patients a choice of therapists, motivational enhancement interventions, preparing patients prior to psychotherapy on what to expect, attendance reminders, and providing information on how to make the best use of therapy. Participants with single diagnoses made better use of interventions than those with multiple diagnoses.

Practice Implications

Psychotherapists can improve attendance in psychotherapy by providing patients with choice of appointment times and therapists, by taking the time to prepare patients prior to therapy for what to expect in treatment and how to best make use of therapy, using motivational interventions, and by providing appointment reminders.

Author email: s.kellett@sheffield.ac.uk or p.sheeran@sheffield.ac.uk