Blog

Bell, E. C., Marcus, D. K., & Goodlad, J. K. (2013). Are the parts as good as the whole? A meta-analysis of component treatment studies. Journal of Consulting and Clinical Psychology, 81, 722-736.

Component studies (i.e., dismantling treatments or adding to existing treatments) may provide a method for identifying whether specific active ingredients in psychotherapy contribute to client outcomes. In a dismantling design, at least one element of the treatment is removed and the full treatment is compared to this dismantled version. In additive designs, an additional component is added to an existing treatment to examine whether the addition improves client outcomes. If the dismantled or added component is an active ingredient, then the condition with fewer components should yield less improvement. Among other things, results from dismantling or additive design studies can help clinicians make decisions about which components of treatments to add or remove with some clients who are not responding. For example, Jacobson and colleagues (1996) conducted a dismantling study of cognitive-behavioral therapy (CBT) for depression. They compared: (1) the full package of CBT, (2) behavioral activation (BA) plus CBT modification of automatic thoughts, and (3) BA alone. This study failed to find differences among the three treatment conditions. These findings were interpreted to indicate that BA was as effective as CBT, and there followed an increased interest in behavioral treatments for depression. However, relying on a single study to influence practice is risky because single studies are often statistically underpowered and their results are not as reliable as the collective body of research. One way to evaluate the collective research is by meta analysis, which allows one to assess an overall effect size in the available literature (see my November, 2013 blog on why clinicians should rely on meta analyses). In their meta analysis, Bell and colleagues (2013) collected 66 component studies from 1980 to 2010. For the dismantling studies, there were no significant differences between the full treatments and the dismantled treatments. For the additive studies, the treatment with the added component yielded a small but significant effect at treatment completion and at follow-up. These effects were only found for the specific problems that were targeted by the treatment. Effects were smaller and non-non-significant for other outcomes such as quality of life.

Practice Implications

Psychotherapists are sometimes faced with a decision about whether to supplement current treatments with an added component, or whether to remove a component that may not be helping. Adding components to existing treatments leads to modestly improved outcomes at least with regard to targeted symptoms. Removing components appears not to have an impact on outcomes. The findings of Bell and colleagues’ (2013) meta analysis suggest that specific components or active ingredients of current treatments’ have a significant but small effect on outcomes. Some writers, such as Wampold, have argued that the small effects of specific components highlight the greater importance of common factors in psychotherapy (i.e., therapeutic alliance, client expectations, therapist empathy, etc.). This may be especially the case when it comes to improving a patient’s quality of life.

Author email: david.marcus@wsu.edu

Handbook of Psychotherapy and Behavior Change: Starting in March 2013 I will review one chapter a month from the Handbook of Psychotherapy and Behavior Change in addition to reviewing psychotherapy research articles. Book chapters have more restrictive copy right rules than journal articles, so I will not provide author email addresses for these chapters. If you are interested, the Handbook table of content and sections of the book can be read on Google Books.

Bohart, A.C. & Wade, A.G. (2013). The client in psychotherapy. In M. Lambert (Ed.) Bergin and Garfield’s handbook of psychotherapy and behavior change (6^th ed.), pp. 219-257. Hoboken, NJ: Wiley.

Last month I blogged about the section in Bohart and Wade’s (2013) chapter that focused on client symptom severity and motivation. This month I focus on differences between clients and therapists on their perceptions of therapy processes and outcomes. In a previous blog (see June 2013), I reviewed a meta analysis that showed that given two equally effective treatments, clients should be given their preference in order to improve outcomes. Clearly, client perceptions and preferences are important, and perhaps more important than the therapist’s perceptions. Bohart and Wade (2013) reviewed a number of studies that demonstrated this. For example, studies show that client ratings of the therapeutic alliance predicted which therapists had better than average outcomes, whereas therapist ratings of the alliance did not predict outcomes.  In three other meta-analyses, client perceptions of therapist genuineness, empathy, and therapeutic presence were each more predictive of outcomes than the respective therapists’ assessments of their own genuineness, empathy, and therapeutic presence. Clients also value different outcomes compared to therapists and researchers. Most research on outcomes tends to focus on symptom reduction, but clients appear to have a broader view of good outcomes. In a qualitative study, clients focused on healthier relationship patterns, an increase in self-understanding that led to freedom from and avoidance of self-destructive behaviour, and stronger valuing of the self, in addition to symptom reduction. Others report that clients define good outcomes as reengaging in meaningful work and social roles, and restoring their self respect.

Practice Implications

Clients are more finely attuned to the therapeutic alliance than therapists, and perhaps are better at detecting relevant and helpful therapist stances. If you are interested in assessing therapeutic alliance or a therapist’s empathy, don’t ask the therapist, ask the client. This has implications for training therapists in helpful therapeutic relationship stances. Helping trainees find areas for continued development as a therapist (i.e., in terms of improving their empathy, genuineness, and therapeutic presence) may require asking their clients’ opinions. Client perceptions of therapist qualities are more relevant than therapist perceptions when assessing effective therapist relationship stances. Therapists should monitor client preferences, particularly if the client is having difficulty engaging in the therapy. If possible and reasonable, therapists should alter their relationship approach to a client based on client feedback. Regarding outcomes, therapists, researchers, and agencies should consider broader definitions of outcomes that are more aligned with what clients want and value. Improved self concept, improved relationships, and better social and work functioning may be just as important as symptom reduction for most clients.

Munder, T., Brütsch, O., Leonhart, R., Gerger, H., & Barth, J. (2013). Researcher allegiance in psychotherapy outcome research: An overview of reviews. Clinical Psychology Review, 33, 501-511.

Although evidence for the efficacy of psychotherapy is largely uncontested, there remains debate about whether one type of treatment is more effective than another. This debate continues despite a recent American Psychological Association (APA) resolution on the equivalent efficacy of most systematic psychotherapy approaches. There are many aspects to this debate (e.g., some treatments are more researched than others and so appear to be better; symptom focused measurements are more sensitive to change and so may favour one treatment over another; some treatments are more amenable to manualization and short term application; etc.). One element of the debate that has received a lot of attention is researcher allegiance. Researcher allegiance refers to researchers preferring one treatment approach over another, and this preference may bias comparative outcome trials in favour of the preferred therapy. Researcher allegiance is measured by assessing primary researchers’ publication history or by their self-declared preference for a particular therapy approach. There exist 30 meta analyses that assessed researcher allegiance since the 1980s. These meta analyses focused on different therapy types, client populations (adults, children), and research designs (randomized trials, naturalistic effectiveness studies). However, some meta analyses have reported contradictory results for the researcher allegiance effect. This could be due to the different foci of the meta analyses (i.e., different treatment approaches, patient populations, age groups, etc.), and also possibly due the allegiance of those conducting the meta analyses. Munder and colleagues (2013) conducted a mega analysis of these meta analyses. As the name implies, a mega analysis aggregates the findings of available meta analyses. Munder and colleagues found a significant moderate effect of researcher allegiance. Researcher allegiance was consistent across patient populations, age groups, outcome measures, type of study design, and year of publication.

Practice Implications

As the APA resolution indicates, psychotherapy is the informed and intentional application of clinical methods and interpersonal stances derived from established psychological principles. Evidence-based practice in psychotherapy is "the integration of the best available research with clinical expertise in the context of patient characteristics, culture and preferences". The results of this mega analysis undermine the claim of some comparative outcome studies that suggest that one evidence-based psychotherapy is more effective than another.

Author email: tmunder@uni-kassel.de

Handbook of Psychotherapy and Behavior Change: Starting in March 2013 I will review one chapter a month from the Handbook of Psychotherapy and Behavior Change in addition to reviewing psychotherapy research articles. Book chapters have more restrictive copy right rules than journal articles, so I will not provide author email addresses for these chapters. If you are interested, you can read the Handbook table of content and sections of the book on Google Books.

Bohart, A.C. & Wade, A.G. (2013). The client in psychotherapy. In M. Lambert (Ed.) Bergin and Garfield’s handbook of psychotherapy and behavior change (6^th ed.), pp. 219-257. Hoboken, NJ: Wiley.

Last month I blogged about the section in Bohart and Wade’s (2013) chapter that focused on client attachment. This month I focus on other factors like severity of distress and comorbidity, and level of motivation. Some authors argue that client factors predict 30% of variance in outcomes. That accounts for more of psychotherapy outcome than therapist effects and therapeutic techniques combined. Severity of symptoms of anxiety and depression and functional impairment caused by this distress leads to poorer client prognosis. Further, individuals with more severe symptoms need more sessions to show improvement. Some research shows that those with greater symptoms change more than those with fewer symptoms. However, even though those with higher levels of distress show the most change, they are less likely to achieve recovery in which they return to a normal level of functioning. In most cases, clients with comorbid problems are less likely to do well. For example, comorbidity for personality disorder or substance abuse negatively impact outcome. Client motivation is also related to psychotherapy outcomes. Motivation can be internal (those that arise from the individual’s intrinsic interests or values) or external (those that arise from external rewards or punishments). Generally, internal motives (i.e., greater readiness to change) are better predictors of sustained behaviour change. The stages of change model describes readiness to change as occurring in progressive stages that include: (1) precontemplation, in which clients are not internally motivated; (2) contemplation in which clients move to the next stage where they recognize a problem but are not ready to take action; and (3) preparation for action in which clients are more internally motivated to change. The next two stages of the model do not speak to motivation but to action and maintenance of change. Norcross looked at clients’ readiness to change prior to therapy and its relationship to outcome. Greater readiness to change was moderately and significantly associated with better treatment outcomes.

Practice Implications

The results on severity and comorbidity suggest that providers and policy makers must consider increasing the number of treatment sessions to take into account clients who have greater initial severity and comorbidities, especially for those with comorbid personality disorders. Results related to motivation indicate that when client motivation to work in therapy comes from within and they show progress in their readiness to change, they are more likely to do well. Therapists need to find ways of mobilizing clients’ internal reasons for change. Motivational interviewing may be one means of doing so.

Handbook of Psychotherapy and Behavior Change: Starting in March 2013 I will review one chapter a month from the Handbook of Psychotherapy and Behavior Change in addition to reviewing psychotherapy research articles. Book chapters have more restrictive copy right rules than journal articles, so I will not provide author email addresses for these chapters. If you are interested, the Handbook table of content can be viewed on Amazon.

Bohart, A.C. & Wade, A.G. (2013). The client in psychotherapy. In M. Lambert (Ed.) Bergin and Garfield’s handbook of psychotherapy and behavior change (6^th ed.), pp. 219-257. Hoboken, NJ: Wiley.

Some authors argue that client factors account for 30% of variance in outcomes. That represents a greater association to psychotherapy outcome than therapist effects and therapeutic techniques combined. In this part of the Handbook chapter on client factors, Bohart and Wade discuss client attachment. Bowlby found that attachment relationships were important and were different from other relationships. Attachment figures confer a sense of security and safety to infants that allow children to explore their environment and experience the self. Attachment patterns that develop in childhood tend to be stable throughout the lifespan, but attachment style can change with positive (i.e., psychotherapy, romantic relationships) and negative (i.e., traumatic events) experiences. Attachment security is associated with adaptive affect regulation, positive view of self and others, and reflective functioning that is related to mentalizing. Attachment anxiety is associated with maladaptive up-regulation of emotions, positive view of others but negative view of self, and reduced reflective functioning likely due to preoccupation with relationships and emotion dysregulation. Attachment avoidance is associated with maladaptive down-regulation of emotions, negative view of others and positive view of self (or negative view of others and negative view of self in the case of fearful avoidant attachment), and limited reflective functioning due to dismissing of emotions and relationships. There are also disorganized attachment states related to traumatic events. Those with attachment avoidance tend to be distrustful and less likely to seek psychotherapy. A meta-analysis by Levy and colleagues (2011) of 19 studies including 1467 clients found that attachment security was associated with good psychotherapy outcomes and attachment anxiety was negatively associated with good outcomes. No relationship was found for attachment avoidance and outcomes. Diener and Monroe (2011) conducted a separate meta analysis on attachment and therapeutic alliance which included 17 studies with 886 clients. They found that clients with secure attachments had better alliances with their therapist and those with insecure attachments (anxious or avoidant) had weaker alliances.

Practice Implications

The research is clear that client attachment style influences how clients enter therapy, engage with the therapist, and experience outcomes. Attachment style likely affects specific therapy behaviors like self-disclosure and amount of exploration. In his book Attachment and Psychotherapy, David Wallin (2007) translates attachment theory into a framework for adult psychotherapy by tailoring interventions to specific attachment styles. For example, clients with greater attachment anxiety may do better in psychotherapy when the therapist: helps with down regulation of client emotional experiences, behaves in a way that does not evoke client fears of abandonment or loss, and helps clients improve reflective functioning by encouraging a thoughtful appraisal of their behaviors. On the other hand clients with greater attachment avoidance may require a therapist who: slowly introduces the client to greater attention to emotional experiences, does not demand too much from the client in terms of closeness in therapy at the outset, and encourages reflective functioning by helping the client understand the association between defensive avoidance of affect and relationship problems.

Lambert, M. J. (2012). Helping clinicians to use and learn from research-based systems: The OQ-analyst. Psychotherapy, 49(2), 109.

One of the more interesting and clinically relevant trends in psychotherapy research and practice in the past 10 years is the emergence of research on continuous progress monitoring. Continuous progress monitoring occurs when a patient is given a standardized self report measure before a session and the results of patient functioning are fed back to the therapist. (This is distinct from a clinician asking a patient for a verbal account of how he or she is doing this week). The standardized self report assessment is often done repeatedly, sometimes before every session or every fixed number of sessions. Measures, such as the Outcome Questionnaire (OQ) for adults or youths, was specifically designed for this purpose. The OQ assesses symptoms, interpersonal functioning, and life functioning, and clients are identified as improving (i.e., on course), or at risk of deteriorating. Recently, a small meta analysis of 3 to 4 studies representing 454 to 558 clients on the effects of progress monitoring found a moderate relationship between monitoring plus feedback and client outcomes. The method is particularly effective in changing the course of outcomes for patients who are deteriorating. Large research reviews of evidence based treatments in randomized controlled trials show that about 40% to 60% of patients improve or recover from psychotherapy, 30% to 50% may not benefit, and 3% to 14% deteriorate (see my March 2013 blog). These proportions are likely less positive in everyday practice in which clients are not highly screened to meet research inclusion criteria. Unfortunately, clinicians’ views of their own client outcomes are unrealistically positive. In one survey, clinicians in routine practice reported that about 85% of their clients improved or recovered. About 90% of therapists rated themselves in the upper quartile and none rated themselves as below average (50^th percentile). Also there is serious doubt about the ability of clinicians to identify clients during the course of therapy, who ultimately deteriorate. In the paper by Lambert on the use of the Outcome Questionnaire (OQ), he reviewed several studies on continuous progress monitoring in everyday practice. Each therapist was asked to practice as they routinely do with half their usual caseload. With the other half of their caseload clients completed the OQ and the therapist received feedback before every session about patient progress. The feedback did not make a difference for clients who made steady progress (i.e., on track) from week to week. However, continuous progress monitoring did make a difference for the 20% to 30% who showed some sign of deteriorating at some point in treatment. Notifying therapists that these patients were in trouble reduced the rate of deterioration from 20.1% to 5.5%, and monitoring and feedback increased positive outcomes from 22.3% to 55.5%.

Practice Implications

Lambert reported that clinicians in these “practice as usual” studies were initially skeptical but quite surprised at the outcomes related to continuous progress monitoring. Standardized assessments appear to get around the problem of clinician over-estimation of their patients’ positive outcomes. Clinicians were able to more accurately identify clients at risk of deteriorating likely resulting in the therapist doing something different to forestall the negative consequences. Lambert argues that it is in the best interest of at-risk patients to have their symptoms, interpersonal functioning, and life functioning formally monitored throughout treatment. However, clinicians are likely to resist doing so because they believe that they are already highly successful, and even more so than the typical outcomes produced by clinical trials. Formal monitoring of client outcomes has little downside for clinicians (it is inexpensive and requires little training), and it has many upsides for clients, especially those who are at risk for deteriorating.

Author email: michael_lambert@byu.edu