Blog

Falkenström, F., Grant, J., & Holmqvist, R. (2016): Review of organizational effects on the outcome of mental health treatments. Psychotherapy Research, DOI: 10.1080/10503307.2016.1158883

Many psychotherapists treat patients within organizational contexts. These contexts might include university clinics, hospitals, primary care centers, community health centers, or even shared or group private practices. Psychotherapy researchers are often concerned with patient outcomes and predictors of outcomes like patient, therapist, or relationship variables. However, rarely do psychotherapy researchers consider the effects of the larger organizational context within which the psychotherapy is provided. On the other hand, many organizational psychology researchers are interested in organizational culture and management practices but seldom link these directly to patient outcomes. Is there an effect of the organizational context (i.e., culture and climate) on patient outcomes, and can we understand its effects in order to improve outcomes? Falkenstrom and colleagues review this literature. Organizational culture refers to shared norms, beliefs, and expectations in an organization or unit. These can be affected by hierarchical structure (i.e., perceived power differences between professions), managerial principles and styles (e.g., rigid vs lax styles, supportive and active vs undermining, micro-managing, or disengaged), and by technology. Various organizations appear to engender different cultures such that the staff can be more or less committed to the organization strategies and to the work itself. This is the basis of the well known expression: “culture eats strategy for breakfast”. Organizational climate refers to the overall sense of psychological security in a work environment. This may have an impact on workers’ attitudes and performance, and may also affect their willingness to report errors and to problem solve. In their review, Falkenstrom and colleagues found only 19 studies that directly assessed the effects of organizational context on patient mental health outcomes. Differences between organizations appeared to account for between 6% and 60% of patient outcomes. This is a very wide range that may be the result of many differences between studies (i.e., different patient populations, different definitions of outcomes, different definitions and measurements of organizational variables, etc.). However, even at 6%, this represents what most researchers would call a medium and meaningful effect. For example, Falkenstrom and colleagues reviewed specific studies and found that organizational climate (i.e., low conflict, low emotional exhaustion, and high cooperation and job satisfaction) were related to better psychosocial functioning in children placed in state custody. Several other studies showed that high staff turnover, low levels of support from leadership, and low mutual respect among professionals was associated with poorer mental health outcomes for a variety of patient populations. One study found that an intervention to improve organizational culture and climate resulted in improving mental health outcomes among children and adolescents.

Practice Implications

There are surprisingly few studies that look at the relationship between organizational culture and patient outcomes. Although limited, most of the studies point to the effects of organizational culture and climate on staff and on patient outcomes. With increased emphasis on quality control in mental health care, it makes sense for managers, practitioners, researchers and patient groups to carefully consider an organization’s managerial practices, leadership, culture, and climate when looking to improve patient outcomes.

Crawford, M.J., Thana, L., Farquharson, L., Palmer, L., Hancock, E.... Parry, G.D. (2016). Patient experience of negative effects of psychological treatment: results of a national survey. British Journal of Psychiatry, 208, 260-265.

There is lots of evidence that psychotherapy is effective for a wide variety of disorders. However, a number of studies report that between 5% and 10% of patients report higher levels of symptoms following treatment compared to when they started. Although the side effects and negative outcomes in pharmacological treatment studies are routinely reported, negative outcomes in psychological treatment studies are rarely reported and investigated. In this very large survey, Crawford and colleagues analysed data from an audit of state funded psychological therapies for depression and anxiety in England and Wales. Adult patients from 220 centers were invited to complete an anonymous service-user questionnaire that asked about their experiences of the processes and outcomes of psychotherapy. Some of the questions asked if clients experienced a “lasting bad effect” from the treatment. Nearly 15,000 individuals responded to the survey. More than half (51%) were treated with cognitive behavioral therapy, and most clients received only one treatment, which was predominantly individual therapy. Most (74.35%) received fewer than 10 sessions. Of the respondents, 763 (5.23%) reported that therapy had a “lasting bad effect”, and an additional 7.70% were “unsure” whether they experienced a lasting bad effect. People over 65 years old were less likely to have a lasting negative effect, and those from minority ethnic groups and non-heterosexuals were more likely to report lasting bad effects. In addition, those who did not know what type of therapy they received were more likely to have lasting bad effects.

Practice Implications

A substantial minority of patients reported lasting negative effects from their psychological treatment. With approximately a million Canadians receiving outpatient psychological treatment of one form or another each year, these findings imply that thousands of patients could have experienced a lasting negative effect. The findings suggest that psychotherapists need to be highly sensitive to cultural and ethnic minority issues and acquire cultural competence. The same is true when treating non-heterosexuals. Clinicians should also make sure to provide sufficient information to patients about the type of treatment they are receiving as part of the informed consent process. Attending to these issues may reduce the likelihood of therapeutic alliance ruptures that may be related to lasting negative effects.

Werbart, A., Von Below, C., Brun, J., & Gunnarsdottir, H. (2015). “Spinning one’s wheels”: Nonimproved patients view their psychotherapy. Psychotherapy Research, 25, 546-564.

The rate of patients who experience no change after receiving psychotherapy is about 35% to 40% in clinical trials. Further, about 5% to 10% get worse after treatment. So, in spite of the fact that psychotherapy is effective in general, a sizeable minority of patients do not benefit. There is also evidence that patients’ perception of therapy differs greatly from their therapists’. Therapists are often inaccurate in identifying or predicting patient outcomes, and patients’ judgements tend to better correspond with treatment outcomes. In this study, Werbart and colleagues evaluated outcomes of 134 patients who had elevated symptoms. The average age of patients was 22.4 years (range 18 – 26), so many were young adults. Almost all received a diagnosis ranging from depressive disorders, anxiety disorders, or personality disorders. The predominant treatment was psychoanalytic. Of the 134 patients, many experienced large improvements by the end of treatment. However, 20 patients remained clinically distressed and did not improve or deteriorated after receiving psychotherapy. The authors interviewed these 20 patients at termination and at three-year follow-up using a semi-structured interview. The interview asked patients for their experiences of therapy. The researchers transcribed the interviews and coded the transcripts using a known method of qualitative analysis called “grounded theory”. Three main themes related to poor outcomes were identified by these patients. (1) The therapy or therapist – in which: therapists were perceived by patients as passive or reticent, patients felt distant from the therapist, and patients did not understand the therapy method. (2) Outcomes of therapy – in which: the patient expected more from therapy, and symptoms and emotional problems remained in the “impaired” range at the end of treatment. (3) The impact of life circumstances – referring to negative impacts of events outside of the therapy.

Practice Implications

This is a small but unique study that interviewed patients who did not benefit from psychotherapy about their experiences of the treatment and therapist. Nonimproved patients described their therapist generally as too passive, distant, and uninvolved in the work of therapy. These patients described difficulty understanding the therapeutic method and the nature of the therapeutic relationship. The findings highlight the importance of the therapeutic alliance. To have a good alliance, patients and therapists have to agree on the tasks of therapy, agree on the goals that the therapy should achieve for the patient, and there should be a mutual liking or bond between patient and therapist. Those patients whose therapists pay attention to and foster a good alliance are more likely to experience good outcomes.

Wampold, B.E. & Imel, Z.E. (2015). The great psychotherapy debate (2^nd ed.). New York: Routledge.

The Great Psychotherapy Debate: Starting in April, 2015 I review parts of The Great Psychotherapy Debate (Wampold & Imel, 2015) in the PPRNet Blog. This is the second edition of a landmark, and sometimes controversial, book that surveys the evidence for what makes psychotherapy work. You can view parts of the book in Google Books

In the concluding chapter of their book, Wampold and Imel discuss the evidence and strategies that therapists can use to improve patient outcomes. As indicated in previous PPRNet Blogs, Wampold and Imel concluded that the differences between specific treatment approaches is small. In other words, Wampold and Imel argue that there is no good evidence that one bona fide psychotherapy is more effective than another for most disorders. By “bona fide” treatments, they mean psychotherapy that: provides the client with a plausible theory/explanation of the disorder, delivers a structured intervention based on the plausible theory, and is offered by an effective therapist. The authors also found that contextual factors (e.g., therapeutic alliance, therapist empathy, client expectations) accounted for a sizeable proportion of patient outcomes. A key element in this understanding of effective therapy is the role of the therapist. The authors reviewed various studies and meta analyses that showed that therapists differ widely in their outcomes and in their ability to establish a therapeutic alliance. Unfortunately, therapists tend to be overly-optimistic about their clients’ outcomes. Therapists often do not have quality data on their clients’ progress, and the complexities of the therapeutic work makes it difficult for therapists to keep in mind all aspects of the therapy that is helpful or not helpful to clients. For example, some therapists may be good at establishing an alliance, but they may not be so good at providing a viable treatment structure. Other therapists may be highly empathic with clients who have moderately severe symptoms, but the same therapists may not respond as empathically with more difficult clients. Outcome or process monitoring (i.e., providing therapists with reliable information about the ongoing status of patient symptoms or about the quality of the therapeutic relationship) provides an evidence-based aid in helping therapists to improve their clients’ outcomes.

Practice Implications

Regardless of the type of psychotherapy they use, therapists are responsible for achieving good outcomes for their clients. This includes continually developing therapeutic skills over time. There is some evidence that a reflective attitude towards one’s psychotherapy practice is helpful. Unfortunately, therapists may not be continually improving or reflecting on their practice. This is indicated by research showing that trainees and interns appear to be as competent as experienced clinicians. Therapists need quality information about their clients in order to improve their own practice and clients’ outcomes. But psychotherapy practice is complex, the therapeutic relationship is multifaceted, and clients are variable in their presenting issues and life experiences. All of these make it difficult for any therapist to make accurate decisions in therapy. Progress or process monitoring (i.e., continually measuring outcomes and relationship processes with a psychometrically valid instrument), may be one way for therapists to receive high quality feedback about patient progress in order to improve their psychotherapy practice.

Gilbody, S., Littlewood, E., Hewitt, C., Brierley, Tharmanathan, P....White, D. (2015). Computerised cognitive behaviour therapy (cCBT) as treatment for depression in primary care (REEACT trial): Large scale pragmatic randomised controlled trial. BMJ, 351, h5627. Doi: 10.1136/bmj.h5627.

Depression is one of the most common reasons why people see family physicians for consultation. The personal and economic burden of depression is high, such that depression is the leading cause of disability worldwide. Effective treatments for depression include antidepressant medications and psychotherapy. Cognitive behavioral therapy (CBT) is an effective treatment for depression, but is not always accessible for those who live in remote areas, and for those who cannot easily find or afford a trained psychotherapist. One solution, touted by some is to provide computerized CBT (cCBT) via internet or CD. In fact, the National Institute for Health and Care Excellence (NICE) in the UK recommend cCBT programs as a first step of care for depression. Commercially available cCBT programs include “Beating the Blues”, and freely available programs include “MoodGYM”. Previous research shows a large effect of cCBT for reducing depressive symptoms, but non-adherence (i.e., not completing the modules) and patient dropout rates tend to be high. Another issue is that most of the studies of cCBT were conducted by the developers of the programs, and so there may be researcher allegiance effects that could bias the findings. In this large trial, Gilbody and colleagues asked: “How effective is supported computerized cognitive behavior therapy (cCBT) when it is offered in addition to usual primary care in adults with depression?” The authors recruited 691 depressed patients seen in primary care with a general practitioner (GP) in the UK. All participants had access to a computer and high speed internet. The participants were randomly assigned to receive: (1) usual GP care plus 8 50-minute sessions of Beating the Blues, or (2) usual GP care plus 6 weekly modules of MoodGYM, or (3) only usual GP care. Usual GP care included providing antidepressants, counselling, or brief psychotherapy which are all offered as part of the UK National Health Service. Computerized CBT was supported by weekly telephone calls followed by reminder emails to encourage participants to access, use, and complete the programs. At 4 months after the start of treatment, about half of all participants were no longer depressed, and there were no differences between the three study conditions on any of the outcomes (e.g., depression, quality of life). The results were consistent up to 2 years post treatment. However, only about 17% of those receiving one of the cCBT treatments completed all of the sessions. The average number of sessions completed of cCBT was very low (Beating the Blues = 2 out of 8 sessions; MoodGYM = 1 out of 6 sessions). The authors concluded that there was no significant benefit of adding supported cCBT to usual GP care.

Practice Implications

Adding cCBT to usual GP care did not provide added benefit to depressed patients. Low adherence and low engagement with cCBT likely reduced the utility of computerized delivery of therapy. It is possible that more intensively supported cCBT (i.e., with weekly face to face contacts) might have improved the added value of cCBT, but would also have reduced the practically utility and accessibility of cCBT. Those who are depressed might have difficulty with summoning the energy and concentration necessary to repeatedly log on to computers and engage in computerized or internet based treatment.

Tritt, A., Kelly, J., & Waller, G. (2015). Patients’ experiences of clinicians’ crying during psychotherapy for eating disorders. Psychotherapy, 52(3), 373-380.

Psychotherapy can be an emotionally intensive experience for both patients and therapists. In a large survey, more than 70% of therapists reported having cried in therapy, and 30% cried during the past month. Therapists who cried almost always saw the experience as positive or neutral (99.2%) for the patient and the therapeutic relationship. Do clients feel the same way about therapists who cry? In this study, Tritt and colleagues surveyed 188 adult patients with an eating disorder who were recently in psychotherapy. Of those, 107 (56.9%) reported that their therapist had cried during therapy. There was no association between frequency of therapist crying and therapist age, patient diagnosis, or type of psychotherapy (i.e., manual-based or not). Therapists who cried a moderate amount were seen by clients as having a positive demeanor (i.e., happy, firm, consistent), whereas therapists who cried more extremely were rated by clients as having a more negative demeanor (i.e., anxious, angry, bored). If therapists who cried were generally perceived by clients to have a positive demeanor, then therapist crying had a positive impact on therapy. That is, clients reported a greater respect for the therapist, greater willingness to express emotions, and higher willingness to undertake therapy in the future. However, if therapists who cried were generally perceived by clients to have a negative demeanor, then therapist crying had a negative impact on therapy. That is, clients were less willing to express emotions in therapy and to undertake therapy in the future. Further, if the therapist who cried was rated as having a negative demeanor, the client experienced more self blame, assumed that there was something wrong in the therapist’s life, and that the therapist and client did not share the same perspective on the client’s life and treatment.

Practice Implications

This small but unique and interesting survey sheds some light on clients’ experiences of therapists who cry during therapy. More than half of clients experienced their therapist crying during therapy. In contrast to surveys of therapists who tend to evaluate therapist crying as exclusively positive or neutral, this survey found that many but not all clients experienced therapist crying as positive. It depends on how the client perceives the therapist as a person. Therapists who are seen by clients as happy, firm, and consistent may assume that patients will experience their crying as a positive indicator of the therapeutic relationship. However, therapists who are seen by clients as anxious, bored, or angry cannot assume that clients will see their tears as being positive for therapy.