Blog

The Psychotherapy Practice Research Network (PPRNet) blog began in 2013 in response to psychotherapy clinicians, researchers, and educators who expressed interest in receiving regular information about current practice-oriented psychotherapy research. It offers a monthly summary of two or three published psychotherapy research articles. Each summary is authored by Dr. Tasca and highlights practice implications of selected articles. Past blogs are available in the archives. This content is only available in English.

August 2016

Psychotherapy That is Culturally Congruent for Chinese Clients

Xu, H. & Tracey, T.J.G. (2016). Cultural congruence with psychotherapy efficacy: A network meta-analytic examination in China. Journal of Counseling Psychology, 63, 359-365.

Cultural congruence refers to providing psychotherapy that is consistent with the client’s cultural context in its description of the etiology of symptoms and in its therapeutic procedures. In general, congruence of treatments with clients’ expectation, preferences, and beliefs is related to greater psychotherapy efficacy. And specifically identifying culturally appropriate or adapted treatments is important because this is often related to better therapy outcomes for ethnic and racial minorities. Psychotherapy as a professional practice developed recently in China. Cognitive-behavioral, existential-humanistic, and psychodynamic therapies have taken their place along side indigenous therapies including Naikan therapy, Taoism cognitive therapy, and Morita therapy. Historically in China mental health problems were seen as a disturbance in ying-yang or a sin committed in a previous life. Healing practices included engaging in altruism or religious practices to achieve redemption. Xu and Tracey argue that Chinese culture strongly endorses an experiential and subjective orientation and is less aligned with analytic and objective orientations. Using this understanding, the authors expected that experiential-humanistic and indigenous therapies would be more congruent and therefore more effective than cognitive-behavioral education or psychodynamic therapy in alleviating mental health issues. In this meta analysis, Xu and Tracey reported on 235 studies conducted in China that compared the various treatments to a control condition or to each other. There were too few studies of psychodynamic therapy, so it was not included in the analyses. All treatments were effective compared to a control condition with large effect sizes (g = .85 to 1.18). However, whereas experiential-humanistic and indigenous therapies were equally effective, each was significantly more effective (g = .34) than cognitive-behavioral psychoeducation.

Practice Implications

The three modalities, experiential-humanistic, indigenous, and cognitive-behavioral psychoeducation were effective. However the two therapies that were more experiential and subjective in nature were more effective to reduce Chinese clients’ symptoms. When working with Chinese clients, therapists may achieve better outcomes if they work on more experiential components (e.g., feelings and therapeutic relationship) and focus on subjective experiences (e.g., introspection and reflection). The results of the meta analysis suggest that when working with Chinese clients interpersonal processes and emotions should be the clinical focus and take priority over dysfunctional cognitions and psychoeducation.

May 2016

Does Organizational Context Have an Effect on Patient Outcomes?

Falkenström, F., Grant, J., & Holmqvist, R. (2016): Review of organizational effects on the outcome of mental health treatments. Psychotherapy Research, DOI: 10.1080/10503307.2016.1158883

Many psychotherapists treat patients within organizational contexts. These contexts might include university clinics, hospitals, primary care centers, community health centers, or even shared or group private practices. Psychotherapy researchers are often concerned with patient outcomes and predictors of outcomes like patient, therapist, or relationship variables. However, rarely do psychotherapy researchers consider the effects of the larger organizational context within which the psychotherapy is provided. On the other hand, many organizational psychology researchers are interested in organizational culture and management practices but seldom link these directly to patient outcomes. Is there an effect of the organizational context (i.e., culture and climate) on patient outcomes, and can we understand its effects in order to improve outcomes? Falkenstrom and colleagues review this literature. Organizational culture refers to shared norms, beliefs, and expectations in an organization or unit. These can be affected by hierarchical structure (i.e., perceived power differences between professions), managerial principles and styles (e.g., rigid vs lax styles, supportive and active vs undermining, micro-managing, or disengaged), and by technology. Various organizations appear to engender different cultures such that the staff can be more or less committed to the organization strategies and to the work itself. This is the basis of the well known expression: “culture eats strategy for breakfast”. Organizational climate refers to the overall sense of psychological security in a work environment. This may have an impact on workers’ attitudes and performance, and may also affect their willingness to report errors and to problem solve. In their review, Falkenstrom and colleagues found only 19 studies that directly assessed the effects of organizational context on patient mental health outcomes. Differences between organizations appeared to account for between 6% and 60% of patient outcomes. This is a very wide range that may be the result of many differences between studies (i.e., different patient populations, different definitions of outcomes, different definitions and measurements of organizational variables, etc.). However, even at 6%, this represents what most researchers would call a medium and meaningful effect. For example, Falkenstrom and colleagues reviewed specific studies and found that organizational climate (i.e., low conflict, low emotional exhaustion, and high cooperation and job satisfaction) were related to better psychosocial functioning in children placed in state custody. Several other studies showed that high staff turnover, low levels of support from leadership, and low mutual respect among professionals was associated with poorer mental health outcomes for a variety of patient populations. One study found that an intervention to improve organizational culture and climate resulted in improving mental health outcomes among children and adolescents.

Practice Implications

There are surprisingly few studies that look at the relationship between organizational culture and patient outcomes. Although limited, most of the studies point to the effects of organizational culture and climate on staff and on patient outcomes. With increased emphasis on quality control in mental health care, it makes sense for managers, practitioners, researchers and patient groups to carefully consider an organization’s managerial practices, leadership, culture, and climate when looking to improve patient outcomes.
Organizational Factors That Reduce Suicide Rates in the Population

Kapur, N., Ibrahim, S., While, D., Baird, A.,... Appleby, L. (2016). Mental health service changes, organisational factors, and patient suicide in England in 1997–2012: a before-and-after study. The Lancet Psychiatry.

Suicide is a major cause of death worldwide, and many recent public health efforts have focused on suicide prevention. Many studies have looked at social, psychological, and biological factors that may cause suicide, but few studies have examined the effects of health service contexts on suicide rates. In this large retrospective population-based study, Kapur and colleagues looked at over 19,000 suicides that occurred within England’s health services from 1997 to 2012. This represented 26% of all suicides in England. The researchers: evaluated economic climate, surveyed the clinic administrators and clinicians involved, and they reviewed policy, service, and staffing changes at each time point. Health care in England is organized nationally through the National Health Service, and the government also collected confidential survey data on deaths by suicide between 1997 and 2012. The researchers examined if specific policy changes and organizational factors affected suicide rates. Health system changes such as: (a) implementing the National Institute for Health and Care Excellence depression guidelines, (b) making available crisis and home treatment teams, (c) implementing policies on transfer from youth to adult care and (d) new procedures for managing patients with dual diagnosis were all associated with reduced suicide rates during the study period. One of the most interesting findings was that these changes to the treatment and management of depression, youth, crises, and dual diagnoses were much more effective in reducing suicide rates under two organizational contexts: (1) when non-medical staff turnover was low, and (2) when there was greater reporting of patient safety incidents. Lower staff turnover likely means that patients in those organizations received greater continuity of care and that suicidal or depressed patients were more likely to receive treatment from highly trained and experienced professionals. Greater reporting of patient safety incidents tend to occur in organizations in which the staff feels sufficiently safe and secure to report and discuss negative clinical events without fear of reprisal or punishment. Such reflective practice is likely critical to increasing staff expertise in providing psychological treatment.

Practice Implications

Psychotherapists often do not think about the organizational context within which they work when considering the treatment they provide to those with mental health issues including people who may attempt suicide. Yet many psychotherapists work within an organizational context (e.g., hospitals, group practices, clinics, community health care centers, etc.). The findings from this study indicate that stability in staffing (i.e. low turnover) and working within a system that encourages reporting and discussing negative events likely has a positive impact on mental health outcomes like suicide.

April 2016

Patient Experience of Negative Effects of Psychotherapy

Crawford, M.J., Thana, L., Farquharson, L., Palmer, L., Hancock, E.... Parry, G.D. (2016). Patient experience of negative effects of psychological treatment: results of a national survey. British Journal of Psychiatry, 208, 260-265.

There is lots of evidence that psychotherapy is effective for a wide variety of disorders. However, a number of studies report that between 5% and 10% of patients report higher levels of symptoms following treatment compared to when they started. Although the side effects and negative outcomes in pharmacological treatment studies are routinely reported, negative outcomes in psychological treatment studies are rarely reported and investigated. In this very large survey, Crawford and colleagues analysed data from an audit of state funded psychological therapies for depression and anxiety in England and Wales. Adult patients from 220 centers were invited to complete an anonymous service-user questionnaire that asked about their experiences of the processes and outcomes of psychotherapy. Some of the questions asked if clients experienced a “lasting bad effect” from the treatment. Nearly 15,000 individuals responded to the survey. More than half (51%) were treated with cognitive behavioral therapy, and most clients received only one treatment, which was predominantly individual therapy. Most (74.35%) received fewer than 10 sessions. Of the respondents, 763 (5.23%) reported that therapy had a “lasting bad effect”, and an additional 7.70% were “unsure” whether they experienced a lasting bad effect. People over 65 years old were less likely to have a lasting negative effect, and those from minority ethnic groups and non-heterosexuals were more likely to report lasting bad effects. In addition, those who did not know what type of therapy they received were more likely to have lasting bad effects.

Practice Implications

A substantial minority of patients reported lasting negative effects from their psychological treatment. With approximately a million Canadians receiving outpatient psychological treatment of one form or another each year, these findings imply that thousands of patients could have experienced a lasting negative effect. The findings suggest that psychotherapists need to be highly sensitive to cultural and ethnic minority issues and acquire cultural competence. The same is true when treating non-heterosexuals. Clinicians should also make sure to provide sufficient information to patients about the type of treatment they are receiving as part of the informed consent process. Attending to these issues may reduce the likelihood of therapeutic alliance ruptures that may be related to lasting negative effects.
Nonimproved Patients View Their Psychotherapy

Werbart, A., Von Below, C., Brun, J., & Gunnarsdottir, H. (2015). “Spinning one’s wheels”: Nonimproved patients view their psychotherapy. Psychotherapy Research, 25, 546-564.

The rate of patients who experience no change after receiving psychotherapy is about 35% to 40% in clinical trials. Further, about 5% to 10% get worse after treatment. So, in spite of the fact that psychotherapy is effective in general, a sizeable minority of patients do not benefit. There is also evidence that patients’ perception of therapy differs greatly from their therapists’. Therapists are often inaccurate in identifying or predicting patient outcomes, and patients’ judgements tend to better correspond with treatment outcomes. In this study, Werbart and colleagues evaluated outcomes of 134 patients who had elevated symptoms. The average age of patients was 22.4 years (range 18 – 26), so many were young adults. Almost all received a diagnosis ranging from depressive disorders, anxiety disorders, or personality disorders. The predominant treatment was psychoanalytic. Of the 134 patients, many experienced large improvements by the end of treatment. However, 20 patients remained clinically distressed and did not improve or deteriorated after receiving psychotherapy. The authors interviewed these 20 patients at termination and at three-year follow-up using a semi-structured interview. The interview asked patients for their experiences of therapy. The researchers transcribed the interviews and coded the transcripts using a known method of qualitative analysis called “grounded theory”. Three main themes related to poor outcomes were identified by these patients. (1) The therapy or therapist – in which: therapists were perceived by patients as passive or reticent, patients felt distant from the therapist, and patients did not understand the therapy method. (2) Outcomes of therapy – in which: the patient expected more from therapy, and symptoms and emotional problems remained in the “impaired” range at the end of treatment. (3) The impact of life circumstances – referring to negative impacts of events outside of the therapy.

Practice Implications

This is a small but unique study that interviewed patients who did not benefit from psychotherapy about their experiences of the treatment and therapist. Nonimproved patients described their therapist generally as too passive, distant, and uninvolved in the work of therapy. These patients described difficulty understanding the therapeutic method and the nature of the therapeutic relationship. The findings highlight the importance of the therapeutic alliance. To have a good alliance, patients and therapists have to agree on the tasks of therapy, agree on the goals that the therapy should achieve for the patient, and there should be a mutual liking or bond between patient and therapist. Those patients whose therapists pay attention to and foster a good alliance are more likely to experience good outcomes.

March 2016

Does Clinician Confidence Lead to Accurate Clinical Judgement?

Miller, D.J., Spengler, E.S., & Spengler, P.M. (2015). A meta-analysis of confidence and judgement accuracy in clinical decision making. Journal of Counseling Psychology, 62, 553-567.

People can make errors in judgements based on decision making rules that are biased. Clinicians also may be prone to making such errors. In their Nobel Prize winning work, Kahneman and Tversky outlined a number of heuristics (i.e., mental shortcuts) that lead to cognitive biases, which in turn affect accuracy of decisions. For example, when making a differential diagnosis clinicians may: rely too heavily on only one piece of information which may be the most available (e.g., “I vividly remember a patient with conversion disorder who had the same history”); or ignore that a particular event (e.g., conversion disorder) is very rare; or seek confirming rather than disconfirming evidence (e.g., the patient has PTSD symptoms that can explain some symptoms). Complicating these biases is the tendency for clinicians to be over-confident. For example, in one study the average psychotherapist rated their performance as better than 80% of their peers, and no therapist rated him or herself in the lower 50^th percentile among peers. In their meta analysis, Miller and colleagues reviewed 36 studies of the relationship between clinician confidence ratings and accuracy of decisions among 1,485 clinicians. The authors were particularly interested in the overconfidence bias, which occurs when individuals report higher confidence in their judgments than is warranted by their actual accuracy. For example, studies have assessed the impact of clinician confidence on clinical accuracy in: detecting random responding on a psychological test, diagnosing a brain disorder verified by medical test using neuropsychological test data, predicting future violence and recidivism in offenders, and patient progress in psychotherapy. Most studies find that clinicians are quite confident in their judgments. But, is this confidence warranted? Miller and colleagues’ meta analysis found a significant but small (r = .15) association between confidence and accuracy. This suggests that clinician confidence is only slightly indicative of decision-making accuracy. The effect was a little larger for more experienced clinicians (r = .25), indicating that more experience and training resulted in somewhat more consistency between a clinician’s confidence and their clinical accuracy. Further, higher confidence leads to poorer accuracy when clinicians have to make repeated decisions without feedback, when feedback is not written, and when an event is rare.

Practice Implications

Clinicians, like everyone else, are sometimes subject to making errors when they only look at confirming evidence, when they rely only on their own memory rather than objective data, and when they are over-confident. Accuracy can be increased when clinicians use decision-making aids that provide quality corrective feedback. Aids to help in decision making might include the use of: objective standardized test data, repeated measurements with feedback to assess patient progress in psychotherapy, and actively looking for disconfirming evidence before making a clinical judgement. As the authors conclude, confidence is not a good substitute for accuracy.

This month...

Type of Research

Topics

August 2016

Practice Implications

May 2016

Practice Implications

Practice Implications

April 2016

Practice Implications

Practice Implications

March 2016

Practice Implications

Psychotherapy Practice Research Network (PPRNet)