Dodo bird verdict

The Dodo bird verdict (or Dodo bird conjecture) is a controversial topic in psychotherapy, referring to the claim that all psychotherapies, regardless of their specific components, produce equivalent outcomes, as with The Dodo character of Alice in Wonderland. The conjecture was introduced by Saul Rosenzweig in 1936, drawing on imagery from Lewis Carroll's novel Alice's Adventures in Wonderland, but only came into prominence with the emergence of new research evidence in the 1970s.^[1]

The importance of the continuing debate surrounding the Dodo bird verdict stems from its implications for professionals involved in the field of psychotherapy and the psychotherapies made available to clients.

History

Carroll, Lewis, "Chapter 3: The Caucus Race and a Long Tale", Alice's Adventures in Wonderland, Everybody has won, and all must have prizes .

The Dodo bird verdict terminology was coined by Saul Rosenzweig in 1936 to illustrate the notion that all therapies are equally effective.^[2][3][4][5] Rosenzweig borrowed the phrase from Lewis Carroll's 1865 book, Alice in Wonderland, wherein a number of characters become wet and, in order to dry themselves, the Dodo Bird decided to issue a competition: everyone was to run around the lake until they were dry. Nobody cared to measure how far each person had run, nor how long. When they asked the Dodo who had won, he thought long and hard and then said, "Everybody has won and all must have prizes." In the case of psychotherapies, Rosenzweig argued that common factors were more important than specific technical differences, so that (on the Dodo bird conjecture) all therapies are winners; they all produce equally effective outcomes.^[1]

The Dodo bird debate only took flight in 1975 when Lester Luborsky, Barton Singer and Lise Luborsky reported the results of one of the first comparative studies demonstrating few significant differences in the outcomes among different psychotherapies.^[4] This study spurred a plethora of new studies in both opposition to and support of the Dodo bird verdict.^[6]

The Dodo bird debate, in brief, is focused on whether or not the specific components of different treatments lead some treatments to outperform other treatments for specific disorders. Supporters of the Dodo bird verdict contend that all psychotherapies are equivalent because of "common factors" that are shared in all treatments (i.e., having a relationship with a therapist who is warm, respectful, and has high expectations for client success).^[7][8] In contrast, critics of the Dodo bird verdict would argue that the specific techniques used in different therapies are important, and all therapies do not produce equivalent outcomes for specific disorders.

Support

Common factors theory states that if certain therapies in psychology are equally effective, it is because of the common factors they share. The most important causal agents in treatment are the common factors; the specific techniques that are unique to treatment strategies have only minor importance.^{[9][10][11][12][13]}

There is research to support common factors theory. One common factor is the client–therapist interaction, also known as the therapeutic alliance. A 1992 paper by Lambert showed that nearly 40 percent of the improvement in psychotherapy is from these client–therapist variables.^[14] Other researchers have further analyzed the importance of client–therapist variables in treatment. They found that improvement in the patient was due to extra-therapeutic factors, for example patients' thought processes. Data shows that patients with more positive attitudes will have a better chance of experiencing clinical improvement, regardless of the therapist's actions.^[3][4][15] Furthermore, in a meta-analysis of many studies of psychotherapy, Wampold et al. 2002, found that 7% of the variability in treatment outcome was due to the therapeutic alliance whereas 1% of the variability was due to a specific treatment.^{[16][17][18][19]} The therapist's attitude is also a very important causal agent in positive patient change. Najavits and Strupp (1994) demonstrated that a positive, warm, caring, and genuine therapist generated statistically significant differences in patient outcome.^[20] Wampold et al. 2002, also found that nearly 70% of the variability in treatment outcome was due to the therapist's attitude toward the efficacy of the treatment.^[16] Specific components of therapy are concluded to be relatively frivolous when compared with the more profound and directly patient affecting common factors.

Researchers have studied common factors in detail. Grencavage and Norcross (1990) identified 35 common factors in published sources.^[21] The identified common factors were categorized into five main groups: client characteristics, therapist qualities, change processes, treatment structures and relationship elements. Examples of some of the common factors included within these broad categories are persuasion, a healing setting, engagement, the use of rituals and techniques, suggestion, and emotional learning. Tracey et al. 2003, examined deeper relationships among the categories and common factors. They concluded that there are two dimensions of therapy: feeling and thinking. Within each of the two dimensions are three clusters: bond, information, and role.^[22]

Data provide evidence for the Dodo bird verdict.^[23] Generally speaking, common factors are responsible for patient improvement instead of any component of a specific treatment.^[8][23] Researchers such as Wampold and Luborsky continue to support this claim in recent articles published in the Behavioral Therapist. Wampold et al. 2010 refutes claims made by Siev et al. 2009 that Wampold 2009 made errors in research. Wampold et al. 2009, suggests that people need to "accept the importance of the alliance and therapists and remain committed to developing and improving treatments."^[23] Wampold continues by saying that techniques could be beneficial in psychotherapy because they are the easiest variables to manipulate. These variables can act to change alliance and other common factors. Common factors can then be closely monitored and carefully distributed to patients via the therapist.^[23]

Some researchers have pointed out that there are many reasons to study common factors among different psychotherapies, and some of those reasons may have nothing to do with the Dodo bird verdict.^[24] Regardless of whether or not certain psychotherapies are roughly equally effective, studying the commonalities among treatments can lead to a better understanding of why the treatments are effective.^[24]

Opposition

In opposition to the Dodo bird verdict, there are a growing number of studies demonstrating that some treatments produce better outcomes for particular disorders when compared to other treatments.^[25][26] Here, in contrast to the common factor theory, specific components of the therapy have shown predictive power.^[27][28][29] The most compelling evidence against the Dodo bird verdict is illustrated by the research done on anxiety disorders. Many studies have found specific treatment modalities to be beneficial when treating anxiety disorders, specifically cognitive behavioral therapy (CBT).^[30][31] CBT uses techniques from both cognitive therapy and behavioral therapy to modify maladaptive thoughts and behaviors.^[32][33][34] Numerous meta-analyses have shown that CBT yields significantly superior results in the treatment of psychological disorders, most notably, anxiety disorders. However, CBT also plays a positive role in treating depression, eating disorders, substance abuse disorders, and obsessive-compulsive disorder.^{[35][36][37][38][39][40][41]} In meta-analytic reviews, there is generally a larger effect size when CBT is used to treat anxiety disorders. Recent studies show that when treating generalized anxiety disorder, CBT generated an effect size of 0.51, which indicates a medium effect. That is a much larger effect compared to supportive therapy and other treatments.^[36][37] Similarly, when treating social anxiety disorder, CBT produced an effect size of 0.62, which again supports the evidence that CBT does in fact yield significantly better results than other therapies.^[36][42] Those supporting the Dodo bird verdict often use meta-analyses to compare multiple evidence supported treatments (ESTs) in order to illustrate that these treatments have no really significant differences. Because these treatments are already proven to work, comparing them to each other does show little variation. However psychology is made up of more therapies than just ESTs. When comparing a therapy like CBT to a treatment that does not meet EST criteria, the difference in effect size is obvious. Research showing differences among different treatments for specific disorders is now reflected in the latest EST guidelines.^[29] ESTs are developed from multiple control trial tests to evaluate which therapies yield the best results for specific disorders. These disorders include, but are not limited to, major depressive disorder, anxiety disorder, panic disorder, and OCD.^[29][43] According to the Ethics Code of the American Psychological Association (APA), psychologists and therapists have an obligation to avoid harming their clients in any way.^[43][44] ESTs are a major component in this movement. By using specific therapies clinically proven to improve certain disorders, therapists are avoiding further damage to their patients. However, supporting the idea of ESTs inevitably implies that some therapies are in fact more efficacious than others for particular disorders.^[45]

There is also research suggesting that some treatments might be harmful. Indeed, "if psychotherapy is powerful enough to do good, it may be powerful enough to do harm," as well.^[46] Some psychotherapies can be labeled as unhelpful, while others fall under the category of harmful. Unhelpful treatments are those that give no assistance while harmful therapies are actually damaging or dangerous to the patient.^[46] When identifying a "harmful" treatment it is important to note the distinction between "harm that can be caused by a disorder and harm that can be caused by the application of a treatment,"^[46] The negative outcomes of some psychotherapies are becoming an alarming reality in the field of clinical psychology.^[47][48] Studies have shown that individuals exhibited negative responses to treatment in some substance abuse work,^[43] and some types of grief therapy,^[46][49] and certain therapeutic techniques with trauma and PTSD patients.^[46][50][51] While those studies that support the Dodo bird verdict focus on the importance of building a client–therapist relationship, some studies have "identified a number of other relationship factors that may interfere with or negatively impact therapeutic change".^{[47][52][53][54]} The emerging evidence to the effect that there are possibly harmful psychotherapies is not only contradictory to the "all therapies are equal" stance of the Dodo bird verdict, but may also point out problems implicating the APA's Code of Ethics. Many meta-analyses show that there are treatments that do yield more positive outcomes for specific disorders. However, proof that some treatments actually harm patients instead of helping them further erodes support for the Dodo bird verdict.

Issues in testing

A considerable amount of the controversy about the Dodo bird verdict relates to the meta-analytic methods used in research.^[55] These generate a lack of clear psychotherapeutic evidence for the support of either side in the debate.^[55] Meta-analytic studies have compared the effect sizes of different treatments, but have not been reliable in finding a consistent effect size.^[6] This could be because of several confounding variables. For example, many researchers are said to "have an agenda" when conducting meta-analyses, cherry-picking experiments they want to use in their study in order to produce the results they want. This pre-determined skewing results in unfair representations of the research.^[56] "Agenda"-based meta-analyses are confounded with the researcher's political, social, and economical opinions. Since psychologists are given the power to choose which studies are used in a meta-analysis, personal biases are involved, and the meta-analysis will produce biased results if the researcher is not careful in controlling for his or her own opinions.^[57]

Researchers opposing the Dodo bird verdict have found Dodo bird supporters' meta-analyses to be "agenda"-based and highly subjective.^[56] Arguments have proposed that meta-analyses could possibly produce misleading results because of the type of studies combined in the comparison.^[58][59][60] In Paul Crits-Christoph's review of Wampold et al.'s (1997) comparative study, a work that supported the Dodo bird verdict, he concluded that out of the 114 articles used in the study, 79 of them involve similar comparative tests.^[61] Some meta-analyses constructed are not sensitive to the subtle distinctions between treatment effects, especially among comparative studies of highly similar treatments.^[58][62][63]

Dodo bird supporting researchers have found anti-Dodo bird supporters' research to also be "agenda"-based. For example, Wampold (2009) found Siev et al.'s (2007) study whose research for significance of CBT (Cognitive Behavior Therapy) versus RT (Rational Therapy) was resting on one experiment with an uncharacteristically large effect size (1.02) by Clark et al. (1994).^[23] Wampold found this effect size to be invalid because of the internal biases of the study. When this flawed experiment was removed from the analysis, the effect size was not statistically significant for the use of CBT over RT in panic disorder therapy. Against this research, in support of the anti-Dodo bird verdict, Chambless (2002) stated that "errors in data analysis, exclusion of research on many types of clients, faulty generalization to comparisons between therapies that have never been made, and erroneous sorts of treatments for all sorts of problems can be assumed to represent the difference between any two types of treatment for a given problem."^[64]

Clearly, if meta-analyses are to be taken seriously, they need to be conducted carefully and objectively. In support of the anti-Dodo bird side, Hunsley (2007) says that when "measurement quality is controlled for and when treatments are appropriately categorized, there is consistent evidence in both treatment outcome and comparative treatment research that cognitive and behavioral treatments are superior to other treatments for a wide range of conditions, in both adult and child samples."^[55] This suggests that if and when variables are controlled, there is appreciable evidence for the superiority of cognitive and behavioral treatments.

Importance

The outcome of the Dodo bird debate has extremely important implications for the future of clinical psychology. For one, policymakers have to know how effective each existing psychotherapy is in order to be able to decide which therapies should be supported. This controversy may also lead governmental officials to cut funding for psychological treatments and other public health measures^[65][66][67]

Perhaps the greatest illustration of the current state of the Dodo bird verdict is seen in the meta-analyses of Wampold and Barlow and the responses to it. In these meta-analyses, researchers on both sides point out the weaknesses and inconsistencies in their opponents' positions. Although both sides are trying to improve psychology in their respective ways, the disagreement about and lack of consistent evidence for the Dodo bird verdict may in fact be the cause of increased public doubt about the field. The conclusion of the debate could nationally dictate which therapists and which procedures will remain financially supported. For example, if the Dodo bird verdict is thought to be true regarding different psychotherapies, then many clinicians would feel free to use any therapy they see fit to employ. However, if the Dodo bird verdict is proven to be false, then clinicians would likely have to use empirically supported therapies when treating their clients.

Fuelling the debate have been alternative visions or paradigms of mental illness. Those believing in a medical model of mental illness and cure see the Dodo bird verdict as necessarily untrue – even absurd – whatever the evidence supporting it.^[9] Those who see therapy as context-based – as relying on a shared frame of reference or context between client and therapist for optimum results^[1] – will almost equally automatically welcome the Dodo bird verdict.^[9]

See also

References