Skip to main content

REVIEW article

Front. Psychiatry, 26 June 2019
Sec. Psychological Therapy and Psychosomatics
This article is part of the Research Topic Placebo and Nocebo Effects in Psychiatry and Beyond View all 39 articles

Placebo Effects in Psychotherapy: A Framework

  • Psychosomatic Medicine and Psychotherapy, Department of Internal Medicine VI, University Hospital Tübingen, Tübingen, Germany

The issue of placebo response and the extent of its effect on psychotherapy is complex for two specific reasons: i) Current standards for drug trials, e.g., true placebo interventions, double-blinding, cannot be applied to most psychotherapy techniques, and ii) some of the “nonspecific effects” in drug therapy have very specific effects in psychotherapy, such as the frequency and intensity of patient–therapist interaction. In addition, different psychotherapy approaches share many such specific effects (the “dodo bird verdict”) and lack specificity with respect to therapy outcome. Here, we discuss the placebo effect in psychotherapy under four aspects: a) nonspecific factors shared with drug therapy (context factors); b) nonspecific factors shared among all psychotherapy traditions (common factors); c) specific placebo-controlled options with different psychotherapy modalities; and d) nonspecific control options for the specific placebo effect in psychotherapy. The resulting framework proposes that the exploration and enumeration of context factors, common factors, and specific factors contributes to the placebo effects in psychotherapy.

Historical Roots

Although the term “placebo” became commonplace medical language some time ago (1), it was not before the 1940s that placebo-controlled pharmacological trials became the standard in psychiatry and beyond (2). This rather restrictive use of the term for controlled trials was relinquished only recently in favor of a broader use in all therapeutic conditions, for differentiation between minimizing placebo effects in controlled trials, while maximizing it in daily routine (3, 4), and for harnessing the effect to improve the therapist–patient relationship (5).

Throughout this paper, we will use the terms “placebo effect” and “placebo response” (or “nocebo effect” and “nocebo response”) in accordance with a recent expert opinion of the placebo research community (4): Placebo effect refers to a distinctive psychobiological phenomenon, while placebo response refers to the outcome of clinical trials, the amalgam of responses after receiving a placebo—bias in reporting, regression to mean, possibly also Hawthorne effects, and placebo effects (6).

However, psychotherapy and the placebo response share a specific and delicate relationship.

A response to placebo was soon recognized as an indication of a psychological rather than of a somatic/medical condition (7). Two “roots” of this early placebo research can be identified:

a. In the early 1950s, Stewart Wolff described the mechanisms (conditioning, expectation) by which placebo effects occurred and were strong, particularly with somatic symptoms such as pain and nausea (8, 9). At the same time, in psychiatry, particularly high placebo effects were observed in randomized controlled trials (RCT) with drugs in depression, anxiety, etc. (10), and among other things, the severity of the illness, duration of treatment, and previous therapies were causing this effect (11) [for a survey, see Weimer et al. (12)].

b. Around the same time, Jerome D. Frank noted that patients’ and therapists’ expectations influenced the outcome of psychotherapy (13) and speculated that suggestions (but not motivation) may play a role, as may the duration of therapy, specific-patient characteristics (which he called placebo reactors), and side effects may eliminate it. To distinguish between specific and nonspecific effects, Frank called for clearly defined control groups in psychotherapy also, regardless of its theoretical orientation.

Little has been achieved experimentally since then with regard to exploring placebo effects in psychotherapy, although the therapeutic options available have increased dramatically: psychodynamic psychotherapy, cognitive behavioral therapy (CBT), hypnotherapy, interpersonal psychotherapy, group therapy, couple and family therapy, mindfulness-based therapy (MBT), self-help programs (SHPs), phone- and internet-based therapies, health interventions, e.g., smartphone apps, and the like. The general and specific placebo effects of all of these should be examined. In the following sections, we will argue that of the many factors regarded as “nonspecific” in drug RCT, some should be considered as being specific in psychotherapy, while others remain nonspecific under all circumstances. As with drug therapy, however, not all nonspecific factors are attributable to a placebo effect; since response biases, statistical regression to the mean and spontaneous symptom variation account for some of the effects involved in both the drug and the placebo aspect of trials and therefore also influence psychotherapy. This concept is illustrated in Figure 1.

FIGURE 1
www.frontiersin.org

Figure 1 Schematic relationship between shared and non-shared nonspecific factors contributing to the placebo response in drug and psychotherapy: factors that are part of the (nonspecific) placebo effect in drug therapy (e.g., therapist empathy, intensity of patient-therapist communication, etc.) become “common factors” across all psychotherapies [Rosenzweig’s “Dodo Bird” (1936), or Lambert and Ogles’ “common factors” (2004)], addition to a (small) specific effect of the different psychotherapy modalities that may be composed of a specific combination of the factors, as listed in Table 1.

While most of the older and many recent publications on the placebo effect in psychotherapy avoid determining the size of the placebo effect in psychotherapy (1418), unless they were claiming that the placebo concept cannot be applied to psychotherapy at all (15, 19), others argue that properly designed placebo (control) therapy may be as effective as psychotherapy (16). However, neither of these positions is helpful in planning a rational psychotherapy evaluation.

Instead, we will follow an argument raised by Blease (20, 21); according to which, there is general scientific consensus that the placebo concept exists, but unnecessary debate in placebo studies persists due to the failure to recognize this fact. In principle, the same underlying definitions for placebo response and placebo effect that apply in biomedical research interventions also apply to psychological interventions for which the concept “placebo” was not developed. The key difference lies in recognizing the serious challenges of placebo-controlled clinical trials for psychological treatments. It is therefore unnecessary to eliminate placebo concepts in psychological contexts, as proposed by Kirsch (15).

We will abstain from discussing the placebo concept of Grünbaum (22) for CBT for one simple reason: it was developed before the surge of empirical placebo research had begun in the 1990s (23) and thus cannot reflect current knowledge. Gaab (19) falls into the “Grünbaum trap” when arguing that psychotherapy is at risk of being misconstrued as “mere” placebo without such a discussion and that psychotherapists otherwise simply prescribe placebos. It is not without irony that Wampold (16) illustrates the concept with a contemporary drug example (antibiotics) but falls short (as do others) of explaining what contemporary “incidental constituents” of psychotherapy may be, adhering instead to Grünbaum´s 1986 definition.

A “Grünbaum trap” is what we call the outdated understanding of the placebo response in psychotherapy. It was developed as a seemingly timeless concept (applicable to all psychotherapies at all times, e.g., the “incidental constituents of psychotherapy” according to Grünbaum) when much of what determines the placebo response had already been identified, e.g., learning history and acute expectancies, which are no longer “incidental” in either drug therapy or psychotherapy.

Our subsequent arguments assume that—like drug RCT in similar conditions, when primary efficacy measures are patient-reported outcomes (PROs)—an average placebo response of around 40% may also be effective in psychotherapy, provided that optimal research conditions prevail; where this is not the case, the placebo response is liable to be higher. This position is supported by a more recent meta-analysis of psychotherapy trials in irritable bowel syndrome (IBS) with nearly 100 RCT of drug therapy and an average of 40% placebo response across all trials (24); six additional psychotherapy RCT also yielded an average placebo response of 40% (25).

This is similar to Lambert (26) who proposed that 40% of the effect of psychotherapy is attributable to factors beyond psychotherapy (or, in our terms, nonspecific effects: spontaneous variation, regression to the mean, biases) and a further 15% to the placebo effect (expectancy of improvement); in addition, 15% are thought to be due to the specifics of each psychotherapy modality, while the remaining 30% are common to all psychotherapies, the “dodo bird verdict” (27). These 30% “common factors” of all psychotherapies can be subdivided into “support factors,” “learning factors,” and “action factors,” in accordance with Huibers and Cuijpers (28) (see Table 1).

TABLE 1
www.frontiersin.org

Table 1 Factors assumed to be common in all psychotherapies that may influence psychotherapy outcome. These can be classified in three groups and can—to different degrees—be effective in different psychotherapies, thus enabling different modes of psychotherapy to operate. Their sequential order (from left to right) is based on a concept by Lambert and Ogles (29) that is theory-driven and yet without empirical basis [concept according to Huibers and Cuijpers (28)].

While all these numbers may be variable with respect to their empirical base—from guesses to meta-analyses—they come surprisingly close to what has been reported from RCT across medicine (30) as well as from psychiatry (12) and in the range of what Henry K. Beecher had already estimated from the few clinical trials he had at his disposal in 1955 (7). Provided that PRO are in the focus, our current understanding is that at this level, placebo effects in drug therapy and in psychotherapy do not vary whatsoever in size and mechanism.

We will not elaborate further on the concept of these “common factors”—a detailed review and discussion is available in Lambert (26). An in-depth discussion of the control-group issue in psychological interventions can be found, among others, in Mohr et al. (31) and Guidi et al. (32).

We will neither present nor discuss the vast body of evidence with regard to neurobiology and neurochemistry of the placebo response, but again refer to the literature, e.g., Fabrizio Benedetti´s book (33), and Luana Colloca´s reader (34, 35).

We will structure the following discussion using the analogy of drug therapy and aim to identify nonspecific effects in drug therapy that have either become specific or that have remained nonspecific in psychotherapy. We will discuss common problems of control for nonspecific effects across different psychotherapies as well as potentially specific problems in certain psychotherapies, as also illustrated in Figure 1. Finally, we will address placebo issues with a combination of drug and psychotherapy and discuss the relationship between placebo effects and the efficacy of psychotherapy.

Nonspecific Effects in Drug Therapy Which Become Specific in Psychotherapy

Most RCT with drugs are keen to demonstrate that no center effects occurred, which otherwise could explain to some degree the efficacy of the drugs under investigation. In pivotal trials, such a center effect could potentially cause the requested indication to be declined by the approval authorities. It is of interest to note that in RCT before the 1990s, most studies were single-center trials in which such an effect was not even noticed. Furthermore, the qualification of trial doctors, the degree of their training, and their communication skills and empathy were rarely assessed or subsequently linked to treatment outcome. Age, sex, and other personal characteristics of the patients were not specifically taken into account, although it is well established that these factors may play a role in clinical routine (36) as well as in RCT, for both drug therapy (37) and psychotherapy (38). Rules of good clinical practice required independent raters and therapists, staff training, study monitoring, and strict adherence control (39).

Large multicenter trials produce higher placebo responses (4042), presumably due to a lower standardization of recruitment [including recruitment biases (43)] and higher variability of therapist–patient interaction during the study. In agreement with this, more study visits are now clearly associated with higher placebo response rates in depression in both children (44) and adults (45), as well as in other areas of medicine, e.g., inflammatory (46) and functional bowel disorders (24).

Frequency and intensity of therapist–patient interaction are well-known factors determining the efficacy of psychotherapy (47). They may serve as an example of how nonspecific effects in drug therapy could become specific effects in psychotherapy, however common they may be for most psychotherapy modalities. This is why psychotherapy trials have always sought to standardize the amount of time spent with the patient as well as the communication between patient and therapist. Furthermore, while manuals harmonizing the content and interaction during therapy are standard in psychotherapy, such factors are now also deemed to be relevant in drug trials (48).

One prime example of a common but specific effect involved in psychotherapy is described in an open-label placebo study (49): To achieve an “augmented placebo response” in a sham-acupuncture trial in patients with IBS, acupuncturists were instructed to control their treatment behavior on the basis of a manualized script requesting intensified 20-min doctor–patient communication instead of the usual, standard acupuncture treatment. Many of the verbal instructions required “normal” therapist–patient communication behavior in a psychotherapy setting but may be rather atypical in drug therapy environments.

This procedure doubled the placebo response to sham acupuncture on most outcome measures.

Nonspecific Elements in Drug Therapy That Remain Nonspecific in Psychotherapy

Of the small number of patient-centered predictors of the placebo response identified in RCT in psychiatry (12)—low severity of the disease, short disease duration, no treatment history, more recent trials—none were shown to be specifically relevant in psychotherapy, although it is open to speculation as to whether patients accepting psychotherapy as their primary treatment option are less severely affected, e.g., by depression, than patients accepting psychotropic drug therapy. In depression therapy in particular, younger age was associated with higher placebo response, but this may be due to shorter disease history and lower disease severity in children and adolescents than in adults (30, 50). These factors may lose their importance in all those cases in which a first-line drug therapy is not available.

Of the traditional therapist-centered variables tested (age, sex, theoretical orientation, and percentage of work time conducting therapy), only age was a significant demographic predictor of psychotherapy outcome in a univariate analysis, while in a multivariate analysis, interpersonal and social skills accounted for most of the outcome variance (51). While this casts doubts on the replicability of many psychotherapy RCT, it calls for more research into the role of researcher variables for therapy outcome (52): allegiance to theoretical concepts per se has been made responsible for most of the therapy outcomes (53).

It is, however, of relevance that, particularly in psychiatry—but not outside psychiatry, see Ref. (54)—an unbalanced randomization has been shown to drive the placebo effect: increased placebo effects were observed in depression (45, 55, 56), schizophrenia (57, 58), and psychosis (42) when more patients were randomized to active treatment than to (placebo) control. While this is usually carried out for ethical reasons (to leave the least number of patients untreated), it also serves in certain cases to test different drug dosages against one placebo arm.

Such designs are presumably also common in psychotherapy and may account for a substantial overall effect of the therapy: According to Papakostas and and Fava (55), a 10% increase in the probability of receiving active treatment (i.e., a 10% decrease in the probability of being assigned to the control condition) increases the probability of responding to active (drug) antidepressant therapy by 1.8% and to control (placebo) by 2.6%, in comparison with a 50:50 randomization scheme. When one active treatment is compared with another active treatment [comparative effectiveness research (CER)], the response was higher by a factor of 1.79 than in a placebo-controlled trial, solely brought about by the 100% certainty for patients that they would receive active antidepressant treatment (59).

Common Control Problems in All Psychotherapy Trials and Their Advantages and Pitfalls

Different psychotherapy options share common features when it comes to standards as set down by RCT of drug therapy in psychiatry and psychosomatics, e.g., trial registration, power calculation, ethics approval, and informed consent are easily applicable to all. Others, such as monitoring of treatment progress and adherence control need to be adapted to the specific therapy in some cases, e.g., with internet-based therapies. In most cases, the design also required adaptation to specifics for certain therapy options (60).

The common denominator in all psychotherapy procedures is the inability to effectively blind treatment and control group assignment and to provide a “true” (by nature, ineffective) placebo treatment; among the many procedures that have been developed to secure blinding therapy assignment and to warrant equipoise (61), very few are applicable to psychotherapy (62). Both limitations have important consequences for the placebo response, as will be discussed later. Nevertheless, current guidelines for good clinical practice require independence of raters and diagnostic staff and their impartiality toward the intervention (39).

Ineffective Blinding

Blinding (of the patient) as well as double blinding (of both patient and therapist) is literally impossible, not only in psychotherapy but also with many other interventions such as manual or physical therapy. Even where apparently possible, e.g., in biofeedback and neurofeedback therapy where “false feedback” (signals from another patient, e.g., as “yoked control”) is provided, patients will realize immediately whether they have been randomized to treatment or control. The situation mimics some of the circumstances encountered in therapies using technical tools, e.g., acupuncture, transcutaneous electric nerve stimulation, and transcranial magnetic stimulation where only those patients can be enrolled who had never experienced the “real” therapy before and who may possibly be hoodwinked (63).

In classical drug RCT, unblinding will have imminent consequences for efficacy. Deliberate unblinding of RTC is usually only carried out when severe safety concerns arise but may also occur incidentally when patients and/or doctors notice significant differences in reporting of adverse events (64); even meta-analyses can identify such involuntary unblinding (65). Such unblinding will enhance the response to active therapy and reduce the response to control, thus enlarging the treatment–control difference (66). However, when therapies with either double-blinded placebo-controlled drug interventions or unblinded but controlled psychotherapies for the same condition (depression) were compared, the meta-analysis showed a small but significant effect (drug–placebo difference) in favor of pharmacotherapy (67), indicating that (un-) blinding affects psychotherapy to a lesser degree than conventional drug RCT. Furthermore, patients who were obviously assigned to the control condition (irrespective of its form) will respond with disappointment (68), increased risk of dropping out (69, and potentially with nocebo effects (70), further contributing (via the “last value carried forward” requirement for intent-to-treat analysis of the trial data) to an overestimation of the efficacy of the active arm of the trial.

Blinding is particularly necessary with conventional crossover designs where each patient serves as his/her own control, thereby reducing the data variance and making RCT possible with considerably less patients than with a parallel-group design. However, crossover designs carry another risk: that of carry-over effects from one phase to the next. If the carry-over effect is based on the Pavlovian conditioning of responses (71), even the use of longer washout phases cannot prevent it from occurring.

Ineffective blinding and carry-over effects that cannot be washed out therefore constitute the two reasons why psychotherapeutic trials cannot employ a crossover design. The limitations of a parallel-group design, in particular higher between-subject data variance, had to be overcome by developing other design features to account for the missing “true placebo” in psychotherapy, predominantly “waiting list control” (WLC), and “treatment as usual” (TAU).

Waiting List Control

The fact that no “true placebo” is applicable in psychotherapy RCT does not imply that no placebo effect occurs, as discussed above in the case of CER: when psychotherapy is compared with another therapy, the placebo effect is not controlled for and can therefore no longer be quantified. It can, however, be assumed that some of the alternative control strategies in psychotherapy research also have enhancing placebo effects. This may specifically be true of WLC.

Like crossover studies, WLC reduces data variance on account of a lower within-subject than between-subject variability of data; in this case, however, all patients should have to wait (which is usually not the case). It is also argued that WLC may additionally serve as a control for spontaneous variation of symptoms, a condition that cannot be readily tested with any RCT: it is ethically questionable as to whether a “no treatment control” is acceptable unless the disease is of minor severity and no effective therapy is available. This is the most rigorous interpretation of the current position of the Declaration of Helsinki (72).

Three-arm trials (active, placebo, and no treatment), between 25% and 45% of the treatment effect—of either drug or psychotherapy—can be attributed to spontaneous variation (73), with highest effects in nausea (45%), smoking cessation (40%), depression (35%), phobia (34%), and acute pain (25%). The authors concluded that most of the placebo effects in these conditions are attributable to spontaneous variation of symptoms. However, Kirsch and Sapirstein concluded in their initial paper (74) that 25% of the improvement observed in the drug-treated group (for depression) was due to the active medication, 25% to natural history, and 50% to the placebo effect.

The use of WLC as an indicator of spontaneous variation is therefore misleading (patients are not naive but are promised effective treatment), and it would be more appropriate to install one of the novel designs that separate recruitment for a disease-monitoring study from recruitment for an intervention study, called Zelen design (75) or multiple cohort RCT (MCRCT) design (76) (for more details, see 77 and 78).

Since WLC are promising patient-effective treatment in the future, they may produce strong expectancy effects, probably enhancing the placebo response, even in the phase before the treatment actually commences: symptom improvement during waiting has been reported (79, 80)—similar to effects of run-in periods in drug trials (81)—and cannot be taken solely as indicative of spontaneous remission. Placebo-controlled trials are superior to WLC trials and induce greater symptom reduction (82), as do RCTS with a “no treatment” condition in comparison with WLC trials (70). Furthermore, this effect may rely on the duration of waiting, and standard rules for this have yet to be investigated. One way of doing so would be to install a “step-wedge approach” (83), where randomization between different waiting groups (periods of different length) is used to test a dose-response function of waiting and the point at which positive expectations (placebo effects) may turn into disappointment (nocebo effects) (70) and increased dropout rates (69).

Treatment as Usual

If being randomized to a WLC can induce hope (placebo) or disappointment (nocebo) depending on its length, being randomized to TAU, by dint of its name, is already suggestive of its nocebo effect, the implicit message being that “you get what everybody else gets with this disease, and this treatment is unsatisfactory; that is why we are testing the new one, to which you, unfortunately, have not been randomized.” Unless this is a treatment-naive patient with a very short disease history [which is indicative of high placebo response rates in many conditions and with many therapies (12)], this also reminds him or her of previous unsatisfactory or unsuccessful therapies, which—as we know—contributes significantly to the efficacy of any novel therapies (84).

Being randomized to the active treatment arm rather than to TAU will therefore enhance the placebo effect by enabling patients to compare the ongoing therapy with (all) previously inefficient therapies. For this reason, they prefer to participate in the novel approach; being randomized to TAU is almost a verdict. A TAU approach therefore enhances the placebo effect in the active arm and induces nocebo effects in the control arm.

The only thing that we have learned for sure from placebo/nocebo research over the past 10 years is that words can be painful (85) and can induce nocebo effects (86, 87). TAU definitively hurts, and it would be better rephrased as “the best available and approved treatment” (BAAT) when compared with a novel approach, but this would not work without having a number of logistic repercussions for trial designs.

Firstly, the utmost standardization of the TAU/BAAT treatment used for control purposes would be required. However, this is usually not carried out in psychotherapy RCT involving TAU. It is particularly complicated when patients are recruited from different clinical settings for treatment in a specialized center, but TAU is provided by the transferring therapist. It also generates a further methodological issue with regard to the selection of BAAT, when more than one is available on the market, in the region, or under prevailing restrictions, e.g., health insurance plans. It should be noted that control conditions, e.g., optimized treatment as usual (TAU-O) in psychotherapy trials [see for instance Refs. (88, 89)], face additional challenges, depending on the health care environment in which they were conducted. In Germany, by way of example, patients with a psychiatric or psychosomatic illness, e.g., anorexia nervosa, have access to inpatient, day-patient, and outpatient psychotherapy treatment. If these patients are randomized to the TAU-O arm, they have a choice with regard to a) the treatment setting, b) the treatment method (e.g., CBT or psychodynamic psychotherapy), c) the therapist, and d) the intensity or dosage of therapy. It is therefore also particularly important to discuss findings of studies on the background of the health care system in which they were conducted. These challenges are somewhat similar in CER, where divergent interests (drug companies, ethics boards, and patient representatives) may nominate different options as BAAT (90). Given the large number of different psychotherapeutic approaches to one disease, this may be impossible to achieve in RCT but perhaps in meta-analyses of RCT (91). Finally, if one novel treatment A is compared with the best (or one of the bests) treatment B, statistics cannot rely on A’s superiority over B but should test A’s non-inferiority in comparison with B, with the consequence that as many as a fourfold number of patients could be required to confirm this (92). Not to mention the fact that this generates an ethical paradox since, according to the Declaration of Helsinki, the smallest possible number of patients should be recruited for a trial, while all others should receive regular and adequate treatment (93).

Among the many design alternatives that have been developed to either explore and maximize the placebo response or to avoid or minimize it in drug RCT (3), the so-called preference design may indicate an alternative approach specifically relevant for psychotherapy (78). In short, patients can choose between two (or more) alternative therapies, e.g., drug or psychotherapy, and are assigned accordingly (94). Only those who have no clear preference will undergo randomization. The role of patients’ preference (and its placebo effect) can be assessed post hoc, comparing those with a preference for the one therapy with those randomized to this therapy in each therapy arm.

Specific Control Problems with Specific Psychotherapy Modalities

Beyond these general problems of control conditions with global placebo and nocebo effects in psychotherapy RCT, specific psychotherapies generate specific problems related to control and adequate estimation of the placebo/nocebo effects. Much of what has recently been described as decisional framework for neurocognitive and behavioral intervention (60) applies to most other therapeutic options also.

The subsequent review of different psychotherapies that we discuss bears some arbitrary selection bias and may reflect a more traditional vision of the spectrum of psychotherapies available. However, the intention is to illustrate rather than to cover the variability of problems associated with specific psychotherapy modalities. Readers who feel neglected or overlooked are welcome to consider and outline the specifics of their own modus operandi in light of what has been discussed.

Psychodynamic Psychotherapy

As already observed by Frank (13), it is essential for any control strategy attempting to catch the placebo effect in psychotherapy RCT that it devotes the same interaction (time, number of contacts, and intensity of communication) between the patient and the therapist as is the case in the “active arm” of the therapy. He proposed the use of relaxation therapy as a control for psychodynamic therapy (PDT), but it may equally well be any other passive but interactive therapy. It should be borne in mind that, in most such cases, the control condition does not provide a clear measure of the placebo effect but simply another effective therapy. This will increase the pressure to demonstrate superiority of PDT over control while increasing the placebo effect in both arms. Recent approaches (52, 88) applied standardized diagnostic systems (e.g., operationalized psychodynamic diagnosis) to identify clear treatment foci on the basis of a psychodynamic approach (52, 88).

Cognitive Behavioral Therapy

Unlike psychodynamic psychotherapy (PDT), CBT approaches intrapersonal problems at an individualized rational (cognitive) or behavioral level on the basis of an extensive prior behavioral analysis. To adequately control for nonspecific effects, it is feasible that written information on putative cognitive and behavioral strategies that are independent of the patient’s own history may provide a control strategy. Albeit this lacks the actual behavioral analysis that precedes the active part of the therapy, it is, nevertheless, part of it. Behavioral exercises and tasks, which may mimic some of the effects occurring, bear the risk of errors if not adequately structured to the patient´s pathology and therefore require careful monitoring.

Interpersonal Psychotherapy

Interpersonal psychotherapy, like CBT, is based on a very intimate knowledge and guidance of the patient’s acute problems, and problem solving may therefore not tolerate “sham” interventions without becoming evident. Keeping an (electronic) diary may be a method of monitoring one’s own problems in the absence of a therapist (95). MBT, self-aid programs, and educational programs may also provide a lower-level control for the attention received.

Mindfulness-Based Therapy

An increasing number of therapy studies have demonstrated the efficacy of MBT in somatoform disorders such as IBS. Meditation-based therapy is difficult to control for nonspecific effects. In some trials, validated self-aid programs are used for attention control (96) or “sham mindfulness meditation” (97).

Couple and Family Therapy

The nonspecific contribution of “proxies” toward therapy efficacy has been well established for children in medical therapy (98) but has rarely been assessed in adults (99). Experimentally, the placebo and the nocebo effects in both groups are affected by social models, be it peers, parents, or strangers (100, 101). The control strategies therefore become even more difficult when the “proxies” are part of the intervention, as is the case in pair and family therapy. Merrilees et al. (95) used event-contingent diaries about marital conflict situations to change marital interactions as a control strategy rather than conventional face-to-face family psychotherapy sessions.

Group Psychotherapy

The problem of “proxies” and “others” for the therapy progress and success of individual patients becomes even more virulent with group psychotherapy. One control strategy would be to run two (or more) groups in parallel, with all participants truly randomized to one of the groups, and to compare the group as well as the individual progress between the two. In addition, group processes could be monitored by applying group-specific outcome measures. A further control strategy could consist of using eHealth applications such as chatrooms, focus groups, self-aid guides, and blogs as controls (102).

Hypnotherapy

Nonspecific effects of hypnotherapy, whether general or in a disease-specific form such as gut-directed hypnotherapy (103), are probably best and most readily controlled by relaxation exercises and therapy, since these are similar with respect to the time spent (in a group setting as well as in individual therapy) and active/passive components. A comparison with mindfulness mediation (see previously), while perhaps advisable, has not yet been conducted.

Self-Help Programs

SHPs were initially developed as a control condition for more manualized therapies, especially in patients with somatoform disorders, such as the IBS (104). As they developed their own theoretical framework, and for economic reasons—providing professional help to more patients outside academic centers—many applications are now available, particularly in combination with web-based approaches (105).

E-Mental Health Approaches

The very recent development of phone- and internet-based therapies has spread across all psychotherapy modalities, from CBT to MBT and SHP, e.g., Refs. (106) and (107). Among the most widely used applications is Deprexis®, an internet-based CBT program for the treatment of depression (108, 109). Due to its high standardization, it can easily allow for the control of the effect of a variety of nonspecific factors such as age, sex/gender, race, and other therapist-based demographics, for style of communication (personalized versus neutral), for intensity of communication, e.g., with or without question and answer, feedback, chatroom activity, etc. By contrast, of the many smartphone health applications presently available (now numbering over 300,000), those with a psychotherapeutic approach still lack clear control strategies that would enable us to estimate the overall efficacy of their placebo effect (110). Using “virtual” doctors or therapists (111) in the future may enable us to exert a much better control of the nonspecific factors not only in psychotherapy but also in medical therapy in general (21, 112).

Nonspecific Solutions for the Control of the Specific Placebo Effect in Psychotherapy

In a recent paper (60), we proposed a dynamic decision framework for choosing a control condition depending on the patient population and associated risks, i.e., the risk of the disease itself, placebo vs. nocebo responses in this population, and the armamentarium of available therapies with known efficacy for this patient group, as well as the trial stage. We argued that the choice of control group and its justification need to be taken into consideration, e.g., when comparing behavioral and pharmacological therapies. High participation risk studies should therefore choose among controls with high effect sizes favoring treatment (e.g., waiting list and TAU) that may require smaller sample sizes, while low-risk studies may opt for active comparators and minimal treatment control conditions [see Figures 1 and 2 in Ref. (60)].

Wampold characterizes three global strategies resulting from the need to control for nonspecific effects of psychotherapy: a) identifying single components of the psychotherapy under investigation and replacing them by components of another psychotherapy (tradition); b) dismantling, without replacing, one or more components of a specific psychotherapy; and c) using treatments that control for common factors such as education and counseling (16).

Neither strategy has produced convincing results when it comes to adequately controlling the placebo effect in psychotherapy and has (worst case) shown that the control therapies may be as effective as the therapy under investigation, e.g., Ref. (113). Another novel control strategy, known as “befriending” (114, 115), refers to professional (nurse-conducted) social contacts developed for patients with schizophrenia in the community (116). It may, however, fall into the same trap as others before it, in demonstrating that even the mildest form of patient–therapist communication can result in significant therapeutic effects (117) and may therefore be a specific control only for the specific group of patients for which it was developed.

The “Goldilocks placebo effect” (118) exploits something that has rarely been tested and compared in psychotherapy research, i.e., the provision of alternatives from which the patient may choose. Preference designs (94) allow patients to choose between alternative treatments when available (e.g., drug vs. psychotherapy, different psychotherapy options) prior to randomization. It also allows comparison of the efficacy in patient that preferred one treatment arm with patients that were randomized to this arm of the study. The role of preferences can also be included in the overall statistics when comparing both treatment effects (78). Although the use of preferences does not seem to affect the overall internal and external validity of trials (94) and the preferences themselves do not appear to play a role in the placebo response (119), the systematic evaluation of placebo data beyond acupuncture has not yet been carried out.

By way of comparison (antidepressant versus CBT) of treatment outcome (treatment–control difference, not of the placebo response) in patients with depression, patients in either arm who selected this treatment were found to respond better than those who were randomized to the same arm (120). The difference was even greater in CBT trials and was independent of depression severity and dropout rates. In a trial in patients with chronic widespread pain, participants could choose between four options (CBT, exercise, a combination of both, or TAU), and the treatment preference had no effect on treatment outcome, while improvement expectations did (121). Neither of the studies elaborated on the placebo effect size under preference–choice conditions.

The “Goldilocks principle,” which refers to Goldilocks´ quote about her preferred porridge temperature as being “just right” in the popular fairytale “Goldilocks and the Three Bears” (Robert Southey 1837), has found many applications in science. The Goldilocks placebo effect study (118) takes things a step further and asks whether it is the number of options available rather than the option to select per se that determines the placebo effect, and that the effect is larger when this number is “just right” than when there are too many or too few options to choose from. While their example is taken from a choice between different alternative medicine remedy treatments (2, 12, or 38 Bach flower essences, where the middle option received the highest rating as well as the highest symptom improvement report), the principle may also apply to lower number of choice options. Whether it can explain the divergent results of the two preference studies cited previously (120, 121) remains open at this point, and more data are required before this principle can be applied to placebo effects in psychotherapy.

Some Specifics of Psychotherapy and Its Evaluation

Unlike drug therapy, where drug–drug interactions appear to be a pharmaceutical problem only, and the placebo effects above (or below) both are identical, psychotherapy is often combined with drug therapy, albeit their interactions have rarely been investigated. An RCT with a combination of both cannot, therefore, easily answer the question as to the size of the placebo effect and the relative contribution of either component to it. In depression, for example, psychotherapy in combination with drug therapy (122) and vice versa (123) is more effective than psychotherapy or drug therapy alone. The question, however, remains unanswered. Direct comparison of drug and psychotherapy has shown no superiority of drug over psychotherapy (124), and assuming similar effect sizes of the placebo component under both conditions would not change this relationship. However, they cannot be taken as merely additive, and the superiority of the combination may be also a function of the individual patient’s preference (120). Unless an RCT is conducted and evaluated that provides either drug therapy (or placebo) alone, or psychotherapy (or an appropriate control) alone, or both in any combination, we will presumably not be able to answer this question with sufficient accuracy. Such a study resembles similarity with a double-dummy design (125), and it can be combined with a “no treatment” control group, e.g., in a register trial (76). The same holds true of other combinations of psychotherapy, such as those with neuro-modulatory therapies and biofeedback approaches (126).

Finally, one issue that requires specific consideration is the fact that, in psychotherapy, the outcome measure is usually, if not invariably a measure of subjective PRO or expert-rated outcome, whereas in drug therapy, efficacy can often be measured with both PRO/expert-rated outcome and with biomarkers, or at least with the circulating or tissue-specific level of the applied drug. Since PRO are more susceptible to placebo response than biomarkers (127), approval authorities and expert boards usually require both as endpoints in RCTs. It would therefore be advantageous if psychotherapy research were able to develop the equivalent of a biomarker as an indicator of therapy success and as an adjunct measure of the size of the placebo response in psychotherapy in the future.

Summary

Overestimation of the efficacy of interventions, not only in psychotherapy, is common to all medical subspecialties, as is the effort to minimize nonspecific treatment effects, among which the placebo effect has the poorest reputation. Unfortunately, as we have already shown previously, psychotherapy lacks a true placebo intervention, and some of the nonspecific effects in drug therapy, such as the empathy of the therapist and the quality of the patient–therapist communication, become quite specific effects in psychotherapy. On the other hand, many of the common control strategies in psychotherapy research, especially waiting list and TAU, tend to inflate these nonspecific effects at the expense of already reduced overall efficacy, be it specific for individual psychotherapy modalities or for a “common effect” of all of them.

Under these circumstances, the scientific community of placebo researcher should not seek exemption from the scientific rules of treatment evaluation that have been developed for drug therapy but rather seek specific strategies to control at least some of the elements of psychotherapy that are responsible for the placebo response. These strategies can either be specific to certain psychotherapy modalities (as we have discussed) or further develop common strategies for all, bearing the possibility of covering at least some of Grünbaum´s “incidental constituents” without attempting to identify and enumerate them all. For instance, changing the waiting-list control into a “step-wedge” design, evaluating the cohort multiple RCT design, or developing the preference design to a Goldilocks approach for psychotherapy are empirical ways of proceeding (78, 114, 115) and much more appropriate than reasoning why it is impossible to control placebo effect in psychotherapy or remonstrating that all of psychotherapy is only placebo.

Last but not least: Biomedicine has learned to accept that placebo/nocebo effects exist outside placebo-controlled trials in daily medicine, and they contribute to a large extent to the success or failure of patient treatment, sometimes even more so than the drugs available. It is now time for psychotherapists to accept them in their daily practice.

Author Contributions

PE had the idea for the paper and conceptualized it. PE and SZ wrote the paper.

Funding

Supported by the German-Norwegian Günther Jantschek Research Stipend (PE).

Conflict of Interest Statement

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

References

1. Jutte R. The early history of the placebo. Complement Ther Med (2013) 21:94–7. doi: 10.1016/j.ctim.2012.06.002

PubMed Abstract | CrossRef Full Text | Google Scholar

2. Kaptchuk TJ. Intentional ignorance: a history of blind assessment and placebo controls in medicine. Bull Hist Med (1998) 72:389–433. doi: 10.1353/bhm.1998.0159

PubMed Abstract | CrossRef Full Text | Google Scholar

3. Enck P, Bingel U, Schedlowski M, Rief W. The placebo response in medicine: minimize, maximize or personalize? Nat Rev Drug Discov (2013) 12:191–204. doi: 10.1038/nrd3923

PubMed Abstract | CrossRef Full Text | Google Scholar

4. Evers AWM, Colloca L, Blease C, Annoni M, Atlas LY, Benedetti F, et al. Implications of placebo and nocebo effects for clinical practice: expert consensus. Psychother Psychosom (2018) 87:204–10. doi: 10.1159/000490354.

PubMed Abstract | CrossRef Full Text | Google Scholar

5. Colloca L, Miller FG. Harnessing the placebo effect: the need for translational research. Philos Trans R Soc Lond B Biol Sci (2011) 366:1922–30. doi: 10.1098/rstb.2010.0399

PubMed Abstract | CrossRef Full Text | Google Scholar

6. Schedlowski M, Enck P, Rief W, Bingel U. Neuro-bio-behavioral mechanisms of placebo and nocebo responses: implications for clinical trials and clinical practice. Pharmacol Rev (2015) 67:697–730. doi: 10.1124/pr.114.009423

PubMed Abstract | CrossRef Full Text | Google Scholar

7. Beecher HK. The powerful placebo. J Am Med Assoc (1955) 159:1602–6. doi: 10.1001/jama.1955.02960340022006

PubMed Abstract | CrossRef Full Text | Google Scholar

8. Wolf S. Effects of suggestion and conditioning on the action of chemical agents in human subjects; the pharmacology of placebos. J Clin Invest (1950) 29:100–9. doi: 10.1172/JCI102225

PubMed Abstract | CrossRef Full Text | Google Scholar

9. Wolf S. The pharmacology of placebos. Pharmacol Rev (1959) 11:689–704.

PubMed Abstract | Google Scholar

10. Loranger AW, Prout CT, White MA. The placebo effect in psychiatric drug research. JAMA (1961) 176:920–5. doi: 10.1001/jama.1961.03040240026010

PubMed Abstract | CrossRef Full Text | Google Scholar

11. Rickels K, Lipman R, Raab E. Previous medication, duration of illness and placebo response. J Nerv Ment Dis (1966) 142:548–54. doi: 10.1097/00005053-196606000-00006

PubMed Abstract | CrossRef Full Text | Google Scholar

12. Weimer K, Colloca L, Enck P. Placebo effects in psychiatry: mediators and moderators. Lancet Psychiatry (2015b) 2:246–57. doi: 10.1016/S2215-0366(14)00092-3

PubMed Abstract | CrossRef Full Text | Google Scholar

13. Frank JD. The influence of patients’ and therapists’ expectations on the outcome of psychotherapy. Br J Med Psychol (1968) 41:349–56. doi: 10.1111/j.2044-8341.1968.tb02043.x

PubMed Abstract | CrossRef Full Text | Google Scholar

14. Rosenthal D, Frank JD. Psychotherapy and the placebo effect. Psychol Bull (1956) 53:294–302. doi: 10.1037/h0044068

PubMed Abstract | CrossRef Full Text | Google Scholar

15. Kirsch I. Placebo psychotherapy: synonym or oxymoron? J Clin Psychol (2005) 61:791–803. doi: 10.1002/jclp.20126

PubMed Abstract | CrossRef Full Text | Google Scholar

16. Wampold BE, Minami T, Tierney SC, Baskin TW, Bhati KS. The placebo is powerful: estimating placebo effects in medicine and psychotherapy from randomized clinical trials. J Clin Psychol (2005) 61:835–54. doi: 10.1002/jclp.20129

PubMed Abstract | CrossRef Full Text | Google Scholar

17. Blease C, Kirsch I. The placebo effect and psychotherapy: implications for theory, research, and practice. Psychol Conscious Theory Res Pract (2016) 3:105–7. doi: 10.1037/cns0000094

CrossRef Full Text | Google Scholar

18. Kirsch I, Wampold B, Kelley JM. Controlling for the placebo effect in psychotherapy: noble quest or tilting at windmills? Psychol Conscious Theory Res Pract (2016) 3:121–31. doi: 10.1037/cns0000065

CrossRef Full Text | Google Scholar

19. Gaab J, Blease C, Locher C, Gerger H. Go open: a plea for transparency in psychotherapy. Psychol Conscious Theory Res Pract (2016) 3:175–98. doi: 10.1037/cns0000063

CrossRef Full Text | Google Scholar

20. Blease C. Consensus in placebo studies: lessons from the philosophy of science. (2018a) 61:412–29. doi: 10.1353/pbm.2018.0053

CrossRef Full Text | Google Scholar

21. Blease C. Psychotherapy and placebos: manifesto for conceptual clarity. Front Psychiatry (2018b) 9:379. doi: 10.3389/fpsyt.2018.00379

PubMed Abstract | CrossRef Full Text | Google Scholar

22. Grünbaum A. The placebo concept in medicine and psychiatry. Psychol Med (1986) 16:19–38. doi: 10.1017/S0033291700002506

PubMed Abstract | CrossRef Full Text | Google Scholar

23. Enck P, Horing B, Broelz E, Weimer K. Knowledge gaps in placebo research: with special reference to neurobiology. Int Rev Neurobiol (2018) 139:85–106. doi: 10.1016/bs.irn.2018.07.018

PubMed Abstract | CrossRef Full Text | Google Scholar

24. Ford AC, Moayyedi P. Meta-analysis: factors affecting placebo response rate in the irribowel syndrome. Aliment Pharmacol Ther (2010) 32:144–58. doi: 10.1111/j.1365-2036.2010.04328.x

PubMed Abstract | CrossRef Full Text | Google Scholar

25. Flik CE, Bakker L, Laan W, Van Rood YR, Smout AJ, De Wit NJ. Systematic review: the placebo effect of psychological interventions in the treatment of irritable bowel syndrome. World J Gastroenterol (2017) 23:2223–33. doi: 10.3748/wjg.v23.i12.2223

PubMed Abstract | CrossRef Full Text | Google Scholar

26. Lambert MJ. Maximizing psychotherapy outcome beyond evidence-based medicine. Psychother Psychosom (2017) 86:80–9. doi: 10.1159/000455170

PubMed Abstract | CrossRef Full Text | Google Scholar

27. Rosenzweig S. Some implicit common factors in diverse methods of psychotherapy. Am J Orthopsychiatry (1936) 6:412–5. doi: 10.1111/j.1939-0025.1936.tb05248.x

CrossRef Full Text | Google Scholar

28. Huibers MJH, Cuijpers P. “Common (Nonspecific) Factors in Psychotherapy,”. In: Cautin RL, Lilienfeld SO, editors. The Encyclopedia of Clinical Psychology. New York: John WIley & Sons (2015). p. 681–6. doi: 10.1002/9781118625392.wbecp272

CrossRef Full Text | Google Scholar

29. Lambert MJ, Ogles BM. The efficacy and effectiveness of psychotherapy. In: Lambert MJ, editor. Bergin and Garfield’s handbook of psychotherapy and behavior change. 5th ed. New York: John Wiley & Sons (2004). p. 139–93.

Google Scholar

30. Weimer K, Colloca L, Enck P. Age and sex as moderators of the placebo response - an evaluation of systematic reviews and meta-analyses across medicine. Gerontology (2015a) 61:97–108. doi: 10.1159/000365248

PubMed Abstract | CrossRef Full Text | Google Scholar

31. Mohr DC, Spring B, Freedland KE, Beckner V, Arean P, Hollon SD, et al. The selection and design of control conditions for randomized controlled trials of psychological interventions. Psychother Psychosom (2009) 78:275–84. doi: 10.1159/000228248

PubMed Abstract | CrossRef Full Text | Google Scholar

32. Guidi J, Brakemeier EL, Bockting CLH, Cosci F, Cuijpers P, Jarrett RB, et al. Methodological recommendations for trials of psychological interventions. Psychother Psychosom (2018) 87:276–84. doi: 10.1159/000490574

PubMed Abstract | CrossRef Full Text | Google Scholar

33. Benedetti F. Placebo effects. Oxord: Oxford University Press (2014). doi: 10.1093/acprof:oso/9780198705086.001.0001

CrossRef Full Text | Google Scholar

34. Colloca L. Preface: The Fascinating Mechanisms and Implications of the Placebo Effect. Int Rev Neurobiol (2018a) 138:xv–xx. doi: 10.1016/S0074-7742(18)30027-8.

PubMed Abstract | CrossRef Full Text | Google Scholar

35. Colloca L. Preface: Part II: The Fascinating Mechanisms and Implications of the Placebo Effect. Int Rev Neurobiol (2018b)139:xvii–xxiii. doi: 10.1016/S0074-7742(18)30087-4.

PubMed Abstract | CrossRef Full Text | Google Scholar

36. Rakel DP, Hoeft TJ, Barrett BP, Chewning BA, Craig BM, Niu M. Practitioner empathy and the duration of the common cold. Fam Med (2009) 41:494–501.

PubMed Abstract | Google Scholar

37. Enck P, Klosterhalfen S, Kruis W. Determination of placebo effect in irritable bowel syndrome. Dtsch Med Wochenschr (2005) 130:1934–7. doi: 10.1055/s-2005-872605

PubMed Abstract | CrossRef Full Text | Google Scholar

38. Martens U, Caspari G, Rilk A, Hefner J, Teufel M, Klosterhalfen S, et al. Six-year follow-up of patients with functional bowel disorders, with and without previous psychotherapy. Psychosoc Med (2010) 7:Doc06. doi: 10.3205/psm000068

CrossRef Full Text | Google Scholar

39. Mentz RJ, Hernandez AF, Berdan LG, Rorick T, O’brien EC, Ibarra JC, et al. Good clinical practice guidance and pragmatic clinical trials: balancing the best of both worlds. Circulation (2016) 133:872–80. doi: 10.1161/CIRCULATIONAHA.115.019902

PubMed Abstract | CrossRef Full Text | Google Scholar

40. Bridge JA, Birmaher B, Iyengar S, Barbe RP, Brent DA. Placebo response in randomized controlled trials of antidepressants for pediatric major depressive disorder. Am J Psychiatry (2009) 166:42–9. doi: 10.1176/appi.ajp.2008.08020247

PubMed Abstract | CrossRef Full Text | Google Scholar

41. Yildiz A, Vieta E, Tohen M, Baldessarini RJ. Factors modifying drug and placebo responses in randomized trials for bipolar mania. Int J Neuropsychopharmacol (2011) 14:863–75. doi: 10.1017/S1461145710001641

PubMed Abstract | CrossRef Full Text | Google Scholar

42. Agid O, Siu CO, Potkin SG, Kapur S, Watsky E, Vanderburg D, et al. Meta-regression analysis of placebo response in antipsychotic trials, 1970-2010. Am J Psychiatry (2013) 170:1335–44. doi: 10.1176/appi.ajp.2013.12030315

PubMed Abstract | CrossRef Full Text | Google Scholar

43. Kobak KA, Kane JM, Thase ME, Nierenberg AA. Why do clinical trials fail? J Clin Psychopharmacol (2007) 27:1–5. doi: 10.1097/JCP.0b013e31802eb4b7

PubMed Abstract | CrossRef Full Text | Google Scholar

44. Rutherford BR, Sneed JR, Tandler JM, Rindskopf D, Peterson BS, Roose SP. Deconstructing pediatric depression trials: an analysis of the effects of expectancy and therapeutic contact. J Am Acad Child Adolesc Psychiatry (2011) 50:782–95. doi: 10.1016/j.jaac.2011.04.004

PubMed Abstract | CrossRef Full Text | Google Scholar

45. Mancini M, Wade AG, Perugi G, Lenox-Smith A, Schacht A. Impact of patient selection and study characteristics on signal detection in placebo-controlled trials with antidepressants. J Psychiatr Res (2014) 51:21–9. doi: 10.1016/j.jpsychires.2014.01.001

PubMed Abstract | CrossRef Full Text | Google Scholar

46. Jairath V, Zou G, Parker CE, Macdonald JK, Mosli MH, Alameel T, et al. Systematic review with meta-analysis: placebo rates in induction and maintenance trials of crohn’s disease. Aliment Pharmacol Ther (2017) 45:1021–42. doi: 10.1111/apt.13973

PubMed Abstract | CrossRef Full Text | Google Scholar

47. Erekson DM, Lambert MJ, Eggett DL. The relationship between session frequency and psychotherapy outcome in a naturalistic setting. J Consult Clin Psychol (2015) 83:1097–107. doi: 10.1037/a0039774

PubMed Abstract | CrossRef Full Text | Google Scholar

48. Kobak KA. Inaccuracy in clinical trials: effects and methods to control inaccuracy. Curr Alzheimer Res (2010) 7:637–41. doi: 10.2174/156720510793499057

PubMed Abstract | CrossRef Full Text | Google Scholar

49. Kaptchuk TJ, Kelley JM, Conboy LA, Davis RB, Kerr CE, Jacobson EE, et al. Components of placebo effect: randomised controlled trial in patients with irritable bowel syndrome. Bmj (2008) 336:999–1003. doi: 10.1136/bmj.39524.439618.25

PubMed Abstract | CrossRef Full Text | Google Scholar

50. Weimer K, Gulewitsch MD, Schlarb AA, Schwille-Kiuntke J, Klosterhalfen S, Enck P. Placebo effects in children: a review. Pediatr Res (2013) 74:96–102. doi: 10.1038/pr.2013.66

PubMed Abstract | CrossRef Full Text | Google Scholar

51. Anderson T, Ogles BM, Patterson CL, Lambert MJ, Vermeersch DA. Therapist effects: facilitative interpersonal skills as a predictor of therapist success. J Clin Psychol (2009) 65:755–68. doi: 10.1002/jclp.20583

PubMed Abstract | CrossRef Full Text | Google Scholar

52. Leichsenring F, Steinert C. Replicability in psychotherapy research: uncontrolled risk factors and proposed measures. Psychother Psychosom (2016) 85:371–2. doi: 10.1159/000444858

PubMed Abstract | CrossRef Full Text | Google Scholar

53. Munder T, Brutsch O, Leonhart R, Gerger H, Barth J. Researcher allegiance in psychotherapy outcome research: an overview of reviews. Clin Psychol Rev (2013) 33:501–11. doi: 10.1016/j.cpr.2013.02.002

PubMed Abstract | CrossRef Full Text | Google Scholar

54. Elsenbruch S, Enck P. Placebo effects and their determinants in gastrointestinal disorders. Nat Rev Gastroenterol Hepatol (2015) 12:472–85. doi: 10.1038/nrgastro.2015.117

PubMed Abstract | CrossRef Full Text | Google Scholar

55. Papakostas GI, Fava M. Does the probability of receiving placebo influence clinical trial outcome? A meta-regression of double-blind, randomized clinical trials in mdd. Eur Neuropsychopharmacol (2009) 19:34–40. doi: 10.1016/j.euroneuro.2008.08.009

PubMed Abstract | CrossRef Full Text | Google Scholar

56. Sinyor M, Levitt AJ, Cheung AH, Schaffer A, Kiss A, Dowlati Y, et al. Does inclusion of a placebo arm influence response to active antidepressant treatment in randomized controlled trials? Results from pooled and meta-analyses. J Clin Psychiatry (2010) 71:270–9. doi: 10.4088/JCP.08r04516blu

PubMed Abstract | CrossRef Full Text | Google Scholar

57. Woods SW, Gueorguieva RV, Baker CB, Makuch RW. Control group bias in randomized atypical antipsychotic medication trials for schizophrenia. Arch Gen Psychiatry (2005) 62:961–70. doi: 10.1001/archpsyc.62.9.961

PubMed Abstract | CrossRef Full Text | Google Scholar

58. Mallinckrodt CH, Zhang L, Prucka WR, Millen BA. Signal detection and placebo response in schizophrenia: parallels with depression. Psychopharmacol Bull (2010) 43:53–72.

PubMed Abstract | Google Scholar

59. Rutherford BR, Sneed JR, Roose SP. Does study design influence outcome? The effects of placebo control and treatment duration in antidepressant trials. Psychother Psychosom (2009) 78:172–81. doi: 10.1159/000209348

PubMed Abstract | CrossRef Full Text | Google Scholar

60. Gold SM, Enck P, Hasselmann H, Friede T, Hegerl U, Mohr DC, et al. Control conditions for randomised trials of behavioural interventions in psychiatry: a decision framework. Lancet Psychiatry (2017) 4:725–32. doi: 10.1016/S2215-0366(17)30153-0

PubMed Abstract | CrossRef Full Text | Google Scholar

61. Boutron I, Guittet L, Estellat C, Moher D, Hrobjartsson A, Ravaud P. Reporting methods of blinding in randomized trials assessing nonpharmacological treatments. PLoS Med (2007) 4:e61. doi: 10.1371/journal.pmed.0040061

PubMed Abstract | CrossRef Full Text | Google Scholar

62. Button KS, Munafo MR. Addressing risk of bias in trials of cognitive behavioral therapy. Shanghai Arch Psychiatry (2015) 27:144–8. doi: 10.11919/j.issn.1002-0829.215042

PubMed Abstract | CrossRef Full Text | Google Scholar

63. Enck P, Klosterhalfen S, Zipfel S. Acupuncture, psyche and the placebo response. Auton Neurosci (2010) 157:68–73. doi: 10.1016/j.autneu.2010.03.005

PubMed Abstract | CrossRef Full Text | Google Scholar

64. Kim SE, Kubomoto S, Chua K, Amichai MM, Pimentel M. “Pre-cebo”: an unrecognized issue in the interpretation of adequate relief during irritable bowel syndrome drug trials. J Clin Gastroenterol (2012) 46:686–90. doi: 10.1097/MCG.0b013e31825828a7

PubMed Abstract | CrossRef Full Text | Google Scholar

65. Shah E, Triantafyllou K, Hana AA, Pimentel M. Adverse events appear to unblind clinical trials in irritable bowel syndrome. Neurogastroenterol Motil (2014) 26:482–8. doi: 10.1111/nmo.12289

PubMed Abstract | CrossRef Full Text | Google Scholar

66. Berna C, Kirsch I, Zion SR, Lee YC, Jensen KB, Sadler P, et al. Side effects can enhance treatment response through expectancy effects: an experimental analgesic randomized controlled trial. Pain (2017) 158:1014–20. doi: 10.1097/j.pain.0000000000000870

PubMed Abstract | CrossRef Full Text | Google Scholar

67. Cuijpers P, Karyotaki E, Andersson G, Li J, Mergl R, Hegerl U. The effects of blinding on the outcomes of psychotherapy and pharmacotherapy for adult depression: a meta-analysis. Eur Psychiatry (2015) 30:685–93. doi: 10.1016/j.eurpsy.2015.06.005

PubMed Abstract | CrossRef Full Text | Google Scholar

68. Doering BK, Rief W, Petrie KJ. Lessons to be learned from placebo arms in psychopharmacology trials. Handb Exp Pharmacol (2014) 225:273–90. doi: 10.1007/978-3-662-44519-8_15

PubMed Abstract | CrossRef Full Text | Google Scholar

69. Cooper AA, Conklin LR. Dropout from individual psychotherapy for major depression: a meta-analysis of randomized clinical trials. Clin Psychol Rev (2015) 40:57–65. doi: 10.1016/j.cpr.2015.05.001

PubMed Abstract | CrossRef Full Text | Google Scholar

70. Furukawa TA, Noma H, Caldwell DM, Honyashiki M, Shinohara K, Imai H, et al. Waiting list may be a nocebo condition in psychotherapy trials: a contribution from network meta-analysis. Acta Psychiatr Scand (2014) 130:181–92. doi: 10.1111/acps.12275

PubMed Abstract | CrossRef Full Text | Google Scholar

71. Suchman AL, Ader R. Classic conditioning and placebo effects in crossover studies. Clin Pharmacol Ther (1992) 52:372–7. doi: 10.1038/clpt.1992.157

PubMed Abstract | CrossRef Full Text | Google Scholar

72. Association WM. World medical association declaration of helsinki: ethical principles for medical research involving human subjects. JAMA (2013) 310:2191–4. doi: 10.1001/jama.2013.281053

PubMed Abstract | CrossRef Full Text | Google Scholar

73. Krogsboll LT, Hrobjartsson A, Gotzsche PC. Spontaneous improvement in randomised clinical trials: meta-analysis of three-armed trials comparing no treatment, placebo and active intervention. BMC Med Res Methodol (2009) 9:1. doi: 10.1186/1471-2288-9-1

PubMed Abstract | CrossRef Full Text | Google Scholar

74. Kirsch I, Sapirstein G. Listening to prozac but hearing placebo: a meta-analysis of antidepressant medication. Prev Treat (1998) 1:0002a. doi: 10.1037//1522-3736.1.0002a

CrossRef Full Text | Google Scholar

75. Zelen M. A new design for randomized clinical trials. N Engl J Med (1979) 300:1242–45. doi: 10.1056/NEJM197905313002203

PubMed Abstract | CrossRef Full Text | Google Scholar

76. Relton C, Torgerson D, O’cathain A, Nicholl J. Rethinking pragmatic randomised controlled trials: introducing the “cohort multiple randomised controlled trial” design. BMJ (2010) 340:c1066. doi: 10.1136/bmj.c1066

CrossRef Full Text | Google Scholar

77. Fava GA, Tomba E, Tossani E. Innovative trends in the design of therapeutic trials in psychopharmacology and psychotherapy. Prog Neuropsychopharmacol Biol Psychiatry (2013) 40:306–11. doi: 10.1016/j.pnpbp.2012.10.014

PubMed Abstract | CrossRef Full Text | Google Scholar

78. Weimer K, Enck P. Traditional and innovative experimental and clinical trial designs and their advantages and pitfalls. Handb Exp Pharmacol (2014) 225:237–72. doi: 10.1007/978-3-662-44519-8_14

PubMed Abstract | CrossRef Full Text | Google Scholar

79. Hesser H, Weise C, Rief W, Andersson G. The effect of waiting: a meta-analysis of wait-list control groups in trials for tinnitus distress. J Psychosom Res (2011) 70:378–84. doi: 10.1016/j.jpsychores.2010.12.006

PubMed Abstract | CrossRef Full Text | Google Scholar

80. Huckert TF, Hank P, Krampen G. [Changes in psychopathological symptoms during the waiting period for outpatient psychotherapy]. Psychother Psychosom Med Psychol (2012) 62:301–9. doi: 10.1055/s-0032-1314837

PubMed Abstract | CrossRef Full Text | Google Scholar

81. Enck P, Vinson B, Malfertheiner P, Zipfel S, Klosterhalfen S. The placebo response in functional dyspepsia–reanalysis of trial data. Neurogastroenterol Motil (2009) 21:370–77. doi: 10.1111/j.1365-2982.2008.01241.x

PubMed Abstract | CrossRef Full Text | Google Scholar

82. Zhu Z, Zhang L, Jiang J, Li W, Cao X, Zhou Z, et al. Comparison of psychological placebo and waiting list control conditions in the assessment of cognitive behavioral therapy for the treatment of generalized anxiety disorder: a meta-analysis. Shanghai Arch Psychiatry (2014) 26:319–31. doi: 10.11919/j.issn.1002-0829.214173

PubMed Abstract | CrossRef Full Text | Google Scholar

83. De Allegri M, Pokhrel S, Becher H, Dong H, Mansmann U, Kouyate B, et al. Step-wedge cluster-randomised community-based trials: an application to the study of the impact of community health insurance. Health Res Policy Syst (2008) 6:10. doi: 10.1186/1478-4505-6-10

PubMed Abstract | CrossRef Full Text | Google Scholar

84. Hunter AM, Cook IA, Leuchter AF. Impact of antidepressant treatment history on clinical outcomes in placebo and medication treatment of major depression. J Clin Psychopharmacol (2010) 30:748–51. doi: 10.1097/JCP.0b013e3181faa474

PubMed Abstract | CrossRef Full Text | Google Scholar

85. Benedetti F, Lanotte M, Lopiano L, Colloca L. When words are painful: unraveling the mechanisms of the nocebo effect. Neuroscience (2007) 147:260–71. doi: 10.1016/j.neuroscience.2007.02.020

PubMed Abstract | CrossRef Full Text | Google Scholar

86. Hauser W, Hansen E, Enck P. Nocebo phenomena in medicine: their relevance in everyday clinical practice. Dtsch Arztebl Int (2012) 109:459–65. doi: 10.3238/arztebl.2012.0459

PubMed Abstract | CrossRef Full Text | Google Scholar

87. Bingel U, Placebo Competence Team. Avoiding nocebo effects to optimize treatment outcome. JAMA (2014) 312:693–4. doi: 10.1001/jama.2014.8342

PubMed Abstract | CrossRef Full Text | Google Scholar

88. Zipfel S, Wild B, Gross G, Friederich HC, Teufel M, Schellberg D, et al. Focal psychodynamic therapy, cognitive behaviour therapy, and optimised treatment as usual in outpatients with anorexia nervosa (ANTOP study): randomised controlled trial. Lancet (2014) 383:127–37. doi: 10.1016/S0140-6736(13)61746-8

PubMed Abstract | CrossRef Full Text | Google Scholar

89. Zipfel S, Herzog W, Kruse J, Henningsen P. Psychosomatic medicine in germany: more timely than ever. Psychother Psychosom (2016) 85:262–9. doi: 10.1159/000447701

PubMed Abstract | CrossRef Full Text | Google Scholar

90. Platt R, Kass NE, Mcgraw D. Ethics, regulation, and comparative effectiveness research: time for a change. JAMA (2014) 311:1497–8. doi: 10.1001/jama.2014.2144

PubMed Abstract | CrossRef Full Text | Google Scholar

91. Connolly Gibbons MB, Gallop R, Thompson D, Luther D, Crits-Christoph K, Jacobs J, et al. Comparative effectiveness of cognitive therapy and dynamic psychotherapy for major depressive disorder in a community mental health setting: a randomized clinical noninferiority trial. JAMA Psychiatry (2016) 73:904–11. doi: 10.1001/jamapsychiatry.2016.1720

PubMed Abstract | CrossRef Full Text | Google Scholar

92. Leon AC. Evolution of psychopharmacology trial design and analysis: six decades in the making. J Clin Psychiatry (2011) 72:331–40. doi: 10.4088/JCP.10r06669

PubMed Abstract | CrossRef Full Text | Google Scholar

93. Enck P, Klosterhalfen S, Weimer K, Horing B, Zipfel S. The placebo response in clinical trials: more questions than answers. Philos Trans R Soc Lond B Biol Sci (2011) 366:1889–95. doi: 10.1098/rstb.2010.0384

PubMed Abstract | CrossRef Full Text | Google Scholar

94. King M, Nazareth I, Lampe F, Bower P, Chandler M, Morou M, et al. Conceptual framework and systematic review of the effects of participants’ and professionals’ preferences in randomised controlled trials. Health Technol Assess (2005) 91–186:iii–iv. doi: 10.3310/hta9350

CrossRef Full Text | Google Scholar

95. Merrilees CE, Goeke-Morey M, Cummings EM. Do event-contingent diaries about marital conflict change marital interactions? Behav Res Ther (2008) 46:253–62. doi: 10.1016/j.brat.2007.11.007

PubMed Abstract | CrossRef Full Text | Google Scholar

96. Gaylord SA, Whitehead WE, Coble RS, Faurot KR, Palsson OS, Garland EL, et al. Mindfulness for irritable bowel syndrome: protocol development for a controlled clinical trial. BMC Complement Altern Med (2009) 9:24. doi: 10.1186/1472-6882-9-24

PubMed Abstract | CrossRef Full Text | Google Scholar

97. Zeidan F, Johnson SK, Gordon NS, Goolkasian P. Effects of brief and sham mindfulness meditation on mood and cardiovascular variables. J Altern Complement Med (2010) 16:867–73. doi: 10.1089/acm.2009.0321

PubMed Abstract | CrossRef Full Text | Google Scholar

98. Liodden I, Sandvik L, Norheim AJ. Placebo by proxy - the influence of parental anxiety and expectancy on postoperative morbidities in children. Forsch Komplementmed (2015) 22:381–7. doi: 10.1159/000442565

PubMed Abstract | CrossRef Full Text | Google Scholar

99. Grelotti DJ, Kaptchuk TJ. Placebo by proxy. BMJ (2011) 343:d4345. doi: 10.1136/bmj.d4345

PubMed Abstract | CrossRef Full Text | Google Scholar

100. Vogtle E, Barke A, Kroner-Herwig B. Nocebo hyperalgesia induced by social observational learning. Pain (2013) 154:1427–33. doi: 10.1016/j.pain.2013.04.041

PubMed Abstract | CrossRef Full Text | Google Scholar

101. Colloca L, Benedetti F. Placebo analgesia induced by social observational learning. Pain (2009) 144:28–34. doi: 10.1016/j.pain.2009.01.033

PubMed Abstract | CrossRef Full Text | Google Scholar

102. Kramer JJ, Willemsen MC, Conijn B, Van Emst AJ, Brunsting S, Riper H. Effectiveness of a web-based self-help smoking cessation intervention: protocol of a randomised controlled trial. BMC Public Health (2009) 9:32. doi: 10.1186/1471-2458-9-32

PubMed Abstract | CrossRef Full Text | Google Scholar

103. Miller V, Carruthers HR, Morris J, Hasan SS, Archbold S, Whorwell PJ. Hypnotherapy for irritable bowel syndrome: an audit of one thousand adult patients. Aliment Pharmacol Ther (2015) 41:844–55. doi: 10.1111/apt.13145

PubMed Abstract | CrossRef Full Text | Google Scholar

104. Liegl G, Plessen CY, Leitner A, Boeckle M, Pieh C. Guided self-help interventions for irritable bowel syndrome: a systematic review and meta-analysis. Eur J Gastroenterol Hepatol (2015) 27:1209–21. doi: 10.1097/MEG.0000000000000428

PubMed Abstract | CrossRef Full Text | Google Scholar

105. Bernecker SL, Banschback K, Santorelli GD, Constantino MJ. A web-disseminated self-help and peer support program could fill gaps in mental health care: lessons from a consumer survey. JMIR Ment Health (2017) 4:e5. doi: 10.2196/mental.4751

PubMed Abstract | CrossRef Full Text | Google Scholar

106. Mohr DC, Cheung K, Schueller SM, Hendricks Brown C, Duan N. Continuous evaluation of evolving behavioral intervention technologies. Am J Prev Med (2013) 45:517–23. doi: 10.1016/j.amepre.2013.06.006

PubMed Abstract | CrossRef Full Text | Google Scholar

107. Heber E, Ebert DD, Lehr D, Cuijpers P, Berking M, Nobis S, et al. The benefit of web- and computer-based interventions for stress: a systematic review and meta-analysis. J Med Internet Res (2017) 19:e32. doi: 10.2196/jmir.5774

PubMed Abstract | CrossRef Full Text | Google Scholar

108. Schroder J, Bruckner K, Fischer A, Lindenau M, Kother U, Vettorazzi E, et al. Efficacy of a psychological online intervention for depression in people with epilepsy: a randomized controlled trial. Epilepsia (2014) 55:2069–76. doi: 10.1111/epi.12833

PubMed Abstract | CrossRef Full Text | Google Scholar

109. Fischer A, Schröder J, Vettorazzi E, Wolf OT, Pöttgen J, Lau S, et al. An online programme to reduce depression in patients with multiple sclerosis: a randomised controlled trial. Lancet Psychiatry (2015) 2:217–23. doi: 10.1016/S2215-0366(14)00049-2

PubMed Abstract | CrossRef Full Text | Google Scholar

110. Torous J, Firth J. The digital placebo effect: mobile mental health meets clinical psychiatry. Lancet Psychiatry (2016) 3:100–2. doi: 10.1016/S2215-0366(15)00565-9

PubMed Abstract | CrossRef Full Text | Google Scholar

111. Horing B, Newsome ND, Enck P, Babu SV, Muth ER. A virtual experimenter to increase standardization for the investigation of placebo effects. BMC Med Res Methodol (2016) 16:84. doi: 10.1186/s12874-016-0185-4

PubMed Abstract | CrossRef Full Text | Google Scholar

112. Giel KE, Leehr EJ, Becker S, Herzog W, Junne F, Schmidt U, et al. Relapse prevention via videoconference for anorexia nervosa - findings from the restart pilot study. Psychother Psychosom (2015) 84:381–3. doi: 10.1159/000431044

PubMed Abstract | CrossRef Full Text | Google Scholar

113. Baskin TW, Tierney SC, Minami T, Wampold BE. Establishing specificity in psychotherapy: a meta-analysis of structural equivalence of placebo controls. J Consult Clin Psychol (2003) 71:973–9. doi: 10.1037/0022-006X.71.6.973

PubMed Abstract | CrossRef Full Text | Google Scholar

114. Harris T, Brown GW, Robinson R. Befriending as an intervention for chronic depression among women in an inner city. 2: role of fresh-start experiences and baseline psychosocial factors in remission from depression. Br J Psychiatry (1999b) 174:225–32. doi: 10.1192/bjp.174.3.225

PubMed Abstract | CrossRef Full Text | Google Scholar

115. Harris T, Brown GW, Robinson R. Befriending as an intervention for chronic depression among women in an inner city. 1: randomised controlled trial. Br J Psychiatry (1999a) 174:219–24. doi: 10.1192/bjp.174.3.219

PubMed Abstract | CrossRef Full Text | Google Scholar

116. Turkington D, Sensky T, Scott J, Barnes TR, Nur U, Siddle R, et al. A randomized controlled trial of cognitive-behavior therapy for persistent symptoms in schizophrenia: a five-year follow-up. Schizophr Res (2008) 98:1–7. doi: 10.1016/j.schres.2007.09.026

CrossRef Full Text | Google Scholar

117. Turkington D, Spencer H, Lebert L, Dudley R. Befriending: active placebo or effective psychotherapy? Br J Psychiatry (2017) 211:5–6. doi: 10.1192/bjp.bp.116.197467

PubMed Abstract | CrossRef Full Text | Google Scholar

118. Hafner RJ, White MP, Handley SJ. The goldilocks placebo effect: placebo effects are stronger when people select a treatment from an optimal number of choices. Am J Psychol (2018) 131:175–84. doi: 10.5406/amerjpsyc.131.2.0175

CrossRef Full Text | Google Scholar

119. Prady SL, Burch J, Crouch S, Macpherson H. Insufficient evidence to determine the impact of patient preferences on clinical outcomes in acupuncture trials: a systematic review. J Clin Epidemiol (2013) 66:308–18. doi: 10.1016/j.jclinepi.2012.09.011

PubMed Abstract | CrossRef Full Text | Google Scholar

120. Mergl R, Henkel V, Allgaier AK, Kramer D, Hautzinger M, Kohnen R, et al. Are treatment preferences relevant in response to serotonergic antidepressants and cognitive-behavioral therapy in depressed primary care patients? Results from a randomized controlled trial including a patients’ choice arm. Psychother Psychosom (2011) 80:39–47. doi: 10.1159/000318772

PubMed Abstract | CrossRef Full Text | Google Scholar

121. Beasley MJ, Ferguson-Jones EA, Macfarlane GJ. Treatment expectations but not preference affect outcome in a trial of CBT and exercise for pain. Can J Pain (2017) 1:161–70. doi: 10.1080/24740527.2017.1384297

PubMed Abstract | CrossRef Full Text | Google Scholar

122. Karyotaki E, Smit Y, Holdt Henningsen K, Huibers MJ, Robays J, De Beurs D, et al. Combining pharmacotherapy and psychotherapy or monotherapy for major depression? A meta-analysis on the long-term effects. J Affect Disord (2016) 194:144–52. doi: 10.1016/j.jad.2016.01.036

PubMed Abstract | CrossRef Full Text | Google Scholar

123. Cuijpers P, Van Straten A, Warmerdam L, Andersson G. Psychotherapy versus the combination of psychotherapy and pharmacotherapy in the treatment of depression: a meta-analysis. Depress Anxiety (2009) 26:279–88. doi: 10.1002/da.20519

PubMed Abstract | CrossRef Full Text | Google Scholar

124. Cuijpers P, Andersson G, Donker T, Van Straten A. Psychological treatment of depression: results of a series of meta-analyses. Nord J Psychiatry (2011) 65:354–64. doi: 10.3109/08039488.2011.596570

PubMed Abstract | CrossRef Full Text | Google Scholar

125. Marusic A, Ferencic SF. Adoption of the double dummy trial design to reduce observer bias in testing treatments. J R Soc Med (2013) 106:196–8. doi: 10.1177/0141076813485350

PubMed Abstract | CrossRef Full Text | Google Scholar

126. Razza LB, Moffa AH, Moreno ML, Carvalho AF, Padberg F, Fregni F, et al. A systematic review and meta-analysis on placebo response to repetitive transcranial magnetic stimulation for depression trials. Prog Neuropsychopharmacol Biol Psychiatry (2018) 81:105–13. doi: 10.1016/j.pnpbp.2017.10.016

PubMed Abstract | CrossRef Full Text | Google Scholar

127. Hrobjartsson A, Gotzsche PC. Placebo interventions for all clinical conditions. Cochrane Database Syst Rev (2010) CD003974. doi: 10.1002/14651858.CD003974.pub3

CrossRef Full Text | Google Scholar

Keywords: placebo effects, psychotherapy, control condition, placebo response, clinical trials

Citation: Enck P and Zipfel S (2019) Placebo Effects in Psychotherapy: A Framework. Front. Psychiatry 10:456. doi: 10.3389/fpsyt.2019.00456

Received: 01 August 2018; Accepted: 10 June 2019;
Published: 26 June 2019.

Edited by:

Michael Noll-Hussong, Saarland University Hospital, Germany

Reviewed by:

Giorgio Sandrini, University of Pavia, Italy
Joel Paris, McGill University, Canada
Chantal Berna, Lausanne University Hospital (CHUV), Switzerland

Copyright © 2019 Enck and Zipfel. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Paul Enck, cGF1bC5lbmNrQHVuaS10dWViaW5nZW4uZGU=

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.