Impact of active placebo controls on estimated drug effects in randomised trials: a systematic review of trials with both active placebo and standard placebo

Abstract

Background - An estimated 60% of pharmacological randomised trials use placebo control interventions to blind (i.e. mask) participants. However, standard placebos do not control for perceptible non‐therapeutic effects (i.e. side effects) of the experimental drug, which may unblind participants. Trials rarely use active placebo controls, which contain pharmacological compounds designed to mimic the non‐therapeutic experimental drug effects in order to reduce the risk of unblinding. A relevant improvement in the estimated effects of active placebo compared with standard placebo would imply that trials with standard placebo may overestimate experimental drug effects.<p>

<p>Objectives - We aimed to estimate the difference in drug effects when an experimental drug is compared with an active placebo versus a standard placebo control intervention, and to explore causes for heterogeneity. In the context of a randomised trial, this difference in drug effects can be estimated by directly comparing the effect difference between the active placebo and standard placebo intervention.<p>

<p>Search methods - We searched PubMed, CENTRAL, Embase, two other databases, and two trial registries up to October 2020. We also searched reference lists and citations and contacted trial authors.<p>

<p>Selection criteria - We included randomised trials that compared an active placebo versus a standard placebo intervention. We considered trials both with and without a matching experimental drug arm.<p>

<p>Data collection and analysis - We extracted data, assessed risk of bias, scored active placebos for adequacy and risk of unintended therapeutic effect, and categorised active placebos as unpleasant, neutral, or pleasant. We requested individual participant data from the authors of four cross‐over trials published after 1990 and one unpublished trial registered after 1990. Our primary inverse‐variance, random‐effects meta‐analysis used standardised mean differences (SMDs) of active versus standard placebo for participant‐reported outcomes at earliest post‐treatment assessment. A negative SMD favoured the active placebo. We stratified analyses by trial type (clinical or preclinical) and supplemented with sensitivity and subgroup analyses and meta‐regression. In secondary analyses, we investigated observer‐reported outcomes, harms, attrition, and co‐intervention outcomes.<p>

<p>Main results - We included 21 trials (1462 participants). We obtained individual participant data from four trials. Our primary analysis of participant‐reported outcomes at earliest post‐treatment assessment resulted in a pooled SMD of −0.08 (95% confidence interval (CI) −0.20 to 0.04; I2 = 31%; 14 trials), with no clear difference between clinical and preclinical trials. Individual participant data contributed 43% of the weight of this analysis. Two of seven sensitivity analyses found more pronounced and statistically significant differences; for example, in the five trials with low overall risk of bias, the pooled SMD was −0.24 (95% CI −0.34 to −0.13). The pooled SMD of observer‐reported outcomes was similar to the primary analysis. The pooled odds ratio (OR) for harms was 3.08 (95% CI 1.56 to 6.07), and for attrition, 1.22 (95% CI 0.74 to 2.03). Co‐intervention data were limited. Meta‐regression found no statistically significant association with adequacy of the active placebo or risk of unintended therapeutic effect.<p>

<p>Authors' conclusions - We did not find a statistically significant difference between active and standard placebo control interventions in our primary analysis, but the result was imprecise and the CI compatible with a difference ranging from important to irrelevant. Furthermore, the result was not robust, because two sensitivity analyses produced a more pronounced and statistically significant difference. We suggest that trialists and users of information from trials carefully consider the type of placebo control intervention in trials with high risk of unblinding, such as those with pronounced non‐therapeutic effects and participant‐reported outcomes.