Investigating the impact of problematic evidence on clinical practice guidelines and associated patient outcomes (VITALITY Study II): protocol.

Abstract

Increasing publication of fraudulent clinical trials poses a serious threat to evidence-based medicine. In the VITALITY Study I, we demonstrated that contamination by retracted trials significantly distorts evidence synthesis. The upcoming VITALITY Study II will take a step further and investigate how such problematic evidence undermines the credibility of guideline recommendations. The VITALITY Study II will adopt a retrospective cohort design and will be structured as three work packages (WPs). To start with, a cohort of clinical practice guidelines (CPGs) that were contaminated by retracted trials and/or meta-analyses that included retracted trials will be established based on forward citation searching (WP1). Then, recommendations from these CPGs that used evidence from retracted trials and/or meta-analyses that synthesised these retracted trials will be re-evaluated after removing such problematic evidence, in terms of both the direction and strength of effect sizes (WP2). Finally, the subsequent impact on patient outcomes attributable to distorted recommendations will be estimated on a hypothetical population, measured by the number of expected benefit loss and the number of expected harm increment per 100 000 patients (WP3). Formal ethical approval is not necessary for this study as it does not involve human or animal participants, nor does it involve the collection of primary data. We will disseminate the findings through publication in peer-reviewed journals and, whenever possible, presentations at academic conferences.