Abstract
Association Between Commercial Funding and Estimated Intervention Effects in Randomized Trials: The COMFIT Study
Camilla H. Nejstgaard,1,2 Gemma Clayton,3 Andreas Lundh,1,2,4 Iosief Abraha,5 Susan Armijo-Olivo,6,7 Isabelle Boutron,8,9 Robin Christensen,10,11 Bruno R. da Costa,12,13,14 Greta G. Cummings,15 Agnes Dechartres,16 Carlos Flores-Mir,17 Anders D. Frost,1,2 Toshi A. Furukawa,18 Robin Haring,19,20 Lisa Hartling,21 John P. A. Ioannidis,22,23 Mihaela Ivosevic,1,2 Perrine Janiaud,23,24 David R. T. Laursen,1,2 Helene Moustgaard,1,2 M. Hassan Murad,25 Matthew J. Page,19 Philippe Ravaud,8,9 Humam Saltaji,17 Jelena Savović,3,26 Yasushi Tsujimoto,18,27 Zhen Wang,25 Asbjørn Hróbjartsson1,2
Objective
Commercial companies often fund randomized clinical trials, and methodological studies suggest that this funding may influence trial results and conclusions.1 However, such methodological studies are often at risk of confounding given that they compare trials that differ for reasons other than funding source. The risk of confounding can be minimized in meta-epidemiological studies that compare similar trials within meta-analyses. The Commercial Funding in Trials (COMFIT) study was initiated based on a consortium of researchers who shared data sets with information on meta-analyses and trials included in meta-epidemiological studies (details available in the protocol2). The primary aim of COMFIT was to investigate the impact of commercial funding on estimated intervention effects in randomized clinical trials.
Design
The study approach was to identify meta-epidemiological studies and combine and reanalyze their meta-analysis and trial data. Studies with data on trial funding source and results were included (eg, primarily by investigating funding source or investigating a different trial characteristic and adjusting for funding source). Five bibliographic databases and other sources (eg, conference proceedings) were searched. Meta-epidemiological study authors were contacted and invited to join the COMFIT consortium and share their unpublished data. Construction of the COMFIT database involved, for example, merging data from included studies and checking data quality. Noninformative meta-analyses (eg, meta-analyses in which all trials had the same funding type) and overlapping or correlated meta-analyses and trials (eg, multiple meta-analyses included from the same systematic review) were removed. Bayesian hierarchical models were used to estimate the ratio of odds ratios (RORs) and heterogeneity statistics (to describe within- and between-study heterogeneity). A ROR <1 indicated exaggerated intervention effects in trials with commercial funding. Unadjusted and adjusted analyses using bias domains (low vs high risk of bias from sequence generation, allocation concealment, blinding, incomplete outcome data, selective reporting, and overall risk of bias) and trial sample size were performed. Subgroup and sensitivity analyses (eg, using the Sterne 2-step approach3) were performed.
Results
The COMFIT database contained data on 554 meta-analyses, with 4936 trials from 17 meta-epidemiological studies. Meta-analyses included a median (range) of 7 (2-68) trials. In total, 1368 trials (28%) had noncommercial funding, 1840 trials (37%) had sole commercial or mixed commercial and noncommercial funding, and the remaining 1728 trials (35%) did not have funding sources reported. Using data from the largest meta-epidemiological study (20% of meta-analyses, 19% of trials), the ROR for the association between commercial funding and estimated intervention effects was 0.90 (95% CI, 0.84-0.96) (preliminary findings, not the primary analysis).
Conclusions
The COMFIT database may enable comprehensive analyses of the impact of commercial funding on trial results. The primary analyses will have a markedly increased statistical power and reduced risk of confounding and reporting bias compared with previous studies.
References
1. Lundh A, Lexchin J, Mintzes B, Schroll JB, Bero L. Industry sponsorship and research outcome. Cochrane Database Syst Rev. 2017;2:MR000033. doi:10.1002/14651858.MR000033.pub3
2. Nejstgaard CH, Lundh A, Abdi S, et al. Combining meta-epidemiological study datasets on commercial funding of randomised clinical trials: database, methods, and descriptive results of the COMFIT study. Res Synth Methods. 2022;13(2):214-228. doi:10.1002/jrsm.1527
3. Sterne JAC, Jüni P, Schulz KF, Altman DG, Bartlett C, Egger M. Statistical methods for assessing the influence of study characteristics on treatment effects in “meta-epidemiological” research. Stat Med. 2002;21:1513-1524.
1Centre for Evidence-Based Medicine Odense and Cochrane Denmark, Department of Clinical Research, University of Southern Denmark, Odense, Denmark, cahansen@health.sdu.dk; 2Open Patient Data Explorative Network, Odense University Hospital, Odense, Denmark; 3Population Health Sciences, Bristol Medical School, University of Bristol, Bristol, UK; 4Department of Infectious Diseases, Hvidovre Hospital, Hvidovre, Denmark; 5Servizio Immunotrasfusionale, USL Umbria 2, Foligno, Italy; 6University of Applied Sciences, Faculty of Business and Social Sciences, Hamburg, Germany; 7Faculty of Medicine and Dentistry and Faculty of Rehabilitation Medicine, Department of Physical Therapy, Rehabilitation Research Center, Edmonton, AB, Canada; 8Université de Paris, INSERM, INRAE, CNAM, Centre of Research in Epidemiology and Statistics, Paris, France; 9Cochrane France, Paris, France; 10Section for Biostatistics and Evidence-Based Research, Parker Institute, Frederiksberg and Bispebjerg Hospital, Frederiksberg, Denmark; 11Research Unit of Rheumatology, Department of Clinical Research, University of Southern Denmark, Odense University Hospital, Odense, Denmark; 12Applied Health Research Centre, Li Ka Shing Knowledge Institute of St Michael’s Hospital, Toronto, ON, Canada; 13Institute of Health Policy, Management and Evaluation, University of Toronto, Toronto, ON, Canada;14Institute of Primary Health Care, University of Bern, Bern, Switzerland; 15Faculty of Nursing, University of Alberta, Edmonton, AB, Canada; 16Sorbonne Université, INSERM, Institut Pierre Louis d’Epidémiologie et de Santé Publique, APHP, Sorbonne Université, Hôpital Pitié Salpêtrière, Département de Santé Publique, Centre de Pharmacoépidémiologie, Paris, France; 17Department of Dentistry, Faculty of Medicine and Dentistry, University of Alberta, Edmonton, AB, Canada; 18Department of Health Promotion and Human Behavior, Kyoto University Graduate School of Medicine/School of Public Health, Kyoto, Japan; 19School of Public Health and Preventive Medicine, Monash University, Melbourne, Victoria, Australia; 20European University of Applied Sciences, Brühl, Germany; 21Alberta Research Centre for Health Evidence, Department of Pediatrics, University of Alberta, Edmonton, AB, Canada; 22Stanford Prevention Research Center Department of Medicine, Stanford University, Palo Alto, CA, USA; 23Meta-Research Innovation Center at Stanford, Stanford University, Palo Alto, CA, USA; 24Department of Clinical Research, University Hospital Basel, University of Basel, Basel, Switzerland; 25Evidence-Based Practice Center, Mayo Clinic, Rochester, MN, USA; 26NIHR Applied Research Collaboration West, University Hospitals Bristol and Weston NHS Foundation Trust, Bristol, UK; 27Scientific Research Works Peer Support Group, Japan
Conflict of Interest Disclosures
Asbjørn Hróbjartsson and Andreas Lundh are currently members of the TACIT steering group to develop a tool for addressing conflicts of interest in trials. Toshi A. Furukawa reported receiving grants and personal fees from Mitsubishi-Tanabe and Shionogi, receiving personal fees from Sony outside the submitted work, and having patent 2020-548587 concerning smartphone cognitive behavioral applications pending and intellectual properties for the Kokoro application licensed to Mitsubishi-Tanabe. Jelena Savović was paid by Core Models to deliver an online teaching session of basic evidence synthesis methods. John P. A. Ioannidis is co-director and Isabelle Boutron is an advisory board member of the Peer Review Congress, but they were not involved in the review or decision for this abstract.