Abstract
Individual-Participant Data Meta-Analysis Methodological Guidance: A Systematic Review
Edith Otalike,1 Mike Clarke,2 Ngianga-Bakwin Kandala,1 Joel J. Gagnier1,3
Objective
Individual-participant data meta-analysis (IPD-MA) is regarded as the criterion standard in evidence synthesis, but it is resource intensive. While there is consensus on reporting items, a consensus-based tool for the critical appraisal of the methodological quality of IPD-MA does not currently exist. We undertook a systematic methodology review as the initial phase in the development of a critical appraisal checklist. This review collated and summarized the available methodological guidance on IPD-MA of randomized and observational studies.
Design
We followed the guidelines for Cochrane Methodology Reviews and reported following the PRISMA 2020 guidance. We performed an electronic search of MEDLINE, Embase, CINAHL, Web of Science Scopus, Cochrane Methodology Registry, CONSORT Database of Methodological Papers, Health Technology Assessment Review Database, Research Synthesis Methods, and Journal of the Royal Statistical Society covering publications from 1946 to June 2024. We included studies published in English that addressed any methodological guidance and essential statistical and software requirements for IPD-MA. Data extraction focused on study characteristics, domain of the review process, and the specific recommendations. Risk of bias was assessed using resources relevant to the study design. A thematic synthesis was performed to group recurring themes into domains. For each domain, signalling questions were generated to develop a preliminary checklist for assessment and refinement in a 2-round e-Delphi survey involving international IPD-MA experts.
Results
The literature search yielded 13,589 citations. After screening 9436 unique abstracts and reviewing 286 full texts, we included 130 articles that met our inclusion criteria. These articles consisted of narrative reviews, handbooks, critical reviews, empirical studies, and statistical method articles. They were published between 1995 and 2024, with most originating from the UK (62 [48%]), the US (20 [15%]), and the Netherlands (16 [12%]) and 50 (38%) originating from 10 other countries. Most of these studies had a low risk of bias. We identified 14 domains of guidance for conducting and reporting of IPD-MA, and we categorized them into 5 sections (Table 25-0999). This finding informed the initial version of the checklist to be evaluated in the e-Delphi survey.
Conclusions
There are many recommendations in the literature on the general conduct of IPD-MA and on specific aspects of this research, which would benefit from consensus recommendations for all aspects of IPD-MA and critical appraisal of reports. This review provides many suggestions for these recommendations, and our e-Delphi survey will seek consensus on items to include in the critical appraisal tool, which we expect to be completed in 2025.
1Department of Epidemiology & Biostatistics, Schulich School of Medicine & Dentistry, Western University, London, Ontario, Canada, eotalike@uwo.ca; 2Northern Ireland Methodology Hub, Queen’s University Belfast, Northern Ireland, UK; 3Department of Surgery, Schulich School of Medicine & Dentistry, Western University, London, Ontario, Canada.
Conflict of Interest Disclosures
Edith Otalike receives internal funding from Western University and the Dean’s Research Scholarship award. No other disclosures were reported.
Additional Information
Joel J. Gagnier is a co–corresponding author (jgagnie4@uwo.ca).