Individual Participant Data Meta-analysis: Approaches, Challenges and Considerations

Cover image for research topic "Individual Participant Data Meta-analysis: Approaches, Challenges and Considerations"
49K
views
78
authors
6
articles
Editors
2
Impact
Loading...
9,885 views
29 citations
9,360 views
50 citations
Original Research
24 February 2021
Multisite Comparison of MRI Defacing Software Across Multiple Cohorts
Athena E. Theyers
15 more and 
Stephen R. Arnott

With improvements to both scan quality and facial recognition software, there is an increased risk of participants being identified by a 3D render of their structural neuroimaging scans, even when all other personal information has been removed. To prevent this, facial features should be removed before data are shared or openly released, but while there are several publicly available software algorithms to do this, there has been no comprehensive review of their accuracy within the general population. To address this, we tested multiple algorithms on 300 scans from three neuroscience research projects, funded in part by the Ontario Brain Institute, to cover a wide range of ages (3–85 years) and multiple patient cohorts. While skull stripping is more thorough at removing identifiable features, we focused mainly on defacing software, as skull stripping also removes potentially useful information, which may be required for future analyses. We tested six publicly available algorithms (afni_refacer, deepdefacer, mri_deface, mridefacer, pydeface, quickshear), with one skull stripper (FreeSurfer) included for comparison. Accuracy was measured through a pass/fail system with two criteria; one, that all facial features had been removed and two, that no brain tissue was removed in the process. A subset of defaced scans were also run through several preprocessing pipelines to ensure that none of the algorithms would alter the resulting outputs. We found that the success rates varied strongly between defacers, with afni_refacer (89%) and pydeface (83%) having the highest rates, overall. In both cases, the primary source of failure came from a single dataset that the defacer appeared to struggle with - the youngest cohort (3–20 years) for afni_refacer and the oldest (44–85 years) for pydeface, demonstrating that defacer performance not only depends on the data provided, but that this effect varies between algorithms. While there were some very minor differences between the preprocessing results for defaced and original scans, none of these were significant and were within the range of variation between using different NIfTI converters, or using raw DICOM files.

14,046 views
54 citations

Background: Study-level meta-analyses have demonstrated the efficacy of cognitive–behavioural therapy for psychosis (CBTp). Limitations of conventional meta-analysis may be addressed using individual-participant-data (IPD). We aimed to determine a) whether results from IPD were consistent with study-level meta-analyses and b) whether demographic and clinical characteristics moderate treatment outcome.

Methods: We systematically searched PubMed, Embase, PsychInfo and CENTRAL. Authors of RCTs comparing CBTp with other psychological interventions were contacted to obtain original databases. Hierarchical mixed effects models were used to examine efficacy for psychotic symptoms. Patient characteristics were investigated as moderators of symptoms at post-treatment. Sensitivity analyses were conducted for risk of bias, treatment format and study characteristics.

Results: We included 14 of 23 eligible RCTs in IPD meta-analyses including 898 patients. Ten RCTs minimised risk of bias. There was no significant difference in efficacy between RCTs providing IPD and those not (p >0.05). CBTp was superior vs. other interventions for total psychotic symptoms and PANSS general symptoms. No demographic or clinical characteristics were robustly demonstrated as moderators of positive, negative, general or total psychotic symptoms at post-treatment. Sensitivity analyses demonstrated that number of sessions moderated the impact of treatment assignment (CBTp or other therapies) on total psychotic symptoms (p = 0.02).

Conclusions: IPD suggest that patient characteristics, including severity of psychotic symptoms, do not significantly influence treatment outcome in psychological interventions for psychosis while investing in sufficient dosage of CBTp is important. IPD provide roughly equivalent efficacy estimates to study-level data although significant benefit was not replicated for positive symptoms. We encourage authors to ensure IPD is accessible for future research.

12,665 views
27 citations
Open for submission
Deadline
24 May 2025
Submit a paper
Recommended Research Topics
Frontiers Logo

Frontiers in Computer Science

Creating Evidence from Real World Patient Digital Data
Edited by Jane Nikles, Eric J. Daza, Suzanne McDonald, Eric Hekler, Nicholas Schork
122.8K
views
57
authors
14
articles
Frontiers Logo

Frontiers in Public Health

Improving Disaster Health Outcomes and Resilience through Rapid Research: Implications for Public Health Policy and Practice
Edited by Stephanie Rose Montesanti, Arthur Chan, Iain Walker
375.7K
views
83
authors
17
articles
Frontiers Logo

Frontiers in Public Health

Employing Digital Footprints in Measuring Mental Health Status of Adolescent Internet Users
Edited by Tingshao Zhu, Jia Xue, Dexi Liu
37.8K
views
20
authors
8
articles
Frontiers Logo

Frontiers in Public Health

Machine Learning Approaches for Monitoring Mental Health and Substance Abuse Using Social Media Data
Edited by Dario Gregori, Tingshao Zhu, Paola Berchialla, Aslihan Senturk Acar, Danila Azzolina, Erica Secchettin
Deadline
30 Oct 2023
Submit
10.2K
views
6
articles