Abstract
Strategic Insights Into Editor Engagement With AI-Assisted Tools Based on Survey and Data Analysis of AI-Assisted Ethics Checks
Beth Waymouth,1 Heather Slater,1 Angharad Goode,1 Katie Allin,1 Maria Kowalczuk1
Objective
As publishers increasingly adopt artificial intelligence (AI)–driven tools, understanding editor engagement with AI-assisted editorial checks is crucial for maintaining publication standards. This study examines Handling Editors’ (HEs) interaction with an AI-powered check that flags manuscripts needing further verification during peer review and allows HEs and the editorial office (EOF) to collaborate on resolutions. After observing a decline in HE engagement, a survey was conducted to uncover the underlying reasons.
Design
We analyzed internal data tracking interaction with the AI-supported ethics check introduced to HEs in 2022. Existing editors were emailed about this new tool and given access and instructions, including a detailed Ethics Guidance document. Newly recruited HEs were introduced to the check during onboarding webinars. Data included the final status of the ethics check, collected quarterly between September 2022 and March 2024. Engagement was defined as the resolution of ethics checks by the HE rather than the EOF. To contextualize the engagement patterns, a survey was distributed to 4627 HEs across our journal portfolio who were active in 2024 and consented to be recontacted. Data were collected for 2 weeks in December 2024, with a reminder issued after the first week.
Results
Initial analysis showed that editor engagement dropped from 40% (2899 of 7394 total checks) to 20% (2170 of 10,692) between September 2022 and November 2023. Engagement rose to 25% (1227 of 4766 checks) between January and March 2024; however, this increase was not statistically significant. Of the surveyed editors, 725 (16%) responded to at least the first question. Of 662 respondents, 67% amended the ethics check on at least some manuscripts, with 24% interacting with the check for every manuscript. Among surveyed editors, 33% indicated that they were unaware of the check. In the “Other” category (n = 66), 38 HEs (58%) said no ethics issues required action or manuscripts didn’t need ethical approval; 4 cited unfamiliarity with the check, and 4 responded that they did not remember. Out of 478 responses from HEs not amending the check on some or all manuscripts, 67% cited an expectation that this task fell to the EOF. This was especially true when handling higher manuscript volumes (Table 25-0897).
Conclusions
These results underscore the risk of editor disengagement when AI-assisted tools lack sufficient onboarding support and adequate training. For AI integration to be effective, publishers must employ consistent monitoring of engagement and explore ways to ensure AI tools are visible, actionable, and reliably applied across editorial checkpoints.
1Frontiers Media S.A., Switzerland, maria.kowalczuk@frontiersin.org.
Conflict of Interest Disclosures
Heather Slater, Angharad Goode, Katie Allin, and Maria Kowalczuk are employees of Frontiers Media S.A. Beth Waymouth was an employee of Frontiers Media S.A. at the time when the study was conducted and when the abstract was written and originally submitted. Since May 2025, Beth Waymouth has been an independent researcher.
Acknowledgment
We would like to thank all our Handling Editors who participated in the survey. We also wish to thank our colleagues Elena Vicario and Simone Ragavooloo for their valuable suggestions and insightful comments on this project and the abstract.