Korean J Anesthesiol.  2025 Jun;78(3):199-214. 10.4097/kja.25075.

Comprehensive reporting guidelines and checklist for studies developing and utilizing artificial intelligence models

• Kwak SG
• Kim J

• KMID: 2568209
• DOI: http://doi.org/10.4097/kja.25075

Abstract

Background
The rapid advancement of artificial intelligence (AI) in healthcare necessitates comprehensive and standardized reporting guidelines to ensure transparency, reproducibility, and ethical applications in clinical research. Existing reporting standards are limited by their focus on specific study designs. We aimed to develop a comprehensive set of guidelines and a checklist for reporting studies that develop and utilize AI models in healthcare, covering all essential components of AI research regardless of the study design.
Methods
Two experts in statistics from the Statistical Round of the Korean Journal of Anesthesiology developed these guidelines and checklist. The key elements essential for AI model reporting were identified and organized into structured sections, including study design, data preparation, model training and evaluation, ethical considerations, and clinical implementation. Iterative reviews and feedback from clinicians and researchers were used to finalize the guidelines and checklist.
Results
These guidelines provide a detailed description of each item on the checklist, ensuring comprehensive reporting of AI model research. Full details regarding the AI model specifications and data-handling processes are provided.
Conclusions
These guidelines and checklist are meant to serve as valuable tools for researchers, addressing key aspects of AI reporting, and thereby supporting the reliability, accountability, and ethical use of AI in healthcare research.

Keyword

Artificial intelligence; Health care research; Machine learning; Reproducibility of results; Statistical models; Statistics