Clin Exp Emerg Med.  2022 Dec;9(4):345-353. 10.15441/ceem.22.354.

Development and validation of interpretable machine learning models for inpatient fall events and electronic medical record integration

Affiliations
  • 1Department of Nursing, Samsung Medical Center, Seoul, Korea
  • 2Department of Digital Health, Samsung Advanced Institute for Health Science & Technology (SAIHST), Sungkyunkwan University, Seoul, Korea
  • 3Digital and Smart Health Office, Tan Tock Seng Hospital (TTSH), Singapore
  • 4Digital Innovation Center, Samsung Medical Center, Seoul, Korea
  • 5Department of Nursing, Inha University, Incheon, Korea
  • 6Department of Emergency Medicine, Samsung Medical Center, Sungkyunkwan University School of Medicine, Seoul, Korea

Abstract


Objective
Falls are one of the most frequently occurring adverse events among hospitalized patients. The Morse Fall Scale, which has been widely used for fall risk assessment, has the two limitations of low specificity and difficulty in practical implementation. The aim of this study was to develop and validate an interpretable machine learning model for prediction of falls to be integrated in an electronic medical record (EMR) system.
Methods
This was a retrospective study involving a tertiary teaching hospital in Seoul, Korea. Based on the literature, 83 known predictors were grouped into seven categories. Interpretable fall event prediction models were developed using multiple machine learning models including gradient boosting and Shapley values.
Results
Overall, 191,778 cases with 272 fall events (0.1%) were included in the analysis. With the validation cohort of 2020, the area under the receiver operating curve (AUROC) of the gradient boosting model was 0.817 (95% confidence interval [CI], 0.720–0.904), better performance than random forest (AUROC, 0.801; 95% CI, 0.708–0.890), logistic regression (AUROC, 0.802; 95% CI, 0.721–0.878), artificial neural net (AUROC, 0.736; 95% CI, 0.650–0.821), and conventional Morse fall score (AUROC, 0.652; 95% CI, 0.570–0.715). The model’s interpretability was enhanced at both the population and patient levels. The algorithm was later integrated into the current EMR system.
Conclusion
We developed an interpretable machine learning prediction model for inpatient fall events using EMR integration formats.

Keyword

Accidental falls; Machine learning; Patient safety; Nursing informatics
Full Text Links
  • CEEM
Actions
Cited
CITED
export Copy
Close
Share
  • Twitter
  • Facebook
Similar articles
Copyright © 2024 by Korean Association of Medical Journal Editors. All rights reserved.     E-mail: koreamed@kamje.or.kr