J Prev Med Public Health.  2019 Sep;52(5):316-322. 10.3961/jpmph.19.125.

Reliability and Validity of the Appropriateness Evaluation Protocol for Public Hospitals in Korea

• Lee C
• Kim SJ
• Lee C
• Shin E

• KMID: 2460213
• DOI: http://doi.org/10.3961/jpmph.19.125

Abstract

OBJECTIVES
This study was conducted to assess the applicability of the Appropriateness Evaluation Protocol (AEP) for public hospitals in Korea.
METHODS
In May 2016, 1500 admission claims were collected from Korean public district hospitals using stratified random sampling. Of these claims, 560 admissions to 37 hospitals were retrieved for analysis. Medical records administrators determined the appropriateness of admission using the criteria detailed in the AEP, and a physician separately assessed the appropriateness of admission based on her clinical judgment. To examine the applicability of the AEP, the concordance of the decisions made between a pair of AEP reviewers and between an AEP reviewer and a physician reviewer was compared.
RESULTS
The results showed an almost perfect inter-rater agreement between the AEP reviewers and a moderate agreement between the AEP reviewers and the physician. The sensitivity and specificity of the AEP were calculated as 0.86 and 0.56, respectively.
CONCLUSIONS
Our findings suggest that the AEP could potentially be applied to Korean public hospitals as a reliable and valid instrument for assessing the appropriateness of admissions.

Keyword

Appropriateness Evaluation Protocol; Public hospitals; Medical records; Korea

MeSH Terms

Administrative Personnel
Hospitals, District
Hospitals, Public*
Humans
Judgment
Korea*
Medical Records
Reproducibility of Results*
Sensitivity and Specificity