Korean J healthc assoc Infect Control Prev.  2023 Dec;28(2):192-202. 10.14192/kjicp.2023.28.2.192.

A Validation Study of Surveillance Data: Focus on the Korean National Healthcare-associated Infections Surveillance System (KONIS), Intensive Care Unit Module

• Kwak YG

• KMID: 2549946
• DOI: http://doi.org/10.14192/kjicp.2023.28.2.192

Abstract

The validation of national surveillance data is crucial for identifying methodological issues, enhancing participation, and detecting data quality problems within healthcare-associated infection surveillance systems. The Korean National Healthcare-associated Infections Surveillance System (KONIS) conducted data validity assessments for the intensive care unit (ICU) module between 2008 and 2017. This paper discusses the necessity of data validation studies, reviews their status in foreign countries, and presents the methodology and findings of validation studies on KONIS ICU module data. Various validation methods, including external and internal validation, as well as case studies, have been employed to evaluate data quality and suggest areas for improvement. Given the significant resources required for external validation, the active adoption of internal validation and case studies in the KONIS to enhance data quality is suggested.

Keyword

Validation; Healthcare-associated infection; KONIS; Surveillance; ICU

Figure

• 

  Fig. 1 Participating hospitals and intensive care units (ICUs) in the Korean Healthcare-associated Infections Surveillance System since 2006.

Reference

1. Choi YH. 2018; Prospective nationwide healthcare-associated infection surveillance system in South Korea. J Korean Med Assoc. 61:21–5. DOI: 10.5124/jkma.2018.61.1.21.

2. Gastmeier P, Sohr D, Schwab F, Behnke M, Zuschneid I, Brandt C, et al. 2008; Ten years of KISS: the most important requirements for success. J Hosp Infect. 70 Suppl 1:11–6. DOI: 10.1016/S0195-6701(08)60005-5. PMID: 18994676.

3. Korean National Healthcare-associated Infections Surveillance System. KONIS ICU report. http://konis.cafe24.com/xe/reports_icu_y.

4. Korean National Healthcare-associated Infections Surveillance System. KONIS ICU manual 2016. http://konis.cafe24.com/xe/index.php?mid=manual&category=251&document_srl=6092023. (Updated on 27 August 2018).

5. Hazamy PA, Van Antwerpen C, Tserenpuntsag B, Haley VB, Tsivitis M, Doughty D, et al. 2013; Trends in validity of central line-associated bloodstream infection surveillance data, New York State, 2007-2010. Am J Infect Control. 41:1200–4. DOI: 10.1016/j.ajic.2013.06.006. PMID: 24035214.

6. Emori TG, Edwards JR, Culver DH, Sartor C, Stroud LA, Gaunt EE, et al. 1998; Accuracy of reporting nosocomial infections in intensive-care-unit patients to the National Nosocomial Infections Surveillance System: a pilot study. Infect Control Hosp Epidemiol. 19:308–16. Erratum in: Infect Control Hosp Epidemiol 1998;19:479. DOI: 10.1086/647820. PMID: 9613690.

7. Zuschneid I, Geffers C, Sohr D, Kohlhase C, Schumacher M, Ruden H, et al. 2007; Validation of surveillance in the intensive care unit component of the German nosocomial infections surveillance system. Infect Control Hosp Epidemiol. 28:496–9. DOI: 10.1086/512631. PMID: 17385161.

8. McBryde ES, Brett J, Russo PL, Worth LJ, Bull AL, Richards MJ. 2009; Validation of statewide surveillance system data on central line-associated bloodstream infection in intensive care units in Australia. Infect Control Hosp Epidemiol. 30:1045–9. DOI: 10.1086/606168. PMID: 19803720.

9. Backman LA, Melchreit R, Rodriguez R. 2010; Validation of the surveillance and reporting of central line-associated bloodstream infection data to a state health department. Am J Infect Control. 38:832–8. DOI: 10.1016/j.ajic.2010.05.016. PMID: 21093699.

10. Oh JY, Cunningham MC, Beldavs ZG, Tujo J, Moore SW, Thomas AR, et al. 2012; Statewide validation of hospital-reported central line-associated bloodstream infections: Oregon, 2009. Infect Control Hosp Epidemiol. 33:439–45. DOI: 10.1086/665317. PMID: 22476268.

11. Rich KL, Reese SM, Bol KA, Gilmartin HM, Janosz T. 2013; Assessment of the quality of publicly reported central line-associated bloodstream infection data in Colorado, 2010. Am J Infect Control. 41:874–9. DOI: 10.1016/j.ajic.2012.12.014. PMID: 23498552.

12. Thompson DL, Makvandi M, Baumbach J. 2013; Validation of central line-associated bloodstream infection data in a voluntary reporting state: New Mexico. Am J Infect Control. 41:122–5. DOI: 10.1016/j.ajic.2012.03.039. PMID: 23040607.

13. Masia MD, Barchitta M, Liperi G, Cantù AP, Alliata E, Auxilia F, et al. 2010; Validation of intensive care unit-acquired infection surveillance in the Italian SPIN-UTI network. J Hosp Infect. 76:139–42. DOI: 10.1016/j.jhin.2010.05.013. PMID: 20633960.

14. Arnold KE, Thompson ND. 2012; Building data quality and confidence in data reported to the National Healthcare Safety Network. Infect Control Hosp Epidemiol. 33:446–8. DOI: 10.1086/665311. PMID: 22476269.

15. Centers for Disease Control. 2022 Data validation resources. https://www.cdc.gov/nhsn/validation/2022.html. (Updated on 31 October 2023).

16. Bagchi S, Watkins J, Pollock DA, Edwards JR, Allen-Bridson K. 2018; State health department validations of central line-associated bloodstream infection events reported via the National Healthcare Safety Network. Am J Infect Control. 46:1290–5. DOI: 10.1016/j.ajic.2018.04.233. PMID: 29903420.

17. Bagchi S, Watkins J, Norrick B, Scalise E, Pollock DA, Allen-Bridson K. 2020; Accuracy of catheter-associated urinary tract infections reported to the National Healthcare Safety Network, January 2010 through July 2018. Am J Infect Control. 48:207–11. DOI: 10.1016/j.ajic.2019.06.006. PMID: 31326261.

18. Suetens C, Latour K, Kärki T, Ricchizzi E, Kinross P, Moro ML, et al. 2018; Prevalence of healthcare-associated infections, estimated incidence and composite antimicrobial resistance index in acute care hospitals and long-term care facilities: results from two European point prevalence surveys, 2016 to 2017. Euro Surveill. 23:1800516. Erratum in: Euro Surveill 2018;23:181122e1. DOI: 10.2807/1560-7917.ES.2018.23.46.1800516.

19. Schröder C, Behnke M, Gastmeier P, Schwab F, Geffers C. 2015; Case vignettes to evaluate the accuracy of identifying healthcare-associated infections by surveillance persons. J Hosp Infect. 90:322–6. DOI: 10.1016/j.jhin.2015.01.014. PMID: 25726431.

20. van Hauwermeiren E, Iosifidis E, Kärki T, Suetens C, Kinross P, Plachouras D. 2019; Development of case vignettes for assessment of the inter-rater variability of national validation teams for the point prevalence survey of healthcare-associated infections and antimicrobial use in European acute care hospitals. J Hosp Infect. 101:455–60. DOI: 10.1016/j.jhin.2019.01.018. PMID: 30682398.

21. Wright MO, Allen-Bridson K, Hebden JN. 2017; Assessment of the accuracy and consistency in the application of standardized surveillance definitions: a summary of the American Journal of Infection Control and National Healthcare Safety Network case studies, 2010-2016. Am J Infect Control. 45:607–11. DOI: 10.1016/j.ajic.2017.03.035. PMID: 28549513. PMCID: PMC5528141.

22. Jeon MH, Kim TH, Kim SR, Chun HK, Han SH, Bang JH, et al. 2014; Korean Nosocomial Infections Surveillance System, intensive care unit module report: summary of data from July 2011 through June 2012. Korean J Nosocomial Infect Control. 19:52–63. DOI: 10.14192/kjnic.2014.19.2.52.

23. Kwak YG, Choi JY, Yoo HM, Lee SO, Kim HB, Han SH, et al. 2017; Validation of the Korean National Healthcare-associated Infections Surveillance System (KONIS): an intensive care unit module report. J Hosp Infect. 96:377–84. DOI: 10.1016/j.jhin.2017.04.003. PMID: 28545827.

24. Song JE, Kwak YG, Oh GB, Choi YH, Kim SR, Han SH, et al. in press 2023; External and internal validation of healthcare-associated infection data collected by the Korean National Healthcare-associated Infections Surveillance System (KONIS). Am J Infect Control. DOI: 10.1016/j.ajic.2023.06.020.

25. Song JE, Oh GB, Choi YH, Kim SR, Han SH, Yoo SY, et al. 2023; A survey of the collection of denominator data in the Korean National Healthcare-associated Infections Surveillance System, intensive care unit module. Korean J healthc assoc Infect Control Prev. 28:78–84. DOI: 10.14192/kjicp.2023.28.1.78.