Yonsei Med J.  2013 Jul;54(4):1040-1048. 10.3349/ymj.2013.54.4.1040.

Factors Affecting the Validity of Self-Reported Data on Health Services from the Community Health Survey in Korea

• Kim H
• Lee K
• Chang S
• Kang G
• Tak Y
• Lee M
• Kim V
• Lee J
• Jeong H

• KMID: 2158243
• DOI: http://doi.org/10.3349/ymj.2013.54.4.1040

Abstract

PURPOSE
As a follow-up for the validity study of Community Health Surveys (CHSs), the purpose of this study was to evaluate the factors affecting the accuracy of CHSs by investigating subjects' characteristics.
MATERIALS AND METHODS
We used data from 11,217 participants (aged 19 years or older) who had participated in the CHS, conducted by a local government in 2008 and analyzed the variables affecting the sensitivity and specificity of hospitalization and outpatient visit.
RESULTS
Multivariate logistic regression analysis showed that, factors related with the sensitivity of hospitalization and outpatient visit questions were gender, age, marital status, chronic diseases, medical checkup, the subjective health status and necessary medical services. Factors related with the specificity were gender, marital status, educational background, chronic diseases, medical checkup, alcohol consumption, necessary medical services and sadness.
CONCLUSION
This study revealed the subject-related factors associated with the validity of the CHS. Efforts to improve the sensitivity and the specificity from self-report questionnaires should consider how the characteristics of subjects may affect their responses.

Keyword

Validity; self-reported; healthcare utilization; community health survey

MeSH Terms

Adult
Age Factors
Ambulatory Care
Female
Health Care Surveys
Health Services/*utilization
Health Status
*Health Surveys
Hospitalization
Humans
Logistic Models
Male
Middle Aged
Questionnaires
Reproducibility of Results
Republic of Korea
Residence Characteristics
*Self Report
Young Adult

Reference

1. Lerner DJ, Lee J. Measuring Health-Related Work Productivity with Self-Reports. In : Kessler RC, Stang PE, editors. Health and Work Productivity: Making the Business Case for Quality Health Care. 2006. Chicaco, IL: University of Chicaco Press;p. 66–87.

2. Evans C, Crawford B. Patient self-reports in pharmacoeconomic studies. Their use and impact on study validity. Pharmacoeconomics. 1999; 15:241–256.

3. Ritter PL, Stewart AL, Kaymaz H, Sobel DS, Block DA, Lorig KR. Self-reports of health care utilization compared to provider records. J Clin Epidemiol. 2001; 54:136–141.

4. Petrou S, Murray L, Cooper P, Davidson LL. The accuracy of self-reported healthcare resource utilization in health economic studies. Int J Technol Assess Health Care. 2002; 18:705–710.

5. Rim H, Kim H, Lee K, Chang S, Hovell MF, Kim YT, et al. Validity of self-reported healthcare utilization data in the Community Health Survey in Korea. J Korean Med Sci. 2011; 26:1409–1414.

6. Goldman N, Lin IF, Weinstein M, Lin YH. Evaluating the quality of self-reports of hypertension and diabetes. J Clin Epidemiol. 2003; 56:148–154.

7. Ahn Y, Yoo K, Park B. Manual for medical statistics. 2005. Seoul, Korea: Press of Seoul National University;p. 142–146.

8. Raebel MA, Malone DC, Conner DA, Xu S, Porter JA, Lanty FA. Health services use and health care costs of obese and nonobese individuals. Arch Intern Med. 2004; 164:2135–2140.

9. Bhandari A, Wagner T. Self-reported utilization of health care services: improving measurement and accuracy. Med Care Res Rev. 2006; 63:217–235.

10. Short ME, Goetzel RZ, Pei X, Tabrizi MJ, Ozminkowski RJ, Gibson TB, et al. How accurate are self-reports? Analysis of self-reported health care utilization and absence when compared with administrative data. J Occup Environ Med. 2009; 51:786–796.

11. Wallihan DB, Stump TE, Callahan CM. Accuracy of self-reported health services use and patterns of care among urban older adults. Med Care. 1999; 37:662–670.

12. Raina P, Torrance-Rynard V, Wong M, Woodward C. Agreement between self-reported and routinely collected health-care utilization data among seniors. Health Serv Res. 2002; 37:751–774.

13. Marshall SF, Deapen D, Allen M, Anton-Culver H, Bernstein L, Horn-Ross PL, et al. Validating California teachers study self-reports of recent hospitalization: comparison with California hospital discharge data. Am J Epidemiol. 2003; 158:1012–1020.

14. Muhajarine N, Mustard C, Roos LL, Young TK, Gelskey DE. Comparison of survey and physician claims data for detecting hypertension. J Clin Epidemiol. 1997; 50:711–718.

15. Beckles GL, Williamson DF, Brown AF, Gregg EW, Karter AJ, Kim C, et al. Agreement between self-reports and medical records was only fair in a cross-sectional study of performance of annual eye examinations among adults with diabetes in managed care. Med Care. 2007; 45:876–883.