J Prev Med Public Health.
2013 Mar;46(2):96-104.
Inappropriate Survey Design Analysis of the Korean National Health and Nutrition Examination Survey May Produce Biased Results
- Affiliations
-
- 1Department of Occupational and Environmental Medicine, Ulsan University Hospital, University of Ulsan College of Medicine, Ulsan, Korea.
- 2Department of Food and Nutrition, Hoseo University, Asan, Korea.
- 3Institue of Environmental & Occupational Medicine, Soonchunhyang University, Asan, Korea.
- 4Korea Industrial Health Association, Seoul, Korea. bklee@kiha21.or.kr
Abstract
OBJECTIVES
The inherent nature of the Korean National Health and Nutrition Examination Survey (KNHANES) design requires special analysis by incorporating sample weights, stratification, and clustering not used in ordinary statistical procedures.
METHODS
This study investigated the proportion of research papers that have used an appropriate statistical methodology out of the research papers analyzing the KNHANES cited in the PubMed online system from 2007 to 2012. We also compared differences in mean and regression estimates between the ordinary statistical data analyses without sampling weight and design-based data analyses using the KNHANES 2008 to 2010.
RESULTS
Of the 247 research articles cited in PubMed, only 19.8% of all articles used survey design analysis, compared with 80.2% of articles that used ordinary statistical analysis, treating KNHANES data as if it were collected using a simple random sampling method. Means and standard errors differed between the ordinary statistical data analyses and design-based analyses, and the standard errors in the design-based analyses tended to be larger than those in the ordinary statistical data analyses.
CONCLUSIONS
Ignoring complex survey design can result in biased estimates and overstated significance levels. Sample weights, stratification, and clustering of the design must be incorporated into analyses to ensure the development of appropriate estimates and standard errors of these estimates.
Keyword
- Full Text Links
-
- Actions
-
Cited
- CITED
-
- Close
- Share
-
- Similar articles
-
- The Current Status and the Perspectives of Nutrition Survey
- Complex sample design effects and inference for Korea National Health and Nutrition Examination Survey data
- The Current Status and the Direction for Development of the Health Interview Survey
- The Korea National Health and Nutrition Examination Survey (KNHANES): Current Status and Challenges
- The Korea National Health and Nutrition Examination Survey data linked Cause of Death data
