Korean J Med Educ.  1994 Apr;5(2):11-17.

Analysis of Korean National Medical Licensing Examination Question Items of 1992~1993 on their Levels of Cognitive Domain, Types of Multiple Choice Questions and the Contents of Medical Knowledge Tested

• Meng KH
• Kang BK
• Lee SH

Abstract

Multiple Choice Question(MCQ) method of examination has long been used as the national medical licensing examination in Korea. If properly used, the MCQ method of examination has considerable value fo r evaluation, and in fact, it has become popular due to its economy of scale, ease of marking and consistency. Moreover, with this method of examination, a large number of candidates can be tested at once and the marking can even be read by automatic readers. However, MCQ does not lend itself so well to problem-solving, which is a far more real-life situation than having to choose between a number of pre-formed alternatives. This, again, however, can be much improved by increasing the proportion of question items associated with interpretation and problem solving level of cognitive domain, and adopting various types of MCQ. This study was planned to examine the proportions of question items by their levels of cognitive domains and the types MCQ together with the contents of medical knowledge of the Korean National Medical Licensing Examinations (NMLE) conducted in 1992 and 1993. All 880 question items (440 question items in each year) were reviewed one by one by three medical education specialists and the levels of cognitive domains, types of MCQ and contents of questions were judged by test subjects. Major findings obtained from the study are as follows: 1) In both years of 1992 and 1993, recall level question items formed 68.0% of all MCQ question items of NMLE. Problem-solving level question items were only 77.% in 1992 and 11.1% in 1993. 2) Major types of MCQ were 'best answer type' one correct answer type'. They were 40.7% and 30.9% of all respectively in 1992, and 35.0% and 32.0% respectively in 1993. Some subjects such as urology and internal medicine were adopting more 'combined response type' MCQ than other subjects. 3) Knowledge contents asked in the NMLE varied very much from subject to subject. However, the names of diseases were the most prevalent answers asked and they were 21.6% in 1992 and 18.2% in 1993. This study suggests that the Korean NMLE should increase the proportion of question items measuring the interpretation and/or problem-solving level of knowledge, and adopt several different types of MCQ.

MeSH Terms

Education, Medical
Internal Medicine
Korea
Licensure*
Problem Solving
Specialization
Urology