Korean Med Educ Rev.  2020 Oct;22(3):198-206. 10.17496/kmer.2020.22.3.198.

Analysis  of  the  Satisfaction  with  Computer  Based  Test  Program  and  Test  Environment  in  Medical  School

• Kim SG
• Lee Ah
• Hwang Is

• KMID: 2508272
• DOI: http://doi.org/10.17496/kmer.2020.22.3.198

Abstract

This study aimed to identify needed improvements to current evaluation methods in medical school computer-based test (CBT) programs and test environments. To that end, an analysis of the importance and satisfaction was conducted through a survey of 3rd and 4th year medical students who had sufficient experience with CBT programs. Importance performance analysis methodology using the correlation coefficient was applied to assess average satisfaction and importance. The first quadrant (keep up the good work) was a factor of review and time management and test facilities among the conveniences of the CBT program. The second quadrant (concentrate here) was a factor of the convenience of the CBT program and computer monitor and chair factor within the test facilities. The third quadrant (low priority) was a factor of cheating and computer failure. The fourth quadrant (possible overkill) was the location, spacing, and temperature factors of the test facilities. Improvements are needed to reduce ‘eye fatigue’ and help students focus and understand the questions in the CBT programs. It is necessary to improve computer monitors, desks and chairs, and consider the subject’s body type and manager in order to cope with computer breakdown and peripheral failures. Spare computers are needed. These findings are meaningful in that they have been able to identify factors that require improvement in the CBT program and test environment resulting from changes in assessment tools.

Keyword

Computer-based test; Evaluation; Importance performance analysis; Medical education