J Korean Med Sci.  2022 May;37(20):e163. 10.3346/jkms.2022.37.e163.

Validity of OSCE Evaluation Using the FLEX Model of Blended Learning

• Kang SH
• Kim TH
• Son HJ
• Park Y
• Lee SH

• KMID: 2530106
• DOI: http://doi.org/10.3346/jkms.2022.37.e163

Abstract

Background
For OSCE (Objective Structured Clinical Examination) scoring, medical schools must bring together many clinical experts at the same place, which is very risky in the context of the coronavirus pandemic. However, if the FLEX model with the properties of self-directed learning and offline feedback is applied to OSCE, it is possible to provide a safe and effective evaluation environment for both universities and students through experts’ evaluation of selfvideo clips of medical students. The present study investigated validity of the FLEX model to evaluate OSCE in a small group of medical students.
Methods
Sixteen 3 rd grade medical students who failed on OSCE were required to take a make-up examination by videotaping the failed items and submitting them online. The scores between original examination and make-up examination were compared using Paired Wilcoxon Signed Rank Test, and a post-hoc questionnaire was conducted.
Results
The score for make-up examination was significantly higher than those for original examination. The significance was maintained even when the score was compared by individual domains of skills and proficiency. In terms of preference, students were largely in favor of self-videotaped examination primarily due to the availability of self-practice.
Conclusion
The FLEX model can be effectively applied to medical education, especially for evaluation of OSCE.

Keyword

Checklist; Smart Phone; Clinical Skill; Competence; Video Recording; COVID-19 Pandemic

Reference

1. Jared S, Charles R. Graham, Essentials for Blended Learning: A Standards-Based Guide. 1st ed. Milton Park, Abingdon-on-Thames, Oxfordshire, England, UK: Routledge;2014.

2. Kim OJ, Jang DJ. The effect of the group counseling class, applied with blended learning for the college students. Korean J Youth Stud. 2018; 25(6):371–395.

3. Krasnova L, Shurygin V. Blended learning of physics in the context of the professional development of teachers. Int J Emerg Technol Learn. 2019; 14(23):17.

4. Maloney S, Paynter S, Storr M, Morgan P. Implementing student self-video of performance. Clin Teach. 2013; 10(5):323–327. PMID: 24015739.

5. Maloney S, Storr M, Morgan P, Ilic D. The effect of student self-video of performance on clinical skill competency: a randomised controlled trial. Adv Health Sci Educ Theory Pract. 2013; 18(1):81–89. PMID: 22354337.

6. Baumgart DC. Smartphones in clinical practice, medical education, and research. Arch Intern Med. 2011; 171(14):1294–1296. PMID: 21788549.

7. Chuang YH, Lai FC, Chang CC, Wan HT. Effects of a skill demonstration video delivered by smartphone on facilitating nursing students’ skill competencies and self-confidence: a randomized controlled trial study. Nurse Educ Today. 2018; 66:63–68. PMID: 29677580.

8. Park JY. Self-assessment, self-efficacy and satisfaction after OSCE using smart phone. J Korean Acad Soc Nurs Educ. 2012; 18(1):120–130.

9. Kim MG, Lee HS. Effects of core basic nursing education using cellular phone video recordings on self-confidence in performance, achievement, and practice satisfaction. J Korean Acad Fundam Nurs. 2017; 24(2):128–137.

10. Maloney S, Storr M, Paynter S, Morgan P, Ilic D. Investigating the efficacy of practical skill teaching: a pilot-study comparing three educational methods. Adv Health Sci Educ Theory Pract. 2013; 18(1):71–80. PMID: 22354336.

11. White CB, Ross PT, Gruppen LD. Remediating students’ failed OSCE performances at one school: the effects of self-assessment, reflection, and feedback. Acad Med. 2009; 84(5):651–654. PMID: 19704203.

12. Vivekananda-Schmidt P, Lewis M, Coady D, Morley C, Kay L, Walker D, et al. Exploring the use of videotaped objective structured clinical examination in the assessment of joint examination skills of medical students. Arthritis Rheum. 2007; 57(5):869–876. PMID: 17530689.

13. Kiehl C, Simmenroth-Nayda A, Goerlich Y, Entwistle A, Schiekirka S, Ghadimi BM, et al. Standardized and quality-assured video-recorded examination in undergraduate education: informed consent prior to surgery. J Surg Res. 2014; 191(1):64–73. PMID: 24746952.