Perspect Nurs Sci.  2014 Oct;11(2):153-161. 10.16952/pns.2014.11.2.153.

Comparison of Teacher's and Students' Evaluations on OSCE Performance among College Nursing Students

• Iikura A
• Suh E

• KMID: 2315704
• DOI: http://doi.org/10.16952/pns.2014.11.2.153

Abstract

PURPOSE
This study was aimed to compare and contrast the evaluation scores on students OSCE performance between the instructors and students according to the Bloom's taxonomy.
METHODS
A total of sixty six students in a nursing college in Seoul, Korea and four instructors were recruited in the study. The 28 sophomore students were assigned to an OSCE on intravenous injection, whereas 38 junior students on tracheostomy care. Knowledge levels were measured by the students using the researcher developed knowledge questionnaires, and the attitudes and skills by the students and instructors by the modified clinical performance checklists. The data were analyzed by SPSS 22.0 program.
RESULTS
For knowledge, the higher GPA of the previous semester was only significant factor of higher knowledge scores. There were statistically significant differences in scores of total (t=-2.740, p=.008) and skill (t=-2.528, p=0.014), but not in attitude between the instructors and students' evaluations. The students evaluated their skill scores significantly higher than those of the instructors. For knowledge, the higher GPA of the previous semester was the only significant factor of higher knowledge scores. In attitude scores, the students in higher grade significantly overestimated themselves (t=3.076, p=.003).
CONCLUSION
Clinical performance assessment requires methodological validity and reliability for student to attain necessary clinical skills properly and efficiently. The findings of this study mandate various assessment methods for nursing simulation evaluations to be valid.

Keyword

Nursing; Simulation; Evaluation; Practice; Objective structured clinical examination

MeSH Terms

Checklist
Classification
Clinical Competence
Humans
Injections, Intravenous
Korea
Nursing
Surveys and Questionnaires
Reproducibility of Results
Seoul
Students, Nursing*
Tracheostomy

Reference

1. Japanese Ministry of Health Law. Study report on the role of technical education in basic nursing education. 2003. [cited 2014 March 23]. Available from:. http://www.mhlw.go.jp/shingi/2003/03/s0317-4.html.

2. Harden RM, Stevenson M, Downie WW, Wilson GM. Assessment of clinical competence using objective structured examination. Br Med J. 1975; 1:447–51.

3. Kajita E. Kyouiku hyouka dai (Education evaluation). 2nd ed.Tokyo, Japan: YuhikakuSousho;2010.

4. Takahashi A, Arita K, Kuratani N, Imaizumi K, Taniyama M, Ito Y. Jyomyakuketsusaiketsu' ensyuniokerugakusei' kyouin-kan no hyouka no hikaku(A comparison of students' and teacher' evaluation on simulation practice of collecting blood). Bull Kawasaki City Coll Nurs. 2007; 12:9–15.

5. Nakamura K. Kango OSCE (Nursing OSCE). Tokyo. Japan: Medical-friend Sha;2011.

6. Kinoshita Y, Kawakami C. Literature review on evaluation of goal achievement in clinical nursing practice. Memoirs Department of Health Science School of Medicine Kyushu University. 2007; 8:49–58.

7. Sugimori M, Funashima N. Kango Kyouiku (Nursing Education). Tokyo. Japan: IgakuShoin;2012.

8. Han MH, Park SG. Differences between scores assessed by examiners and examinees on objective structured clinical examination. Korean J Med Educ. 2009; 21:279–85.

9. Han MH, Park SG. Analysis of trends in self-assessment of performance of clinical skills in nursing students after OSCE. J Korean Acad Fundam Nurs. 2011; 18:210–6.

10. Tajima K. Kangogakukyouikuhyouka no kiso to jissai-kango-jissennouryokuikuseinojyujitunimukete (Fundamental and practice of education evaluation of nursing-for fruitful upbringing of nursing competence). Tokyo. Japan: IgakuShoin;2011.

11. Abadel FT, Hattab AS. How does the medical graduates' self-assessment of their clinical competency differ from experts' assessment? BMC Med Educ. 2013; 13(24):1–9. http://dx.doi.org/10.1186/1472-6920-13-24.

12. Baxter P, Norman G. Self-assessment or self deception? A lack of association between nursing students' self-assessment and performance. J Adv Nurs. 2011; 67:2406–13. http://dx.doi.org/10.1111/j.1365-2648.2011.05658.x.

13. Corcoran AM, Lysaght S, LaMarra D, Ersek M. Pilot test of a three-station palliative care observed structured clinical examination for multidisciplinary trainees. J Nurs Educ. 2013; 52:294–8.

14. Paul F. An exploration of student nurses' thoughts and experiences of using a video-recording to assess their performance of cardiopulmonary resuscitation (CPR) during a mock objective structured clinical examination (OSCE). Nurs Educ Pract. 2010; 10:285–90.

15. White CB, Ross PT, Gruppen LD. Remediating students' failed OSCE performances at one school: The effects of self-assessment, reflection, and feedback. Acad Med. 2009; 84:651–4.

16. Blanch-Hartigan D. Medical students' self-assessment of performance: Results from three meta-analyses. Patient Educ Couns. 2011; 84:3–9. http://dx.doi:10.1016/j.pec.2010.06.037.

17. Kruger J, Dunning D. Unskilled and unaware of it: How difficulties in recognizing one's own incompetence lead to inflated self-assessments. J Pers Soc Psychol. 1999; 77:1121–34.

18. Hodges B, Regehr G, Martin D. Difficulties in recognizing one's own incompetence: Novice physicians who are unskilled and unaware of it. Academic Medicine. 2001; 76:S87–9. http://dx.doi.org/10.1097/00001888-200110001-00029.

19. Parker RW, Alford C, Passmore C. Can family medicine residents predict their performance on the in-training examination? Fam Med. 2004; 36(10):705–9.

20. Roter DL, Larson S, Shinitzky H, Chernoff R, Serwint JR, Ada-mo G, et al. Use of an innovative video feedback technique to enhance communication skills training. Med Educ. 2004; 38(2):145–57.

21. Uchida R, Tsuchiya Y, Akahoshi N, Yamada M, Ogata S, Oku S. On trial of objective structured clinical examination in adult nursing. South Kyusyu J Nurs. 2008; 6:55–61.

22. Japan Youth Research Institute. Koukouseino kokoroto kara-dano kenkouni kansuru chousa (Research on the health of body and mind in high school students). 2012. [cited 2014 March, 20]. Available from:. http://www1.odn.ne.jp/~aaa25710/reserch/2011/gaiyo.pdf.