J Educ Eval Health Prof.  2016;13:8. 10.3352/jeehp.2016.13.8.

Changing medical students' perception of the evaluation culture: Is it possible?

• Colbert-Getz JM
• Baumann S

• KMID: 2413757
• DOI: http://doi.org/10.3352/jeehp.2016.13.8

Abstract

Student feedback is a critical component of the teacher-learner cycle. However, there is not a gold standard course or clerkship evaluation form and limited research on the impact of changing the evaluation process. Results from a focus group and pre-implementation feedback survey coupled with best practices in survey design were used to improve all course/clerkship evaluation for academic year 2013-2014. In spring 2014 we asked all subjected students in University of Utah School of Medicine, United States of America to complete the same feedback survey (post-implementation survey). We assessed the evaluation climate with 3 measures on the feedback survey: overall satisfaction with the evaluation process; time students gave effort to the process; and time students used shortcuts. Scores from these measures were compared between 2013 and 2014 with Mann-Whitney U-tests. Response rates were 79% (254) for 2013 and 52% (179) for 2014. Students' overall satisfaction score were significantly higher (more positive) post-implementation compared to pre-implementation (P<0.001). There was no change in the amount of time students gave effort to completing evaluations (P=0.981) and no change for the amount of time they used shortcuts to complete evaluations (P=0.956). We were able to change overall satisfaction with the medical school evaluation culture, but there was no change in the amount of time students gave effort to completing evaluations and times they used shortcuts to complete evaluations. To ensure accurate evaluation results we will need to focus our efforts on time needed to complete course evaluations across all four years.

Keyword

Feedback; Focus groups; Personal satisfaction; Medical schools; United States

MeSH Terms

Americas
Climate
Focus Groups
Humans
Personal Satisfaction
Practice Guidelines as Topic
Schools, Medical
United States
Utah

Reference

References

1. McOwen KS, Bellini LM, Morrison G, Shea JA. The development and implementation of a health-system-wide evaluation system for education activities: build it and they will come. Acad Med 2009. 2009; 84:1352–1359. http://dx.doi.org/10.1097/ACM.0b013e3181b6c996.

2. Schiekirka S, Reinhardt D, Heim S, Fabry G, Pukrop T, Anders S, Raupach T. Student perceptions of evaluation in undergraduate medical education: a qualitative study from one medical school. BMC Med Educ. 2012; 12:45. http://dx.doi.org/10.1186/1472-6920-12-45.