J Educ Eval Health Prof.  2012;9:9.

An objective structured biostatistics examination: a pilot study based on computer-assisted evaluation for undergraduates

• Khan AS
• Acemoglu H
• Akturk Z

Abstract

We designed and evaluated an objective structured biostatistics examination (OSBE) on a trial basis to determine whether it was feasible for formative or summative assessment. At Ataturk University, we have a seminar system for curriculum for every cohort of all five years undergraduate education. Each seminar consists of an integrated system for different subjects, every year three to six seminars that meet for six to eight weeks, and at the end of each seminar term we conduct an examination as a formative assessment. In 2010, 201 students took the OSBE, and in 2011, 211 students took the same examination at the end of a seminar that had biostatistics as one module. The examination was conducted in four groups and we examined two groups together. Each group had to complete 5 stations in each row therefore we had two parallel lines with different instructions to be followed, thus we simultaneously examined 10 students in these two parallel lines. The students were invited after the examination to receive feedback from the examiners and provide their reflections. There was a significant (P=0.004) difference between male and female scores in the 2010 students, but no gender difference was found in 2011. The comparison among the parallel lines and among the four groups showed that two groups, A and B, did not show a significant difference (P>0.05) in either class. Nonetheless, among the four groups, there was a significant difference in both 2010 (P=0.001) and 2011 (P=0.001). The inter-rater reliability coefficient was 0.60. Overall, the students were satisfied with the testing method; however, they felt some stress. The overall experience of the OSBE was useful in terms of learning, as well as for assessment.

Keyword

Objective structured biostatistics examination; Assessment

MeSH Terms

Biostatistics
Cohort Studies
Curriculum
Female
Humans
Learning
Male
Pilot Projects

Reference

1. Vivekananda-Schmidt P, Lewis M, Coady D, Morley C, Kay L, Walker D, Hassell AB. Exploring the use of videotaped objective structured clinical examination in the assessment of joint examination skills of medical students. Arthritis Rheum. 2007; 57:869–76.

2. Elfes C. Focus on three domains for the clinical skills assessment exam. Practitioner. 2007; 251:107–11.

3. Windish DM, Huot SJ, Green ML. Medicine residents’ understanding of the biostatistics and results in the medical literature. JAMA. 2007; 298:1010–22.

4. West CP, Ficalora RD. Clinician attitudes toward biostatistics. Mayo Clin Proc. 2007; 82:939–43.

5. Gilani SM, Ahmed J, Abbas MA. Electronic document management: a paperless university model. In : 2nd IEEE International Conference on Computer Science and Information Technology 2009; 2009 Aug 8–11; Beijing, China. p. 435–9.

6. Epstein RM. Assessment in medical education. N Engl J Med. 2007; 356:387–96.

7. Jefferies A, Simmons B, Tabak D, McIlroy JH, Lee KS, Roukema H, Skidmore M. Using an objective structured clinical examination (OSCE) to assess multiple physician competencies in postgraduate training. Med Teach. 2007; 29:183–91.

8. Rushforth HE. Objective structured clinical examination (OSCE): review of literature and implications for nursing education. Nurse Educ Today. 2007; 27:481–90.

9. Huang YS, Liu M, Huang CH, Liu KM. Implementation of an OSCE at Kaohsiung Medical University. Kaohsiung J Med Sci. 2007; 23:161–9.

10. Ali A. The objective structured public health examination (OSPHE): work-based learning for a new exam. Work Based Learn Prim Care. 2007; 5:119–22.

11. Menezes RG, Nayak VC, Binu VS, Kanchan T, Rao PP, Baral P, Lobo SW. Objective structured practical examination (OSPE) in Forensic Medicine: students’ point of view. J Forensic Leg Med. 2011; 18:347–9.

12. Slater JA, Lujan HL, DiCarlo SE. Does gender influence learning style preferences of first-year medical students? Adv Physiol Educ. 2007; 31:336–42.

13. Prajapati B, Dunne M, Bartlett H, Cubbidge R. The influence of learning styles, enrollment status and gender on academic performance of optometry undergraduates. Ophthalmic Physiol Opt. 2011; 31:69–78.

14. Abe S, Kawada E. Development of computer-based OSCE re-examination system for minimizing inter-examiner discrepancy. Bull Tokyo Dent Coll. 2008; 49:1–6.