The validity and reliability of self-interviewing skills evaluation protocol for residents in family medcine

Kwon, Hye Seuk; Kim, Jae Whoon; Park, Eal Whan; Cheng, Yoo Seock; Yoon, Sun Mi

Abstract

BACKGROUND: Medical interviewing skills are now recognized as the most important skill to be acquired for the purpose of accurate diagnosis and treatment. Among the several evaluation methods of interviewing skills, audiovisual method has the merit of allowing the fellow residents to have discussion about the interview and of receiving feedback from the teaching faculty by replaying the real interview. In addition, it allows the resident to evaluate his or her interviewing skills, The purpose of this study is to evaluate the reliability and the validity of family residents' self-interviewing skill evaluation protocol.
METHODS
A modified arizona interview rating scale which is an interviewing skill evaluating protocol has been used after Korean version became available. Six interviews with outpatients were recorded and evaluated respectively by 10 residents. The results were compared with that of Golden Standard to assess its validity. Finally, 10 residents were divided into two groups and the results among the groups were compared to evaluate the reliability of the scale.
RESULTS
The evaluation of interviewing skills conducted by the residents showed significant rate of correspondence with the Golden Standard(kappa=.22), and in the comparison of 17 evaluation items, there appeared significant correspondence in 7 items. The analysis of the rate of correspondence between the two group of residents revealed significant rate of correspondence (kappa=0.43). Lastly, the comparisons between the items showed significant rate of correspondence in ll items
CONCLUSIONS
The residents' self interviewing skill evaluation protocol showed significant validity and reliability from which it may be concluded that the protocol can be used as an effective evaluating method.