Ann Rehabil Med.  2011 Aug;35(4):470-476. 10.5535/arm.2011.35.4.470.

Inter-rater Agreement for the Clinical Dysphagia Scale

Affiliations
  • 1Department of Rehabilitation Medicine, Seoul National University College of Medicine, Seoul 110-744, Korea. keepwiz@gmail.com

Abstract


OBJECTIVE
To investigate the inter-rater agreement for the clinical dysphagia scale (CDS). METHOD: Sixty-seven subjects scheduled to participate in a video-fluoroscopic swallowing study (VFSS) were pre-examined by two raters independently within a 24-hour interval. Each item and the total score were compared between the raters. In addition, we investigated whether subtraction of items showing low agreement or modification of rating methods could enhance inter-rater agreement without significant compromise of validity.
RESULTS
Inter-rater agreement was excellent for the total score (intraclass correlation coefficient (ICC): 0.886). Four items (lip sealing, chewing and mastication, laryngeal elevation, and reflex coughing) did not show excellent agreement (ICC: 0.696, 0.377, 0.446, and kappa: 0.723, respectively). However, subtraction of each item either compromised validity, or did not improve agreement. When redefining 'history of aspiration' and 'lesion location' items, the inter-rater agreement (ICC: 0.912, 0.888, respectively) and correlation with new videofluoroscopic dysphagia score (PCC: 0.576, 0.577, respectively) were enhanced. The CDS showed better agreement and validity in stroke patients compared to non-stroke patients (ICC: 0.917 vs 0.835, PCC: 0.663 vs 0.414).
CONCLUSION
The clinical dysphagia scale is a reliable bedside swallowing test. We can improve inter-rater agreement and validity by refining the 'history of aspiration' and 'lesion location' item.

Keyword

Deglutition disorder; Dysphagia; Reproducibility

MeSH Terms

Deglutition
Deglutition Disorders
Humans
Mastication
Reflex
Stroke

Cited by  2 articles

Effect of the Order of Test Diets on the Accuracy and Safety of Swallowing Studies
Se Hee Jung, Juyong Kim, Hyeonghui Jeong, Shi-Uk Lee
Ann Rehabil Med. 2014;38(3):304-309.    doi: 10.5535/arm.2014.38.3.304.

Practical Assessment of Dysphagia in Stroke Patients
Kyoung Moo Lee, Hyo Jong Kim
Ann Rehabil Med. 2015;39(6):1018-1027.    doi: 10.5535/arm.2015.39.6.1018.


Reference

1. Cook IJ, Dodds WJ, Dantas RO, Kern MK, Massey BT, Shaker R, Hogan WJ. Timing of videofluoroscopic, manometric events, and bolus transit during the oral and pharyngeal phases of swallowing. Dysphagia. 1989; 4:8–15. PMID: 2640180.
Article
2. Perlman AL, Palmer PM, McCulloch TM, Vandaele DJ. Electromyographic activity from human laryngeal, pharyngeal, and submental muscles during swallowing. J Appl Physiol. 1999; 86:1663–1669. PMID: 10233133.
3. Koivula I, Sten M, Makela PH. Risk factors for pneumonia in the elderly. Am J Med. 1994; 96:313–320. PMID: 8166149.
Article
4. Niederman MS, McCombs JS, Unger AN, Kumar A, Popovian R. The cost of treating community-acquired pneumonia. Clin Ther. 1998; 20:820–837. PMID: 9737840.
Article
5. Trapl M, Enderle P, Nowotny M, Teuschl Y, Matz K, Dachenhausen A, Brainin M. Dysphagia bedside screening for acute-stroke patients: the Gugging Swallowing Screen. Stroke. 2007; 38:2948–2952. PMID: 17885261.
6. Martino R, Silver F, Teasell R, Bayley M, Nicholson G, Streiner DL, Diamant NE. The Toronto Bedside Swallowing Screening Test (TOR-BSST): development and validation of a dysphagia screening tool for patients with stroke. Stroke. 2009; 40:555–561. PMID: 19074483.
7. Bates B, Choi JY, Duncan PW, Glasberg JJ, Graham GD, Katz RC, Lamberty K, Reker D, Zorowitz R. Veterans Affairs/Department of Defense Clinical Practice Guideline for the Management of Adult Stroke Rehabilitation Care: executive summary. Stroke. 2005; 36:2049–2056. PMID: 16120847.
8. Duncan PW, Zorowitz R, Bates B, Choi JY, Glasberg JJ, Graham GD, Katz RC, Lamberty K, Reker D. Management of Adult Stroke Rehabilitation Care: a clinical practice guideline. Stroke. 2005; 36:e100–e143. PMID: 16120836.
9. Han TR, Paik NJ, Park JW. The clinical functional scale for dysphagia in stroke patients. Korean J Stroke. 2001; 3:153–157.
10. Jung SH, Lee KJ, Hong JB, Han TR. Validation of clinical dysphagia scale: based on videofluoroscopic swallowing study. J Korean Acad Rehabil Med. 2005; 29:343–350.
11. Han TR, Paik NJ, Park JW, Kwon BS. The prediction of persistent dysphagia beyond six months after stroke. Dysphagia. 2008; 23:59–64. PMID: 17602263.
Article
12. Paik NJ, Kim IS, Kim JH, Oh BM, Han TR. Clinical vailidity of the functional dysphagia scale based on videofluoroscopic swallowing study. J Korean Acad Rehabil Med. 2005; 29:43–49.
13. Shrout PE, Fleiss JL. Intraclass correlations: uses in assessing rater reliability. Psychol Bull. 1979; 86:420–428. PMID: 18839484.
Article
14. Fleiss JL, Cohen J. The equivalence of weighted kappa and the intraclass correlation coefficient as measures of reliability. Educ Psychol Meas. 1973; 33:613–619.
Article
15. Fleiss JL, Nee JC, Landis JR. Large sample variance of kappa in the case of different sets of raters. Psychol Bull. 1979; 86:974–977.
Article
16. Splaingard ML, Hutchins B, Sulton LD, Chaudhuri G. Aspiration in rehabilitation patients: videofluoroscopy vs bedside clinical assessment. Arch Phys Med Rehabil. 1988; 69:637–640. PMID: 3408337.
17. DePippo KL, Holas MA, Reding MJ. Validation of the 3-oz water swallow test for aspiration following stroke. Arch Neurol. 1992; 49:1259–1261. PMID: 1449405.
Article
18. DePippo KL, Holas MA, Reding MJ. The Burke dysphagia screening test: validation of its use in patients with stroke. Arch Phys Med Rehabil. 1994; 75:1284–1286. PMID: 7993165.
Article
19. Smithard DG, O'Neill PA, Park C, England R, Renwick DS, Wyatt R, Morris J, Martin DF. Can bedside assessment reliably exclude aspiration following acute stroke? Age Ageing. 1998; 27:99–106. PMID: 16296668.
Article
20. Hinds NP, Wiles CM. Assessment of swallowing and referral to speech and language therapists in acute stroke. QJM. 1998; 91:829–835. PMID: 10024948.
Article
21. Mann G, Hankey GJ, Cameron D. Swallowing function after stroke: prognosis and prognostic factors at 6 months. Stroke. 1999; 30:744–748. PMID: 10187872.
22. Kruger E, Teasell R, Salter K, Foley N, Hellings C. The rehabilitation of patients recovering from brainstem strokes: case studies and clinical considerations. Top Stroke Rehabil. 2007; 14:56–64. PMID: 17901016.
Article
Full Text Links
  • ARM
Actions
Cited
CITED
export Copy
Close
Share
  • Twitter
  • Facebook
Similar articles
Copyright © 2024 by Korean Association of Medical Journal Editors. All rights reserved.     E-mail: koreamed@kamje.or.kr