Ann Rehabil Med.  2011 Aug;35(4):470-476. 10.5535/arm.2011.35.4.470.

Inter-rater Agreement for the Clinical Dysphagia Scale

• Chun SW
• Lee SA
• Jung IY
• Beom J
• Han TR
• Oh BM

• KMID: 1971711
• DOI: http://doi.org/10.5535/arm.2011.35.4.470

Abstract

OBJECTIVE
To investigate the inter-rater agreement for the clinical dysphagia scale (CDS). METHOD: Sixty-seven subjects scheduled to participate in a video-fluoroscopic swallowing study (VFSS) were pre-examined by two raters independently within a 24-hour interval. Each item and the total score were compared between the raters. In addition, we investigated whether subtraction of items showing low agreement or modification of rating methods could enhance inter-rater agreement without significant compromise of validity.
RESULTS
Inter-rater agreement was excellent for the total score (intraclass correlation coefficient (ICC): 0.886). Four items (lip sealing, chewing and mastication, laryngeal elevation, and reflex coughing) did not show excellent agreement (ICC: 0.696, 0.377, 0.446, and kappa: 0.723, respectively). However, subtraction of each item either compromised validity, or did not improve agreement. When redefining 'history of aspiration' and 'lesion location' items, the inter-rater agreement (ICC: 0.912, 0.888, respectively) and correlation with new videofluoroscopic dysphagia score (PCC: 0.576, 0.577, respectively) were enhanced. The CDS showed better agreement and validity in stroke patients compared to non-stroke patients (ICC: 0.917 vs 0.835, PCC: 0.663 vs 0.414).
CONCLUSION
The clinical dysphagia scale is a reliable bedside swallowing test. We can improve inter-rater agreement and validity by refining the 'history of aspiration' and 'lesion location' item.

Keyword

Deglutition disorder; Dysphagia; Reproducibility

MeSH Terms

Deglutition
Deglutition Disorders
Humans
Mastication
Reflex
Stroke

Reference

1. Cook IJ, Dodds WJ, Dantas RO, Kern MK, Massey BT, Shaker R, Hogan WJ. Timing of videofluoroscopic, manometric events, and bolus transit during the oral and pharyngeal phases of swallowing. Dysphagia. 1989; 4:8–15. PMID: 2640180.

2. Perlman AL, Palmer PM, McCulloch TM, Vandaele DJ. Electromyographic activity from human laryngeal, pharyngeal, and submental muscles during swallowing. J Appl Physiol. 1999; 86:1663–1669. PMID: 10233133.

3. Koivula I, Sten M, Makela PH. Risk factors for pneumonia in the elderly. Am J Med. 1994; 96:313–320. PMID: 8166149.

4. Niederman MS, McCombs JS, Unger AN, Kumar A, Popovian R. The cost of treating community-acquired pneumonia. Clin Ther. 1998; 20:820–837. PMID: 9737840.

5. Trapl M, Enderle P, Nowotny M, Teuschl Y, Matz K, Dachenhausen A, Brainin M. Dysphagia bedside screening for acute-stroke patients: the Gugging Swallowing Screen. Stroke. 2007; 38:2948–2952. PMID: 17885261.

6. Martino R, Silver F, Teasell R, Bayley M, Nicholson G, Streiner DL, Diamant NE. The Toronto Bedside Swallowing Screening Test (TOR-BSST): development and validation of a dysphagia screening tool for patients with stroke. Stroke. 2009; 40:555–561. PMID: 19074483.

7. Bates B, Choi JY, Duncan PW, Glasberg JJ, Graham GD, Katz RC, Lamberty K, Reker D, Zorowitz R. Veterans Affairs/Department of Defense Clinical Practice Guideline for the Management of Adult Stroke Rehabilitation Care: executive summary. Stroke. 2005; 36:2049–2056. PMID: 16120847.

8. Duncan PW, Zorowitz R, Bates B, Choi JY, Glasberg JJ, Graham GD, Katz RC, Lamberty K, Reker D. Management of Adult Stroke Rehabilitation Care: a clinical practice guideline. Stroke. 2005; 36:e100–e143. PMID: 16120836.

9. Han TR, Paik NJ, Park JW. The clinical functional scale for dysphagia in stroke patients. Korean J Stroke. 2001; 3:153–157.

10. Jung SH, Lee KJ, Hong JB, Han TR. Validation of clinical dysphagia scale: based on videofluoroscopic swallowing study. J Korean Acad Rehabil Med. 2005; 29:343–350.

11. Han TR, Paik NJ, Park JW, Kwon BS. The prediction of persistent dysphagia beyond six months after stroke. Dysphagia. 2008; 23:59–64. PMID: 17602263.

12. Paik NJ, Kim IS, Kim JH, Oh BM, Han TR. Clinical vailidity of the functional dysphagia scale based on videofluoroscopic swallowing study. J Korean Acad Rehabil Med. 2005; 29:43–49.

13. Shrout PE, Fleiss JL. Intraclass correlations: uses in assessing rater reliability. Psychol Bull. 1979; 86:420–428. PMID: 18839484.

14. Fleiss JL, Cohen J. The equivalence of weighted kappa and the intraclass correlation coefficient as measures of reliability. Educ Psychol Meas. 1973; 33:613–619.

15. Fleiss JL, Nee JC, Landis JR. Large sample variance of kappa in the case of different sets of raters. Psychol Bull. 1979; 86:974–977.

16. Splaingard ML, Hutchins B, Sulton LD, Chaudhuri G. Aspiration in rehabilitation patients: videofluoroscopy vs bedside clinical assessment. Arch Phys Med Rehabil. 1988; 69:637–640. PMID: 3408337.

17. DePippo KL, Holas MA, Reding MJ. Validation of the 3-oz water swallow test for aspiration following stroke. Arch Neurol. 1992; 49:1259–1261. PMID: 1449405.

18. DePippo KL, Holas MA, Reding MJ. The Burke dysphagia screening test: validation of its use in patients with stroke. Arch Phys Med Rehabil. 1994; 75:1284–1286. PMID: 7993165.

19. Smithard DG, O'Neill PA, Park C, England R, Renwick DS, Wyatt R, Morris J, Martin DF. Can bedside assessment reliably exclude aspiration following acute stroke? Age Ageing. 1998; 27:99–106. PMID: 16296668.

20. Hinds NP, Wiles CM. Assessment of swallowing and referral to speech and language therapists in acute stroke. QJM. 1998; 91:829–835. PMID: 10024948.

21. Mann G, Hankey GJ, Cameron D. Swallowing function after stroke: prognosis and prognostic factors at 6 months. Stroke. 1999; 30:744–748. PMID: 10187872.

22. Kruger E, Teasell R, Salter K, Foley N, Hellings C. The rehabilitation of patients recovering from brainstem strokes: case studies and clinical considerations. Top Stroke Rehabil. 2007; 14:56–64. PMID: 17901016.