J Korean Med Sci.  2013 Feb;28(2):190-194. 10.3346/jkms.2013.28.2.190.

Developing a Scoring Guide for the Appraisal of Guidelines for Research and Evaluation II Instrument in Korea: A Modified Delphi Consensus Process

• Lee YK
• Shin ES
• Shim JY
• Min KJ
• Kim JM
• Lee SH
• The Executive Committee for CPGs
• The Korean Academy of Medical Sciences

• KMID: 1429179
• DOI: http://doi.org/10.3346/jkms.2013.28.2.190

Abstract

Korea has a relatively short history in the development and use of clinical practice guidelines (CPGs). Additionally, it has been difficult to employ the Appraisal of Guidelines for Research and Evaluation (AGREE) II instrument due to the lack of consensus and the presence of differences in Korean medical settings and in the Korean socio-cultural environment. An AGREE II scoring guide was therefore developed to reduce differences among evaluators using the same tool. In consideration of the importance of using a quantitative measure of satisfaction with the elements described in the AGREE II manual, a final draft was developed through a Delphi consensus process. Ninety-two draft scoring guides for anchor points 1, 3, 5, and 7 (full score) in 23 items were developed. Consensus was defined as agreement among at least 70% of the raters. Agreement on 88 draft scoring guidelines was reached in the first Delphi round, and agreement for the remaining four was achieved in the second round. The development of an AGREE II scoring guide in this study is expected to contribute to improving the CPG environment.

Keyword

Clinical Practice Guideline; Peer Review

MeSH Terms

Consensus
Humans
Peer Review
*Practice Guidelines as Topic
Republic of Korea

Reference

1. Alonso-Coello P, Irfan A, Solà I, Gich I, Delgado-Noguera M, Rigau D, Tort S, Bonfill X, Burgers J, Schunemann H. The quality of clinical practice guidelines over the last two decades: a systematic review of guideline appraisal studies. Qual Saf Health Care. 2010. 19:e58.

2. Ahn HS, Kim HJ. Development and implementation of clinical practice guidelines: current status in Korea. J Korean Med Sci. 2012. 27:S55–S60.

3. Korean Medical Guideline Information Center. accessed on 16 November 2012. Available at http://www.guideline.or.kr.

4. Ministry of Health & Welfare. The Korean Academy of Medical Sciences. A process model for developing clinical practice guidelines in Korea and its practical application for sample CPGs. accessed on 16 August 2012. Available at http://www.guideline.or.kr/about/board/list.php?code=pds2 .

5. Ministry of Health & Welfare. The Korean Academy of Medical Sciences. Clinical practice guideline development and establishment of informative systems. accessed on 25 September 2012. Available at http://www.guideline.or.kr/about/board/list.php?code=pds2.

6. AGREE Next Steps Consortium. The AGREE II Instrument: Electronic version. accessed on 4 May 2012. Available at http://www.agreetrust.org.

7. Oxman AD, Schünemann HJ, Fretheim A. Improving the use of research evidence in guideline development: 16. Evaluation. Health Res Policy Syst. 2006. 4:28.

8. Ahn HS, Kim SY, Kim NS, Park MH. Appraisal of Guidelines for Research and Evaluation (Korean version). accessed on 25 September 2012. Available at http://www.guideline.or.kr/about/board/viewbody.php?code=pds2&page=1&number=31&keyfield=&key=.

9. Lee SH, Lee YK, Shin IS. Appraisal of guidelines for research and evaluation II (Korean version). accessed on 16 February 2012. Available at http://www.agreetrust.org/resource-centre/agree-ii-translations/.

10. Ministry of Health & Welfare. The Korean Academy of Medical Sciences. Korean Clinical Practice Guidelines: Designing a model system for development, education, propagation and a web-based AGREE II evaluation system. accessed on 14 September 2012. Available at http://www.guideline.or.kr/about/board/viewbody.php?code=pds2&page=1&number=29&keyfield=&key=.

11. Ministry of Health & Welfare. The Korean Academy of Medical Sciences. Study on the propagation of clinical practice guidelines and a plan to invigorate the KOMGI. accessed on 14 September 2012. Available at http://www.guideline.or.kr/about/board/list.php?code=pds.

12. De Hert M, Vancampfort D, Correll CU, Mercken V, Peuskens J, Sweers K, van Winkel R, Mitchell AJ. Guidelines for screening and monitoring of cardiometabolic risk in schizophrenia: systematic evaluation. Br J Psychiatry. 2011. 199:99–105.

13. Stone MA, Wilkinson JC, Charpentier G, Clochard N, Grassi G, Lindblad U, Müller UA, Nolan J, Rutten GE, Khunti K. GUIDANCE Study Group. Evaluation and comparison of guidelines for the management of people with type 2 diabetes from eight European countries. Diabetes Res Clin Pract. 2010. 87:252–260.

14. Delgado-Noguera M, Tort S, Bonfill X, Gich I, Alonso-Coello P. Quality assessment of clinical practice guidelines for the prevention and treatment of childhood overweight and obesity. Eur J Pediatr. 2009. 168:789–799.

15. Dans AL, Dans LF. Appraising a tool for guideline appraisal (the AGREE II instrument). J Clin Epidemiol. 2010. 63:1281–1282.