Arch Craniofac Surg.  2024 Jun;25(3):116-122. 10.7181/acfs.2024.00115.

The new frontier: utilizing ChatGPT to expand craniofacial research

• Zhang A
• Dimock E
• Gupta R
• Chen K

• KMID: 2556932
• DOI: http://doi.org/10.7181/acfs.2024.00115

Abstract

Background
Due to the importance of evidence-based research in plastic surgery, the authors of this study aimed to assess the accuracy of ChatGPT in generating novel systematic review ideas within the field of craniofacial surgery.
Methods
ChatGPT was prompted to generate 20 novel systematic review ideas for 10 different subcategories within the field of craniofacial surgery. For each topic, the chatbot was told to give 10 “general” and 10 “specific” ideas that were related to the concept. In order to determine the accuracy of ChatGPT, a literature review was conducted using PubMed, CINAHL, Embase, and Cochrane.
Results
In total, 200 total systematic review research ideas were generated by ChatGPT. We found that the algorithm had an overall 57.5% accuracy at identifying novel systematic review ideas. ChatGPT was found to be 39% accurate for general topics and 76% accurate for specific topics.
Conclusion
Craniofacial surgeons should use ChatGPT as a tool. We found that ChatGPT provided more precise answers with specific research questions than with general questions and helped narrow down the search scope, leading to a more relevant and accurate response. Beyond research purposes, ChatGPT can augment patient consultations, improve healthcare equity, and assist in clinical decisionmaking. With rapid advancements in artificial intelligence (AI), it is important for plastic surgeons to consider using AI in their clinical practice to improve patient-centered outcomes.

Keyword

Artificial intelligence; Craniofacial research; Machine learning; Natural language processing; Systematic review