Document Type

Article

Publication Date

2-13-2024

Comments

This article is the author's final published version in Arthroscopy, Sports Medicine, and Rehabilitation, Volume 6, Issue 2, 2024, Article number 100893.

The published version is available at https://doi.org/10.1016/j.asmr.2024.100893.

Copyright © 2024 THE AUTHORS. Published by Elsevier Inc. on behalf of the Arthroscopy Association of North America.

Abstract

PURPOSE: To determine whether ChatGPT effectively responds to 10 commonly asked questions concerning ulnar collateral ligament (UCL) reconstruction.

METHODS: A comprehensive list of 90 UCL reconstruction questions was initially created, with a final set of 10 "most commonly asked" questions ultimately selected. Questions were presented to ChatGPT and its response was documented. Responses were evaluated independently by 3 authors using an evidence-based methodology, resulting in a grading system categorized as follows: (1) excellent response not requiring clarification; (2) satisfactory requiring minimal clarification; (3) satisfactory requiring moderate clarification; and (4) unsatisfactory requiring substantial clarification.

RESULTS: Six of 10 ten responses were rated as "excellent" or "satisfactory." Of those 6 responses, 2 were determined to be "excellent response not requiring clarification," 3 were "satisfactory requiring minimal clarification," and 1 was "satisfactory requiring moderate clarification." Four questions encompassing inquiries about "What are the potential risks of UCL reconstruction surgery?" "Which type of graft should be used for my UCL reconstruction?" and "Should I have UCL reconstruction or repair?" were rated as "unsatisfactory requiring substantial clarification."

CONCLUSIONS: ChatGPT exhibited the potential to improve a patient's basic understanding of UCL reconstruction and provided responses that were deemed satisfactory to excellent for 60% of the most commonly asked questions. For the other 40% of questions, ChatGPT gave unsatisfactory responses, primarily due to a lack of relevant details or the need for further explanation.

CLINICAL RELEVANCE: ChatGPT can assist in patient education regarding UCL reconstruction; however, its ability to appropriately answer more complex questions remains to be an area of skepticism and future improvement.

Creative Commons License

Creative Commons License
This work is licensed under a Creative Commons Attribution-Noncommercial-No Derivative Works 4.0 License.

Additional Files
ICMJE author disclosure forms.pdf (852 kB)

Language

English

Download

Share

COinS