Academic Journal

Large language models as sources of patient information on robotic knee arthroplasty: a comparative evaluation.

Λεπτομέρειες βιβλιογραφικής εγγραφής
Τίτλος: Large language models as sources of patient information on robotic knee arthroplasty: a comparative evaluation.
Συγγραφείς: Ciftci MU; Sultan 2. Abdülhamid Han Training and Research Hospital, Department of Orthopedics and Traumatology, 34668 Istanbul, Turkey. Electronic address: mehmetutkuciftci.md@gmail.com., Koluman AC; Bakirkoy Dr. Sadi Konuk Training and Research Hospital, Department of Orthopedics and Traumatology, 34147 Istanbul, Turkey. Electronic address: md.alicankoluman@gmail.com., Aloğlu Çiftçi E; Istanbul Okan University, Faculty of Health Sciences, Department of Physiotherapy and Rehabilitation, Istanbul, Turkey; Istinye University, Institute of Graduate Education, Department of Physiotherapy and Rehabilitation, Istanbul, Turkey. Electronic address: ebru.aloglu@okan.edu.tr., Cakmur BB; Beylikduzu State Hospital, Department of Orthopedics and Traumatology, 34500 Istanbul, Turkey. Electronic address: basar_cakmur@hotmail.com., Ziroğlu N; Department of Orthopedic Prosthetics and Orthotics, Vocational School of Health Services, Acibadem Mehmet Ali Aydinlar University, 34638 Istanbul, Turkey; Department of Orthopaedics and Traumatology, Acibadem University Atakent Hospital, 34303 Istanbul, Turkey. Electronic address: nezih.ziroglu@yahoo.com.
Πηγή: The Knee [Knee] 2026 Oct; Vol. 62, pp. 104579. Date of Electronic Publication: 2026 Jul 30.
Τύπος έκδοσης: Journal Article; Comparative Study
Γλώσσα: English
Στοιχεία περιοδικού: Publisher: Elsevier Country of Publication: Netherlands NLM ID: 9430798 Publication Model: Print-Electronic Cited Medium: Internet ISSN: 1873-5800 (Electronic) Linking ISSN: 09680160 NLM ISO Abbreviation: Knee Subsets: MEDLINE
Imprint Name(s): Publication: [s.l.] : Elsevier
Original Publication: Oxford, UK : Butterworth-Heinemann, c1994-
Ιατρικοί όροι (MeSH): Arthroplasty, Replacement, Knee*/methods , Patient Education as Topic*/methods , Large Language Models* , Robotic Surgical Procedures*, Humans ; Reproducibility of Results ; Comprehension ; Generative Artificial Intelligence ; Artificial Intelligence
Περίληψη: Background: Robotic-assisted total knee arthroplasty (rTKA) is increasingly used because of its surgical precision. However, inconsistent outcomes and high costs often lead patients to seek additional information from artificial intelligence (AI) tools. Large language models (LLMs) such as ChatGPT-4o, Gemini-2.5-Flash, and DeepSeek-V3 are commonly used, but their reliability and readability in orthopaedics remain unclear.
Objectives: To compare the reliability, usefulness, quality, and readability of responses to common patient questions about rTKA generated by leading LLMs.
Methods: Three LLMs answered 20 frequently asked patient questions (n = 20) identified through Google Trends and expert validation. Three orthopaedic specialists (n = 3) evaluated reliability, usefulness, and overall quality using validated scales, while readability was assessed with standard indices.
Results: Inter-rater reliability was good to excellent (ICC = 0.728-0.879). Gemini-2.5-Flash achieved significantly higher reliability and usefulness scores than ChatGPT-4o and DeepSeek-V3 (all p < 0.05). ChatGPT-4o and DeepSeek-V3 produced more readable but less accurate content, revealing an inverse relationship between reliability and readability.
Conclusions: Gemini-2.5-Flash provided the most reliable responses, highlighting the need for supervised integration of LLMs in patient education.
(Copyright © 2026 The Author(s). Published by Elsevier B.V. All rights reserved.)
Competing Interests: Declaration of competing interest The authors declare no competing interests.
Contributed Indexing: Keywords: Artificial intelligence; Large language models; Patient education; Readability; Reliability; Robotic-assisted total knee arthroplasty
Entry Date(s): Date Created: 20260730 Date Completed: 20260909 Latest Revision: 20260909
Update Code: 20260910
DOI: 10.1016/j.knee.2026.104579
PMID: 42531925
Βάση Δεδομένων: MEDLINE