Academic Journal
Large Language Models and Retrieval-Augmented Platforms for the Diagnosis and Management of Periodontal Diseases: A Blinded Expert-Rated Comparative Study of 11 Systems.
| Τίτλος: | Large Language Models and Retrieval-Augmented Platforms for the Diagnosis and Management of Periodontal Diseases: A Blinded Expert-Rated Comparative Study of 11 Systems. |
|---|---|
| Συγγραφείς: | Mayer Y; The Ruth and Bruce Rappaport Faculty of Medicine, Technion, Israel Institute of Technology, Haifa, Israel.; Department of Periodontology, Rambam Health Care Campus, Haifa, Israel., Demetriou B; Department of Periodontology, Rambam Health Care Campus, Haifa, Israel., Rasperini G; Department of Biomedical, Surgical and Dental Sciences, University of Milan, Milan, Italy., Gabay E; The Ruth and Bruce Rappaport Faculty of Medicine, Technion, Israel Institute of Technology, Haifa, Israel.; Department of Periodontology, Rambam Health Care Campus, Haifa, Israel., Gašperšič R; Department of Oral Medicine and Periodontology, Faculty of Medicine, University of Ljubljana, Ljubljana, Slovenia., Božić D; Department of Periodontology, School of Dental Medicine, University of Zagreb, Zagreb, Croatia., Calatrava J; Section of Graduate Periodontology, Faculty of Odontology, University Complutense of Madrid, Madrid, Spain.; Department of Oral Medicine, Infection and Immunity, Harvard School of Dental Medicine, Boston, Massachusetts, USA., Ginesin O; The Ruth and Bruce Rappaport Faculty of Medicine, Technion, Israel Institute of Technology, Haifa, Israel.; Department of Periodontology, Rambam Health Care Campus, Haifa, Israel., Giladi HZ; The Ruth and Bruce Rappaport Faculty of Medicine, Technion, Israel Institute of Technology, Haifa, Israel.; Department of Periodontology, Rambam Health Care Campus, Haifa, Israel., Almeida RF; LAQV/REQUIMTE, Periodontology, Oral Surgery and Oral Medicine Department, Faculty of Dental Medicine, University of Porto, Porto, Portugal. |
| Πηγή: | Journal of clinical periodontology [J Clin Periodontol] 2026 Oct; Vol. 53 (10), pp. 1546-1556. Date of Electronic Publication: 2026 Jul 05. |
| Τύπος έκδοσης: | Journal Article; Comparative Study |
| Γλώσσα: | English |
| Στοιχεία περιοδικού: | Publisher: Wiley-Blackwell Country of Publication: United States NLM ID: 0425123 Publication Model: Print-Electronic Cited Medium: Internet ISSN: 1600-051X (Electronic) Linking ISSN: 03036979 NLM ISO Abbreviation: J Clin Periodontol Subsets: MEDLINE |
| Imprint Name(s): | Publication: Malden, MA : Wiley-Blackwell Original Publication: Copenhagen, Munksgaard. |
| Ιατρικοί όροι (MeSH): | Periodontal Diseases*/diagnosis , Periodontal Diseases*/therapy , Large Language Models* , Information Storage and Retrieval*, Humans ; Generative Artificial Intelligence |
| Περίληψη: | Aim: To compare retrieval-augmented systems with general-purpose large language models (LLMs) on standardised periodontal clinical vignettes. Materials and Methods: Eleven AI systems were evaluated: nine general-purpose LLMs, one general-purpose retrieval-augmented platform (Perplexity) and one medical-domain retrieval-augmented platform (OpenEvidence). Each responded to 30 synthetic vignettes covering acute, chronic and complex periodontal scenarios. Six blinded periodontists scored responses on a 5-point Likert scale for accuracy, safety, freedom from hallucinations and completeness in a randomised block design. Friedman and Conover-Iman tests with Holm correction were applied; mixed-effects and ordinal models served as sensitivity analyses. Results: At least one parameter scored dangerous (≤ 2) in 3.3%-46.7% of responses across platforms, despite mean composite scores (3.28-4.86) exceeding the rubric midpoint of 3.0. Between-model differences were significant (p < 0.001), with a small-to-medium overall effect (Kendall's W = 0.17) and large within-category effects (W up to 0.82). Perplexity, OpenEvidence and Claude 4.7 Opus formed a top tier. Conclusion: Retrieval-augmented systems rated highest, but this advantage was confounded with response length. The dangerous-response spread argues against undifferentiated use. These tools should assist, not replace, specialist judgement. (© 2026 The Author(s). Journal of Clinical Periodontology published by John Wiley & Sons Ltd.) |
| References: | Nat Med. 2025 Jan;31(1):60-69. (PMID: 39779929) J Dent Res. 2014 Nov;93(11):1045-53. (PMID: 25261053) JAMA Netw Open. 2026 Apr 01;9(4):e264003. (PMID: 41973425) J Periodontal Res. 2025 Feb;60(2):121-133. (PMID: 39030766) Commun Med (Lond). 2025 Aug 2;5(1):330. (PMID: 40753316) J Clin Periodontol. 2018 Jun;45 Suppl 20:S219-S229. (PMID: 29926500) J Clin Periodontol. 2025 May;52(5):707-716. (PMID: 39723544) Clin Oral Investig. 2024 Jun 29;28(7):407. (PMID: 38951256) J Clin Periodontol. 2020 Jul;47 Suppl 22:4-60. (PMID: 32383274) Nat Med. 2023 Aug;29(8):1930-1940. (PMID: 37460753) Front Digit Health. 2026 Jan 05;7:1687820. (PMID: 41561161) J Periodontol. 2018 Jun;89 Suppl 1:S159-S172. (PMID: 29926952) J Clin Periodontol. 2018 Jun;45 Suppl 20:S1-S8. (PMID: 29926489) J Am Med Inform Assoc. 2025 Apr 1;32(4):605-615. (PMID: 39812777) Dent J (Basel). 2025 Jun 21;13(7):. (PMID: 40710124) Med Sci Monit. 2026 Apr 01;32:e951721. (PMID: 41920800) Dent J (Basel). 2025 Jun 18;13(6):. (PMID: 40559174) J Am Dent Assoc. 2018 Jul;149(7):576-588.e6. (PMID: 29957185) J Chiropr Med. 2016 Jun;15(2):155-63. (PMID: 27330520) Interact J Med Res. 2025 Jan 28;14:e59823. (PMID: 39874574) J Clin Periodontol. 2022 Aug;49(8):732-739. (PMID: 35322458) J Periodontol. 2018 Jun;89 Suppl 1:S173-S182. (PMID: 29926951) J Clin Periodontol. 2022 Jun;49 Suppl 24:4-71. (PMID: 35688447) BMC Bioinformatics. 2017 Jan 25;18(1):68. (PMID: 28122501) J Prosthet Dent. 2025 Dec;134(6):2435-2442. (PMID: 40055086) J Periodontol. 2018 Jun;89 Suppl 1:S85-S102. (PMID: 29926942) J Prosthet Dent. 2025 Dec;134(6):2328-2336. (PMID: 39562221) Lancet. 2019 Jul 20;394(10194):249-260. (PMID: 31327369) BDJ Open. 2024 Dec 1;10(1):90. (PMID: 39617779) |
| Contributed Indexing: | Keywords: artificial intelligence; clinical decision support; diagnosis; large language models; periodontitis |
| Entry Date(s): | Date Created: 20260705 Date Completed: 20260916 Latest Revision: 20260919 |
| Update Code: | 20260919 |
| PubMed Central ID: | PMC13581464 |
| DOI: | 10.1111/jcpe.70160 |
| PMID: | 42402252 |
| Βάση Δεδομένων: | MEDLINE |
| FullText | Text: Availability: 0 CustomLinks: – Url: https://resolver.ebsco.com/c/fiv2js/result?sid=EBSCO:cmedm&genre=article&issn=1600051X&ISBN=&volume=53&issue=10&date=20261001&spage=1546&pages=1546-1556&title=Journal of clinical periodontology&atitle=Large%20Language%20Models%20and%20Retrieval-Augmented%20Platforms%20for%20the%20Diagnosis%20and%20Management%20of%20Periodontal%20Diseases%3A%20A%20Blinded%20Expert-Rated%20Comparative%20Study%20of%2011%20Systems.&aulast=Mayer%20Y&id=DOI:10.1111/jcpe.70160 Name: Full Text Finder (for New FTF UI) (ns324271) Category: fullText Text: Full Text Finder MouseOverText: Full Text Finder |
|---|---|
| Header | DbId: cmedm DbLabel: MEDLINE An: 42402252 AccessLevel: 3 PubType: Academic Journal PubTypeId: academicJournal PreciseRelevancyScore: 0 |
| IllustrationInfo | |
| Items | – Name: Title Label: Title Group: Ti Data: Large Language Models and Retrieval-Augmented Platforms for the Diagnosis and Management of Periodontal Diseases: A Blinded Expert-Rated Comparative Study of 11 Systems. – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AU" term="%22Mayer+Y%22">Mayer Y</searchLink>; The Ruth and Bruce Rappaport Faculty of Medicine, Technion, Israel Institute of Technology, Haifa, Israel.; Department of Periodontology, Rambam Health Care Campus, Haifa, Israel.<br /><searchLink fieldCode="AU" term="%22Demetriou+B%22">Demetriou B</searchLink>; Department of Periodontology, Rambam Health Care Campus, Haifa, Israel.<br /><searchLink fieldCode="AU" term="%22Rasperini+G%22">Rasperini G</searchLink>; Department of Biomedical, Surgical and Dental Sciences, University of Milan, Milan, Italy.<br /><searchLink fieldCode="AU" term="%22Gabay+E%22">Gabay E</searchLink>; The Ruth and Bruce Rappaport Faculty of Medicine, Technion, Israel Institute of Technology, Haifa, Israel.; Department of Periodontology, Rambam Health Care Campus, Haifa, Israel.<br /><searchLink fieldCode="AU" term="%22Gašperšič+R%22">Gašperšič R</searchLink>; Department of Oral Medicine and Periodontology, Faculty of Medicine, University of Ljubljana, Ljubljana, Slovenia.<br /><searchLink fieldCode="AU" term="%22Božić+D%22">Božić D</searchLink>; Department of Periodontology, School of Dental Medicine, University of Zagreb, Zagreb, Croatia.<br /><searchLink fieldCode="AU" term="%22Calatrava+J%22">Calatrava J</searchLink>; Section of Graduate Periodontology, Faculty of Odontology, University Complutense of Madrid, Madrid, Spain.; Department of Oral Medicine, Infection and Immunity, Harvard School of Dental Medicine, Boston, Massachusetts, USA.<br /><searchLink fieldCode="AU" term="%22Ginesin+O%22">Ginesin O</searchLink>; The Ruth and Bruce Rappaport Faculty of Medicine, Technion, Israel Institute of Technology, Haifa, Israel.; Department of Periodontology, Rambam Health Care Campus, Haifa, Israel.<br /><searchLink fieldCode="AU" term="%22Giladi+HZ%22">Giladi HZ</searchLink>; The Ruth and Bruce Rappaport Faculty of Medicine, Technion, Israel Institute of Technology, Haifa, Israel.; Department of Periodontology, Rambam Health Care Campus, Haifa, Israel.<br /><searchLink fieldCode="AU" term="%22Almeida+RF%22">Almeida RF</searchLink>; LAQV/REQUIMTE, Periodontology, Oral Surgery and Oral Medicine Department, Faculty of Dental Medicine, University of Porto, Porto, Portugal. – Name: TitleSource Label: Source Group: Src Data: <searchLink fieldCode="JN" term="%220425123%22">Journal of clinical periodontology</searchLink> [J Clin Periodontol] 2026 Oct; Vol. 53 (10), pp. 1546-1556. <i>Date of Electronic Publication: </i>2026 Jul 05. – Name: TypePub Label: Publication Type Group: TypPub Data: Journal Article; Comparative Study – Name: Language Label: Language Group: Lang Data: English – Name: TitleSource Label: Journal Info Group: Src Data: <i>Publisher: </i><searchLink fieldCode="PB" term="%22Wiley-Blackwell%22">Wiley-Blackwell </searchLink><i>Country of Publication: </i>United States <i>NLM ID: </i>0425123 <i>Publication Model: </i>Print-Electronic <i>Cited Medium: </i>Internet <i>ISSN: </i>1600-051X (Electronic) <i>Linking ISSN: </i><searchLink fieldCode="IS" term="%2203036979%22">03036979 </searchLink><i>NLM ISO Abbreviation: </i>J Clin Periodontol <i>Subsets: </i>MEDLINE – Name: PublisherInfo Label: Imprint Name(s) Group: PubInfo Data: <i>Publication</i>: Malden, MA : Wiley-Blackwell<br /><i>Original Publication</i>: Copenhagen, Munksgaard. – Name: SubjectMESH Label: MeSH Terms Group: Su Data: <searchLink fieldCode="MM" term="%22Periodontal+Diseases%22">Periodontal Diseases*</searchLink>/<searchLink fieldCode="MM" term="%22Periodontal+Diseases+diagnosis%22">diagnosis</searchLink> <br /><searchLink fieldCode="MM" term="%22Periodontal+Diseases%22">Periodontal Diseases*</searchLink>/<searchLink fieldCode="MM" term="%22Periodontal+Diseases+therapy%22">therapy</searchLink> <br /><searchLink fieldCode="MM" term="%22Large+Language+Models%22">Large Language Models*</searchLink> <br /><searchLink fieldCode="MM" term="%22Information+Storage+and+Retrieval%22">Information Storage and Retrieval*</searchLink><br /><searchLink fieldCode="MH" term="%22Humans%22">Humans</searchLink> ; <searchLink fieldCode="MH" term="%22Generative+Artificial+Intelligence%22">Generative Artificial Intelligence</searchLink> – Name: Abstract Label: Abstract Group: Ab Data: Aim: To compare retrieval-augmented systems with general-purpose large language models (LLMs) on standardised periodontal clinical vignettes.<br />Materials and Methods: Eleven AI systems were evaluated: nine general-purpose LLMs, one general-purpose retrieval-augmented platform (Perplexity) and one medical-domain retrieval-augmented platform (OpenEvidence). Each responded to 30 synthetic vignettes covering acute, chronic and complex periodontal scenarios. Six blinded periodontists scored responses on a 5-point Likert scale for accuracy, safety, freedom from hallucinations and completeness in a randomised block design. Friedman and Conover-Iman tests with Holm correction were applied; mixed-effects and ordinal models served as sensitivity analyses.<br />Results: At least one parameter scored dangerous (≤ 2) in 3.3%-46.7% of responses across platforms, despite mean composite scores (3.28-4.86) exceeding the rubric midpoint of 3.0. Between-model differences were significant (p &lt; 0.001), with a small-to-medium overall effect (Kendall's W = 0.17) and large within-category effects (W up to 0.82). Perplexity, OpenEvidence and Claude 4.7 Opus formed a top tier.<br />Conclusion: Retrieval-augmented systems rated highest, but this advantage was confounded with response length. The dangerous-response spread argues against undifferentiated use. These tools should assist, not replace, specialist judgement.<br /> (© 2026 The Author(s). Journal of Clinical Periodontology published by John Wiley & Sons Ltd.) – Name: Ref Label: References Group: RefInfo Data: Nat Med. 2025 Jan;31(1):60-69. (PMID: <searchLink fieldCode="PM" term="%2239779929%22">39779929)</searchLink><br />J Dent Res. 2014 Nov;93(11):1045-53. (PMID: <searchLink fieldCode="PM" term="%2225261053%22">25261053)</searchLink><br />JAMA Netw Open. 2026 Apr 01;9(4):e264003. (PMID: <searchLink fieldCode="PM" term="%2241973425%22">41973425)</searchLink><br />J Periodontal Res. 2025 Feb;60(2):121-133. (PMID: <searchLink fieldCode="PM" term="%2239030766%22">39030766)</searchLink><br />Commun Med (Lond). 2025 Aug 2;5(1):330. (PMID: <searchLink fieldCode="PM" term="%2240753316%22">40753316)</searchLink><br />J Clin Periodontol. 2018 Jun;45 Suppl 20:S219-S229. (PMID: <searchLink fieldCode="PM" term="%2229926500%22">29926500)</searchLink><br />J Clin Periodontol. 2025 May;52(5):707-716. (PMID: <searchLink fieldCode="PM" term="%2239723544%22">39723544)</searchLink><br />Clin Oral Investig. 2024 Jun 29;28(7):407. (PMID: <searchLink fieldCode="PM" term="%2238951256%22">38951256)</searchLink><br />J Clin Periodontol. 2020 Jul;47 Suppl 22:4-60. (PMID: <searchLink fieldCode="PM" term="%2232383274%22">32383274)</searchLink><br />Nat Med. 2023 Aug;29(8):1930-1940. (PMID: <searchLink fieldCode="PM" term="%2237460753%22">37460753)</searchLink><br />Front Digit Health. 2026 Jan 05;7:1687820. (PMID: <searchLink fieldCode="PM" term="%2241561161%22">41561161)</searchLink><br />J Periodontol. 2018 Jun;89 Suppl 1:S159-S172. (PMID: <searchLink fieldCode="PM" term="%2229926952%22">29926952)</searchLink><br />J Clin Periodontol. 2018 Jun;45 Suppl 20:S1-S8. (PMID: <searchLink fieldCode="PM" term="%2229926489%22">29926489)</searchLink><br />J Am Med Inform Assoc. 2025 Apr 1;32(4):605-615. (PMID: <searchLink fieldCode="PM" term="%2239812777%22">39812777)</searchLink><br />Dent J (Basel). 2025 Jun 21;13(7):. (PMID: <searchLink fieldCode="PM" term="%2240710124%22">40710124)</searchLink><br />Med Sci Monit. 2026 Apr 01;32:e951721. (PMID: <searchLink fieldCode="PM" term="%2241920800%22">41920800)</searchLink><br />Dent J (Basel). 2025 Jun 18;13(6):. (PMID: <searchLink fieldCode="PM" term="%2240559174%22">40559174)</searchLink><br />J Am Dent Assoc. 2018 Jul;149(7):576-588.e6. (PMID: <searchLink fieldCode="PM" term="%2229957185%22">29957185)</searchLink><br />J Chiropr Med. 2016 Jun;15(2):155-63. (PMID: <searchLink fieldCode="PM" term="%2227330520%22">27330520)</searchLink><br />Interact J Med Res. 2025 Jan 28;14:e59823. (PMID: <searchLink fieldCode="PM" term="%2239874574%22">39874574)</searchLink><br />J Clin Periodontol. 2022 Aug;49(8):732-739. (PMID: <searchLink fieldCode="PM" term="%2235322458%22">35322458)</searchLink><br />J Periodontol. 2018 Jun;89 Suppl 1:S173-S182. (PMID: <searchLink fieldCode="PM" term="%2229926951%22">29926951)</searchLink><br />J Clin Periodontol. 2022 Jun;49 Suppl 24:4-71. (PMID: <searchLink fieldCode="PM" term="%2235688447%22">35688447)</searchLink><br />BMC Bioinformatics. 2017 Jan 25;18(1):68. (PMID: <searchLink fieldCode="PM" term="%2228122501%22">28122501)</searchLink><br />J Prosthet Dent. 2025 Dec;134(6):2435-2442. (PMID: <searchLink fieldCode="PM" term="%2240055086%22">40055086)</searchLink><br />J Periodontol. 2018 Jun;89 Suppl 1:S85-S102. (PMID: <searchLink fieldCode="PM" term="%2229926942%22">29926942)</searchLink><br />J Prosthet Dent. 2025 Dec;134(6):2328-2336. (PMID: <searchLink fieldCode="PM" term="%2239562221%22">39562221)</searchLink><br />Lancet. 2019 Jul 20;394(10194):249-260. (PMID: <searchLink fieldCode="PM" term="%2231327369%22">31327369)</searchLink><br />BDJ Open. 2024 Dec 1;10(1):90. (PMID: <searchLink fieldCode="PM" term="%2239617779%22">39617779)</searchLink> – Name: SubjectMinor Label: Contributed Indexing Group: Data: <i>Keywords: </i>artificial intelligence; clinical decision support; diagnosis; large language models; periodontitis – Name: DateEntry Label: Entry Date(s) Group: Date Data: <i>Date Created: </i>20260705 <i>Date Completed: </i>20260916 <i>Latest Revision: </i>20260919 – Name: DateUpdate Label: Update Code Group: Date Data: 20260919 – Name: PubmedCentralID Label: PubMed Central ID Group: ID Data: PMC13581464 – Name: DOI Label: DOI Group: ID Data: 10.1111/jcpe.70160 – Name: AN Label: PMID Group: ID Data: 42402252 |
| PLink | https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=cmedm&AN=42402252 |
| RecordInfo | BibRecord: BibEntity: Identifiers: – Type: doi Value: 10.1111/jcpe.70160 Languages: – Code: eng Text: English PhysicalDescription: Pagination: StartPage: 1546 Subjects: – SubjectFull: Humans Type: general – SubjectFull: Generative Artificial Intelligence Type: general – SubjectFull: Periodontal Diseases diagnosis Type: general – SubjectFull: Periodontal Diseases therapy Type: general – SubjectFull: Large Language Models Type: general – SubjectFull: Information Storage and Retrieval Type: general Titles: – TitleFull: Large Language Models and Retrieval-Augmented Platforms for the Diagnosis and Management of Periodontal Diseases: A Blinded Expert-Rated Comparative Study of 11 Systems. Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: Mayer Y – PersonEntity: Name: NameFull: Demetriou B – PersonEntity: Name: NameFull: Rasperini G – PersonEntity: Name: NameFull: Gabay E – PersonEntity: Name: NameFull: Gašperšič R – PersonEntity: Name: NameFull: Božić D – PersonEntity: Name: NameFull: Calatrava J – PersonEntity: Name: NameFull: Ginesin O – PersonEntity: Name: NameFull: Giladi HZ – PersonEntity: Name: NameFull: Almeida RF IsPartOfRelationships: – BibEntity: Dates: – D: 01 M: 10 Text: 2026 Oct Type: published Y: 2026 Identifiers: – Type: issn-electronic Value: 1600-051X Numbering: – Type: volume Value: 53 – Type: issue Value: 10 Titles: – TitleFull: Journal of clinical periodontology Type: main |
| ResultId | 1 |