Academic Journal

Large Language Models for Clinical Note Simplification: A Systematic Review and Experimental Evaluation of Medical Text Readability.

Bibliographic Details
Title: Large Language Models for Clinical Note Simplification: A Systematic Review and Experimental Evaluation of Medical Text Readability.
Authors: Teichmann M; Brandenburg University of Applied Science, Brandenburg a. d. Havel, Germany., Özkara Menekseoglu P; Department of Psychiatry and Psychotherapy, Immanuel Klinik Rüdersdorf, Brandenburg Medical School Theodor Fontane, Rüdersdorf, Germany., Schwarz J; Department of Psychiatry and Psychotherapy, Immanuel Klinik Rüdersdorf, Brandenburg Medical School Theodor Fontane, Rüdersdorf, Germany., Karbach U; Institute of Medical Sociology, Health Services Research, and Rehabilitation Science (IMVR), Cologne, Germany., Purohit AM; Brandenburg University of Applied Science, Brandenburg a. d. Havel, Germany.
Source: Studies in health technology and informatics [Stud Health Technol Inform] 2026 Sep 17; Vol. 340, pp. 148-162.
Publication Type: Journal Article; Systematic Review
Language: English
Journal Info: Publisher: IOS Press Country of Publication: Netherlands NLM ID: 9214582 Publication Model: Print Cited Medium: Internet ISSN: 1879-8365 (Electronic) Linking ISSN: 09269630 NLM ISO Abbreviation: Stud Health Technol Inform Subsets: MEDLINE
Imprint Name(s): Original Publication: Amsterdam ; Washington, DC : IOS Press, 1991-
MeSH Terms: Large Language Models* , Comprehension* , Electronic Health Records* , Natural Language Processing*, Humans ; Germany
Abstract: Since the introduction of the Patient Rights Act, patients in Germany have gained legal access to their medical records, including clinical notes. However, these documents are typically written for healthcare professionals and are often difficult for patients to understand due to specialized terminology, abbreviations, and complex sentence structures. Large Language Models (LLMs) offer new opportunities to automatically simplify such texts while preserving medically relevant information. This study investigates the potential of LLMs to improve the readability of German clinical notes by combining a systematic literature review with an experimental evaluation. Ten freely available LLMs were assessed using five synthetic clinical notes, which were simplified through standardized prompts designed to ensure linguistic clarity while maintaining content fidelity. Readability was analyzed using established indices (Flesch Reading Ease, Wiener Sachtextformel, LIX, SMOG, and Coleman-Liau) and complemented by a novel analysis of medical terminology and abbreviation density as indicators of domain-specific complexity. The results show that all LLMs substantially increased overall text length while consistently reducing the density of technical terms and abbreviations. However, no model achieved consistent improvements across all readability indices, highlighting limitations of traditional metrics in the medical domain. Models such as Mistral, ChatGPT, and Copilot demonstrated the highest efficiency in balancing linguistic simplification and text length. Overall, LLMs show strong potential to enhance the accessibility of clinical documentation for patients. However, their effectiveness depends on model selection, prompt design, and evaluation methodology. The findings suggest that conventional readability metrics should be extended with domain-specific measures to more accurately assess comprehensibility in medical texts.
Contributed Indexing: Keywords: Artificial Intelligence; Health Literacy; Medical Records; Natural Language Processing; Patient Empowerment
Entry Date(s): Date Created: 20260917 Date Completed: 20260917 Latest Revision: 20260917
Update Code: 20260918
DOI: 10.3233/SHTI260997
PMID: 42752479
Database: MEDLINE
FullText Text:
  Availability: 0
Header DbId: cmedm
DbLabel: MEDLINE
An: 42752479
AccessLevel: 3
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Large Language Models for Clinical Note Simplification: A Systematic Review and Experimental Evaluation of Medical Text Readability.
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AU" term="%22Teichmann+M%22">Teichmann M</searchLink>; Brandenburg University of Applied Science, Brandenburg a. d. Havel, Germany.<br /><searchLink fieldCode="AU" term="%22Özkara+Menekseoglu+P%22">Özkara Menekseoglu P</searchLink>; Department of Psychiatry and Psychotherapy, Immanuel Klinik Rüdersdorf, Brandenburg Medical School Theodor Fontane, Rüdersdorf, Germany.<br /><searchLink fieldCode="AU" term="%22Schwarz+J%22">Schwarz J</searchLink>; Department of Psychiatry and Psychotherapy, Immanuel Klinik Rüdersdorf, Brandenburg Medical School Theodor Fontane, Rüdersdorf, Germany.<br /><searchLink fieldCode="AU" term="%22Karbach+U%22">Karbach U</searchLink>; Institute of Medical Sociology, Health Services Research, and Rehabilitation Science (IMVR), Cologne, Germany.<br /><searchLink fieldCode="AU" term="%22Purohit+AM%22">Purohit AM</searchLink>; Brandenburg University of Applied Science, Brandenburg a. d. Havel, Germany.
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="JN" term="%229214582%22">Studies in health technology and informatics</searchLink> [Stud Health Technol Inform] 2026 Sep 17; Vol. 340, pp. 148-162.
– Name: TypePub
  Label: Publication Type
  Group: TypPub
  Data: Journal Article; Systematic Review
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: TitleSource
  Label: Journal Info
  Group: Src
  Data: <i>Publisher: </i><searchLink fieldCode="PB" term="%22IOS+Press%22">IOS Press </searchLink><i>Country of Publication: </i>Netherlands <i>NLM ID: </i>9214582 <i>Publication Model: </i>Print <i>Cited Medium: </i>Internet <i>ISSN: </i>1879-8365 (Electronic) <i>Linking ISSN: </i><searchLink fieldCode="IS" term="%2209269630%22">09269630 </searchLink><i>NLM ISO Abbreviation: </i>Stud Health Technol Inform <i>Subsets: </i>MEDLINE
– Name: PublisherInfo
  Label: Imprint Name(s)
  Group: PubInfo
  Data: <i>Original Publication</i>: Amsterdam ; Washington, DC : IOS Press, 1991-
– Name: SubjectMESH
  Label: MeSH Terms
  Group: Su
  Data: <searchLink fieldCode="MM" term="%22Large+Language+Models%22">Large Language Models*</searchLink> <br /><searchLink fieldCode="MM" term="%22Comprehension%22">Comprehension*</searchLink> <br /><searchLink fieldCode="MM" term="%22Electronic+Health+Records%22">Electronic Health Records*</searchLink> <br /><searchLink fieldCode="MM" term="%22Natural+Language+Processing%22">Natural Language Processing*</searchLink><br /><searchLink fieldCode="MH" term="%22Humans%22">Humans</searchLink> ; <searchLink fieldCode="MH" term="%22Germany%22">Germany</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Since the introduction of the Patient Rights Act, patients in Germany have gained legal access to their medical records, including clinical notes. However, these documents are typically written for healthcare professionals and are often difficult for patients to understand due to specialized terminology, abbreviations, and complex sentence structures. Large Language Models (LLMs) offer new opportunities to automatically simplify such texts while preserving medically relevant information. This study investigates the potential of LLMs to improve the readability of German clinical notes by combining a systematic literature review with an experimental evaluation. Ten freely available LLMs were assessed using five synthetic clinical notes, which were simplified through standardized prompts designed to ensure linguistic clarity while maintaining content fidelity. Readability was analyzed using established indices (Flesch Reading Ease, Wiener Sachtextformel, LIX, SMOG, and Coleman-Liau) and complemented by a novel analysis of medical terminology and abbreviation density as indicators of domain-specific complexity. The results show that all LLMs substantially increased overall text length while consistently reducing the density of technical terms and abbreviations. However, no model achieved consistent improvements across all readability indices, highlighting limitations of traditional metrics in the medical domain. Models such as Mistral, ChatGPT, and Copilot demonstrated the highest efficiency in balancing linguistic simplification and text length. Overall, LLMs show strong potential to enhance the accessibility of clinical documentation for patients. However, their effectiveness depends on model selection, prompt design, and evaluation methodology. The findings suggest that conventional readability metrics should be extended with domain-specific measures to more accurately assess comprehensibility in medical texts.
– Name: SubjectMinor
  Label: Contributed Indexing
  Group:
  Data: <i>Keywords: </i>Artificial Intelligence; Health Literacy; Medical Records; Natural Language Processing; Patient Empowerment
– Name: DateEntry
  Label: Entry Date(s)
  Group: Date
  Data: <i>Date Created: </i>20260917 <i>Date Completed: </i>20260917 <i>Latest Revision: </i>20260917
– Name: DateUpdate
  Label: Update Code
  Group: Date
  Data: 20260918
– Name: DOI
  Label: DOI
  Group: ID
  Data: 10.3233/SHTI260997
– Name: AN
  Label: PMID
  Group: ID
  Data: 42752479
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=cmedm&AN=42752479
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.3233/SHTI260997
    Languages:
      – Code: eng
        Text: English
    PhysicalDescription:
      Pagination:
        StartPage: 148
    Subjects:
      – SubjectFull: Humans
        Type: general
      – SubjectFull: Germany
        Type: general
      – SubjectFull: Large Language Models
        Type: general
      – SubjectFull: Comprehension
        Type: general
      – SubjectFull: Electronic Health Records
        Type: general
      – SubjectFull: Natural Language Processing
        Type: general
    Titles:
      – TitleFull: Large Language Models for Clinical Note Simplification: A Systematic Review and Experimental Evaluation of Medical Text Readability.
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Teichmann M
      – PersonEntity:
          Name:
            NameFull: Özkara Menekseoglu P
      – PersonEntity:
          Name:
            NameFull: Schwarz J
      – PersonEntity:
          Name:
            NameFull: Karbach U
      – PersonEntity:
          Name:
            NameFull: Purohit AM
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 17
              M: 09
              Text: 2026 Sep 17
              Type: published
              Y: 2026
          Identifiers:
            – Type: issn-electronic
              Value: 1879-8365
          Numbering:
            – Type: volume
              Value: 340
          Titles:
            – TitleFull: Studies in health technology and informatics
              Type: main
ResultId 1