Academic Journal
Validation of a machine learning model for predicting early deterioration in the emergency department.
| Τίτλος: | Validation of a machine learning model for predicting early deterioration in the emergency department. |
|---|---|
| Συγγραφείς: | Lee YR; Temerty Faculty of Medicine, University of Toronto, Toronto, ON, Canada., Ruffolo I; Department of Computer Science, University of Toronto, Toronto, ON, Canada., Mashouri P; Department of Computer Science, University of Toronto, Toronto, ON, Canada., Brudno M; Department of Computer Science, University of Toronto, Toronto, ON, Canada., Ben-Yakov M; Temerty Faculty of Medicine, University of Toronto, Toronto, ON, Canada; Department of Computer Science, University of Toronto, Toronto, ON, Canada; Department of Medicine, University of Toronto, Toronto, ON, Canada; Department of Emergency Medicine, University of Toronto, Toronto, ON, Canada. Electronic address: maxim.benyakov@utoronto.ca. |
| Πηγή: | The American journal of emergency medicine [Am J Emerg Med] 2026 Sep; Vol. 107, pp. 77-82. Date of Electronic Publication: 2026 May 07. |
| Τύπος έκδοσης: | Journal Article; Validation Study |
| Γλώσσα: | English |
| Στοιχεία περιοδικού: | Publisher: W B Saunders Country of Publication: United States NLM ID: 8309942 Publication Model: Print-Electronic Cited Medium: Internet ISSN: 1532-8171 (Electronic) Linking ISSN: 07356757 NLM ISO Abbreviation: Am J Emerg Med Subsets: MEDLINE |
| Imprint Name(s): | Publication: 1983- : Philadelphia, PA : W B Saunders Original Publication: [Philadelphia, PA. : Centrum Philadelphia, c1983]- |
| Ιατρικοί όροι (MeSH): | Triage*/methods , Boosting Machine Learning Algorithms* , Clinical Deterioration* , Emergency Service, Hospital*, Aged ; Female ; Humans ; Classification Algorithms ; Early Warning Score ; Predictive Learning Models ; Risk Assessment |
| Περίληψη: | Early recognition of patients at risk for deterioration in the emergency department (ED) is critical for patient safety. Traditional early warning scores rely on structured triage data and often perform poorly in the dynamic ED environment. We developed and evaluated two machine learning models integrating structured triage data with transformer-based embeddings of free-text nursing triage notes to predict early clinical deterioration prior to initial physician assessment, designed as a risk-based prioritization tool to rank patients by predicted probability of adverse outcome. We analyzed 17,481 consecutive adult ED visits over six months. Structured variables (demographics, vital signs, eCTAS scores) were combined with BioClinicalBERT-derived embeddings from free-text nursing triage notes to form a multimodal feature representation. Two XGBoost models (A, B) were trained on the same binary classification task, predicting "early deterioration" (ICU admission or death within 7 days, prevalence 4.5%) versus all other outcomes, differing only in class weighting. Model A used standard class weighting; Model B applied increased weighting to the early deterioration class to prioritize identification of high-risk patients. Model A achieved a recall of 0.66 (95% CI: 0.59-0.73), precision of 0.17 (95% CI: 0.15-0.20), and ROC-AUC of 0.75 (95% CI: 0.72-0.79). Model B improved recall to 0.77 (95% CI: 0.72-0.84), precision to 0.22 (95% CI: 0.19-0.25), and ROC-AUC to 0.90 (95% CI: 0.88-0.92). While XGBoost's internal feature importance attributed the majority of predictive weight to free-text embeddings, SHAP analysis identified age, respiratory rate, and systolic blood pressure as the dominant individual contributors, with triage note embeddings providing meaningful incremental value confirmed by structured-variable ablation. These findings suggest that AI-driven risk prioritization may function as an adjunct layer of situational awareness in the ED, complementing clinical judgement rather than replacing it. Safe clinical adoption will require prospective shadow testing in real-time workflows to quantify ranking accuracy, assess operational feasibility, and evaluate impact on decision-making before any clinician-facing implementation. (Copyright © 2026 Elsevier Inc. All rights reserved.) |
| Competing Interests: | Declaration of competing interest The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper. |
| Contributed Indexing: | Keywords: Clinical decision support; Early deterioration; Emergency department; Machine learning; Predictive modeling; Risk stratification |
| Entry Date(s): | Date Created: 20260525 Date Completed: 20260612 Latest Revision: 20260618 |
| Update Code: | 20260619 |
| DOI: | 10.1016/j.ajem.2026.05.007 |
| PMID: | 42184774 |
| Βάση Δεδομένων: | MEDLINE |
| ISSN: | 1532-8171 |
|---|---|
| DOI: | 10.1016/j.ajem.2026.05.007 |