Academic Journal
A Hierarchical Machine Learning-Based Framework for Clinical Decision Support in Foot Orthosis Prescription: Algorithm Development and Validation Study.
| Τίτλος: | A Hierarchical Machine Learning-Based Framework for Clinical Decision Support in Foot Orthosis Prescription: Algorithm Development and Validation Study. |
|---|---|
| Συγγραφείς: | Jung JY; Division of Biomedical Engineering, College of Engineering, Jeonbuk National University, 567 Baekje-daero, Deokjin-gu, Jeonju, Jeonbuk-do, 54896, Republic of Korea, 82 63-270-4063, 82 63-270-2247., Yang W; Cyber Warfare Technology Research Center, Cyber Security Research Division, Electronics and Telecommunications Research Institute, Daejeon, Republic of Korea., Kim JJ; Division of Biomedical Engineering, College of Engineering, Jeonbuk National University, 567 Baekje-daero, Deokjin-gu, Jeonju, Jeonbuk-do, 54896, Republic of Korea, 82 63-270-4063, 82 63-270-2247.; Research Center of Healthcare & Welfare Instrument for the Aged, Jeonbuk National University, Jeonju, Jeonbuk-do, Republic of Korea. |
| Πηγή: | JMIR medical informatics [JMIR Med Inform] 2026 Sep 22; Vol. 14, pp. e92831. Date of Electronic Publication: 2026 Sep 22. |
| Τύπος έκδοσης: | Journal Article; Observational Study; Validation Study |
| Γλώσσα: | English |
| Στοιχεία περιοδικού: | Publisher: JMIR Publications Country of Publication: Canada NLM ID: 101645109 Publication Model: Electronic Cited Medium: Internet ISSN: 2291-9694 (Electronic) Linking ISSN: 22919694 NLM ISO Abbreviation: JMIR Med Inform Subsets: MEDLINE |
| Imprint Name(s): | Original Publication: Toronto : JMIR Publications, [2013]- |
| Ιατρικοί όροι (MeSH): | Foot Orthoses*/statistics & numerical data , Foot Orthoses*/standards , Prescriptions*/statistics & numerical data , Prescriptions*/standards , Boosting Machine Learning Algorithms* , Decision Support Systems, Clinical*, Female ; Humans ; Male ; Middle Aged ; Classification Algorithms ; Predictive Learning Models ; Retrospective Studies |
| Περίληψη: | Background: Foot orthosis prescription is a complex clinical decision-making process that involves selecting and combining multiple structural, functional, and material components based on heterogeneous biomechanical information. In routine outpatient practice, detailed biomechanical assessments are often incomplete, creating substantial variability in prescription decisions, and limiting the applicability of conventional machine learning (ML) models that assume fixed feature availability. Objective: This study aimed to develop and evaluate a hierarchical ML-based clinical decision support framework for foot orthosis prescription that accommodates variable clinical information availability, supports multilabel prescription decisions, and incorporates safety-oriented recommendation strategies for routine outpatient practice. Methods: A retrospective observational study was conducted using 6462 visit-level clinical encounters collected from a single institution between 2015 and 2020. Orthotic prescription was formulated as a multilabel prediction task involving 15 prescription components. A hierarchical modeling framework was implemented, consisting of a basic decision level using routinely available demographic and alignment variables, and an advanced level incorporating subtalar joint inversion and eversion range of motion measurements when available. Tree-based gradient boosting models were evaluated using 5-fold stratified grouped cross-validation. Model performance was assessed using component-wise area under the receiver operating characteristic curve (AUROC), area under the precision-recall curve (AUPRC), positive predictive value (PPV), macro-averaged Hamming loss, Top-K hit, and coverage rates based on probabilities calibrated using internal grouped Platt scaling, and component-specific safety-oriented threshold calibration. Results: The hierarchical models demonstrated consistent predictive performance across both decision levels, although precision-recall-based analyses indicated greater variability for low-prevalence prescription components. The Level 4 and Level 8 models achieved mean component-wise AUROC values of 0.792 and 0.816, respectively, with macro-averaged Hamming loss of 0.113 and 0.111. Using component-specific Platt scaling within the 5-fold stratified grouped cross-validation framework, Top-K analysis demonstrated a Top-1 hit rate of 86.7% and a Top-3 hit rate of 97.4%. When all prescribed components were considered, Top-K coverage reached 71.7% at Top-3 and increased to 97.0% at Top-8. Safety-oriented threshold calibration was performed separately for each prescription component, selecting the threshold that achieved the highest sensitivity while maintaining a specificity of at least 95%. Under this component-specific calibration strategy, the aggregated operating profile achieved a microaveraged specificity of 96.00% with a microaveraged sensitivity of 28.71%. Age-stratified analyses revealed distinct feature-importance patterns between pediatric and adult populations. Conclusions: The proposed hierarchical clinical decision support framework supported multicomponent foot orthosis prescription under variable information availability commonly encountered in outpatient practice. By generating ranked component-wise recommendations and high-confidence threshold-calibrated outputs, the framework may support clinician decision-making in routine orthotic practice. Further prospective validation will be required to determine its clinical utility. (© Ji-Yong Jung, Wooyeol Yang, Jung-Ja Kim. Originally published in JMIR Medical Informatics (https://medinform.jmir.org).) |
| References: | I Com (Berl). 2021 Jan 26;19(3):171-179. (PMID: 37014363) NPJ Digit Med. 2020 Mar 23;3:41. (PMID: 32219182) J Foot Ankle Res. 2025 Jun;18(2):e70044. (PMID: 40178762) BMC Musculoskelet Disord. 2023 Jan 7;24(1):16. (PMID: 36611153) Front Bioeng Biotechnol. 2023 Sep 11;11:1239246. (PMID: 37767108) BMC Med. 2019 Oct 29;17(1):195. (PMID: 31665002) J Foot Ankle Res. 2017 Jun 7;10:23. (PMID: 28596806) J Am Podiatr Med Assoc. 2001 Oct;91(9):465-87. (PMID: 11679628) Br J Sports Med. 2018 Mar;52(5):322-328. (PMID: 28935689) Gait Posture. 2002 Jun;15(3):282-91. (PMID: 11983503) BMJ. 2005 Apr 2;330(7494):765. (PMID: 15767266) Front Bioeng Biotechnol. 2024 Jan 10;11:1272693. (PMID: 38268942) PLoS One. 2024 Mar 8;19(3):e0299446. (PMID: 38457399) J Foot Ankle Res. 2020 Jun 11;13(1):35. (PMID: 32527296) Gait Posture. 2021 Jan;83:237-244. (PMID: 33190045) Nat Med. 2022 May;28(5):924-933. (PMID: 35585198) Biomed Eng Online. 2021 Jun 22;20(1):62. (PMID: 34158070) Gait Posture. 2024 Mar;109:120-125. (PMID: 38301334) JAMA. 2018 Apr 3;319(13):1317-1318. (PMID: 29532063) Sci Rep. 2021 Apr 19;11(1):8499. (PMID: 33875716) JMIR Med Inform. 2025 Nov 14;13:e79307. (PMID: 41237368) Int J Environ Res Public Health. 2022 Sep 30;19(19):. (PMID: 36231782) NPJ Digit Med. 2020 Feb 6;3:17. (PMID: 32047862) Foot (Edinb). 2019 Dec;41:39-43. (PMID: 31683095) Gait Posture. 2020 Feb;76:238-251. (PMID: 31874456) J Med Internet Res. 2025 Apr 07;27:e62732. (PMID: 40194276) J Am Med Inform Assoc. 2017 Jan;24(1):198-208. (PMID: 27189013) Sensors (Basel). 2024 Jun 03;24(11):. (PMID: 38894404) J Foot Ankle Res. 2018 Nov 26;11:64. (PMID: 30505351) N Engl J Med. 2019 Jun 27;380(26):2588. (PMID: 31242379) JAMA. 2018 Dec 4;320(21):2199-2200. (PMID: 30398550) J Neuroeng Rehabil. 2022 Jan 16;19(1):4. (PMID: 35034658) Sci Rep. 2025 Dec 29;15(1):44896. (PMID: 41462546) Eur J Pediatr. 2024 Mar;183(3):1287-1294. (PMID: 38103102) Gait Posture. 2007 Jun;26(1):68-75. (PMID: 16945538) J Foot Ankle Res. 2024 Sep;17(3):e12047. (PMID: 39169687) Eur J Phys Rehabil Med. 2011 Mar;47(1):69-89. (PMID: 21448121) Nat Med. 2019 Jan;25(1):44-56. (PMID: 30617339) Sensors (Basel). 2020 Aug 11;20(16):. (PMID: 32796568) NPJ Digit Med. 2023 Nov 7;6(1):206. (PMID: 37935953) Front Bioeng Biotechnol. 2025 Jun 19;13:1579072. (PMID: 40613004) |
| Contributed Indexing: | Keywords: clinical decision support system; foot orthosis prescription; gradient boosting; hierarchical machine learning; multilabel classification; outpatient clinical data |
| Entry Date(s): | Date Created: 20260922 Date Completed: 20260922 Latest Revision: 20260924 |
| Update Code: | 20260925 |
| PubMed Central ID: | PMC13597017 |
| DOI: | 10.2196/92831 |
| PMID: | 42771890 |
| Βάση Δεδομένων: | MEDLINE |
καταχωρήστε σχόλιο πρώτοι!