Academic Journal
Artificial intelligence-based photographic detection of pink esthetic score attributes using a hybrid deep learning segmentation pipeline: a method development study.
| Title: | Artificial intelligence-based photographic detection of pink esthetic score attributes using a hybrid deep learning segmentation pipeline: a method development study. |
|---|---|
| Authors: | Ibrahim M; Department of Periodontology, Faculty of Dentistry, Cairo University, 11 Saray Street, Almanial, Cairo, Egypt. mihad.ibrahim@dentistry.cu.edu.eg., Adayil GG; Faculty of Dentistry, Cairo University, Cairo, Egypt., Hany N; Computer Vision Engineer at Cyshield Egypt, Cairo, Egypt., Emad N; Computer Vision Specialist Engineer and Team Lead at Cyshield Egypt, Cairo, Egypt., Hosny MM; Faculty of Dentistry, Cairo University, Cairo, Egypt. |
| Source: | Scientific reports [Sci Rep] 2026 Aug 01; Vol. 16 (1). Date of Electronic Publication: 2026 Aug 01. |
| Publication Type: | Journal Article |
| Language: | English |
| Journal Info: | Publisher: Nature Publishing Group Country of Publication: England NLM ID: 101563288 Publication Model: Electronic Cited Medium: Internet ISSN: 2045-2322 (Electronic) Linking ISSN: 20452322 NLM ISO Abbreviation: Sci Rep Subsets: MEDLINE |
| Imprint Name(s): | Original Publication: London : Nature Publishing Group, copyright 2011- |
| MeSH Terms: | Image Processing, Computer-Assisted*/methods , Photography*/methods , Photography, Dental*/methods , Deep Learning* , Artificial Intelligence* , Esthetics, Dental*, Gingiva/anatomy & histology ; Tooth Crown/anatomy & histology ; Humans |
| Abstract: | This study aimed to develop and internally validate a novel anatomy-driven artificial intelligence (AI) system for automated postoperative Pink Esthetic Score (PES) evaluation from intraoral photographs. Unlike most existing AI approaches, which rely on end-to-end prediction, the proposed pipeline derives PES attributes from anatomically grounded measurements. A hybrid analytical pipeline integrating instance segmentation and rule-based measurement was developed. Tooth crown segmentation was performed using Mask R-CNN, while gingival segmentation was performed using YOLOv11. Anatomical features were extracted from the segmented structures and converted into ordinal PES attributes through data-driven threshold calibration derived from the training dataset. The reference standard consisted of independent expert scoring of 82 postoperative intraoral photographs. Diagnostic accuracy, confusion matrix analyses, and regression metrics were calculated to evaluate agreement between automated and expert assessments. The hybrid segmentation-based system achieved accuracies of 91.5% for the mesial papilla, 85.4% for the distal papilla, 86.6% for the gingival margin, and 82.9% for gingival color assessment. Exact agreement between automated and expert total PES scores was observed in 57.3% of cases, increasing to 79.3% when a clinically relevant tolerance of ± 1 PES point was applied. Regression analysis demonstrated a mean absolute error of 0.76, a root mean squared error of 1.35, and an R² value of 0.49. An anatomy-driven segmentation framework may provide a transparent and reproducible approach for automated photographic PES attribute assessment in research settings. (© 2026. The Author(s).) |
| Competing Interests: | Declarations. Competing interests: The authors declare no competing interests. Ethics approval: This study was approved by the Cairo University Research Ethics Committee (REC), approval number: 06–25. |
| References: | Stefanini, M. et al. Do soft tissue augmentation techniques provide stable and favorable peri-implant conditions in the medium and long term? A systematic review. Clin. Oral Implants Res. 34, 28–42 (2023). (PMID: 10.1111/clr.1415037750532) Tonetti, M. et al. Aesthetics and patient-reported outcomes in periodontology and implant dentistry: consensus report. J. Clin. Periodontol. 52 (9), 1222–1244 (2025). (PMID: 10.1111/jcpe.141824049511212377961) Fürhauser, R. et al. Evaluation of soft tissue around single-tooth implant crowns: the pink esthetic score. Clin. Oral Implants Res. 16 (6), 639–644 (2005). (PMID: 10.1111/j.1600-0501.2005.01193.x16307569) Meijer, H. J. A., Stellingsma, K., Meijndert, L. & Raghoebar, G. M. A new index for rating aesthetics of implant-supported single crowns and adjacent soft tissues—the Implant Crown Aesthetic Index. Clin. Oral Implants Res. 16 (6), 645–649 (2005). (PMID: 10.1111/j.1600-0501.2005.01128.x16307570) Belser, U. C. et al. Outcome evaluation of early placed maxillary anterior single-tooth implants using objective esthetic criteria: A cross-sectional, retrospective study in 45 patients with a 2- to 4-year follow-up using pink and white esthetic scores. J. Periodontol. 80(1), 140–51 (2009). (PMID: 10.1902/jop.2009.08043519228100) Hof, M. et al. Evaluation of implant esthetics using eight objective indices—comparative analysis of reliability and validity. Clin. Oral Implants Res. 29 (7), 697–706 (2018). (PMID: 10.1111/clr.1326129926991) Srivastava, G. et al. Reproducibility and validity of anterior implant esthetic indices: a review. J. Indian Soc. Periodontol. 24 (4), 301–308 (2020). (PMID: 10.4103/jisp.jisp_528_19328315017418544) Cosyn, J. et al. Soft tissue metric parameters, methods and aesthetic indices in implant dentistry: A critical review. Clin. Oral Implants Res. https://doi.org/10.1111/clr.13756 (2021). (PMID: 10.1111/clr.13756346429838596754) Afrashtehfar, K. I., Assery, M. K. A. & Bryant, S. R. Aesthetic parameters and patient-perspective assessment tools for maxillary anterior single implants. Int. J. Dent. 2021, 6684028 (2021). (PMID: 10.1155/2021/6684028337082557932805) Gehrke, P., Lobert, M. & Dhom, G. Reproducibility of the pink esthetic score—rating soft tissue esthetics around single-implant restorations with regard to dental observer specialization. J. Esthet Restor. Dent. 20 (6), 375–384 (2008). (PMID: 10.1111/j.1708-8240.2008.00212.x19120783) Hamdane, K. & Nasri, W. Esthetic evaluation of single implant-supported prostheses: comparative analysis of the reliability of the esthetic indices. J. Esthet Restor. Dent. 34 (4), 680–688 (2022). (PMID: 10.1111/jerd.1286234971018) Issa, J. et al. Diagnostic test accuracy of artificial intelligence in detecting periapical periodontitis on two-dimensional radiographs: A retrospective study and literature review. Medicina (Kaunas) 59(4), 768 (2023). (PMID: 10.3390/medicina590407683710972610142688) Danks, R. P. et al. Automating periodontal bone loss measurement via dental landmark localisation. Int. J. Comput. Assist. Radiol. Surg. 16 (7), 1189–1199 (2021). (PMID: 10.1007/s11548-021-02431-z341525678260405) Huerta Moncho, A. Vision-based analysis of medical images for assessing bone loss in dental implant patients. (2025). Wu, Z. et al. Prediction of pink esthetic score using deep learning: A proof of concept. J. Dent. 155, 105601 (2025). (PMID: 10.1016/j.jdent.2025.10560139892738) Sounderajah, V. et al. The STARD-AI reporting guideline for diagnostic accuracy studies using artificial intelligence. Nat. Med. 31 (10), 3283–3289 (2025). (PMID: 10.1038/s41591-025-03953-840954311) Feiner, L. F. et al. Propagation and attribution of uncertainty in medical imaging pipelines. In Uncertainty for Safe Utilization of Machine Learning in Medical Imaging (UNSURE 2023) (Springer, 2023) ((arXiv:2309.16831)). Probst, P., Boulesteix, A-L. & Bischl, B. Tunability: importance of hyperparameters of machine learning algorithms. J. Mach. Learn. Res. 20 (53), 1–32 (2019). Esposito, C., Landrum, G. A., Schneider, N., Stiefl, N. & Riniker, S. GHOST: Adjusting the decision threshold to handle imbalanced data in machine learning. J. Chem. Inf. Model. 61(6), 2623–2640 (2021). (PMID: 10.1021/acs.jcim.1c0016034100609) Rudin, C. Stop explaining black box machine learning models for high-stakes decisions and use interpretable models instead. Nat. Mach. Intell. 1 (5), 206–215 (2019). (PMID: 10.1038/s42256-019-0048-x356030109122117) Vandeweghe, C., Agossa, K., Sabri, H., Wang, H. L. & Colard, T. Evaluating radiographic measurements for detecting interdental papilla: A pilot study. J. Esthet. Restor. Dent. https://doi.org/10.1111/jerd.13480 (2025). (PMID: 10.1111/jerd.134804029634712214043) Pitchika, V., Büttner, M. & Schwendicke, F. Artificial intelligence and personalized diagnostics in periodontology: a narrative review. Periodontol 2000. 95 (1), 220–231 (2024). (PMID: 10.1111/prd.1258638927004) Mao, K. et al. Artificial intelligence in detecting periodontal disease from intraoral photographs: A systematic review. Int. Dent. J. 75(5), 100883 (2025). (PMID: 10.1016/j.identj.2025.1008834063913712274314) Huang, N. et al. Predicting the risk of dental implant loss using deep learning. J. Clin. Periodontol. 49 (9), 872–883 (2022). (PMID: 10.1111/jcpe.1368935734921) Alotaibi, G. et al. Artificial intelligence (AI) diagnostic tools: utilizing a convolutional neural network (CNN) to assess periodontal bone level radiographically—a retrospective study. BMC Oral Health. 22 (1), 399 (2022). (PMID: 10.1186/s12903-022-02436-3361008569469589) |
| Contributed Indexing: | Keywords: Artificial intelligence; Computer-aided diagnosis; Deep learning; Dental implants; Esthetics |
| Entry Date(s): | Date Created: 20260801 Date Completed: 20260801 Latest Revision: 20260801 |
| Update Code: | 20260802 |
| DOI: | 10.1038/s41598-026-62229-4 |
| PMID: | 42542472 |
| Database: | MEDLINE |
Be the first to leave a comment!