Academic Journal
An Automated Video Analysis System for Retrospective Assessment and Real-Time Monitoring of Endoscopic Procedures (with Video).
| Τίτλος: | An Automated Video Analysis System for Retrospective Assessment and Real-Time Monitoring of Endoscopic Procedures (with Video). |
|---|---|
| Συγγραφείς: | Zhu Y; Endoscopy Center and Endoscopy Research Institute, Zhongshan Hospital, Fudan University, Shanghai 200032, China.; Shanghai Collaborative Innovation Center of Endoscopy, Shanghai 200032, China., Du L; Endoscopy Center and Endoscopy Research Institute, Zhongshan Hospital, Fudan University, Shanghai 200032, China.; Shanghai Collaborative Innovation Center of Endoscopy, Shanghai 200032, China., Fu PY; Endoscopy Center and Endoscopy Research Institute, Zhongshan Hospital, Fudan University, Shanghai 200032, China.; Shanghai Collaborative Innovation Center of Endoscopy, Shanghai 200032, China., Geng ZH; Endoscopy Center and Endoscopy Research Institute, Zhongshan Hospital, Fudan University, Shanghai 200032, China.; Shanghai Collaborative Innovation Center of Endoscopy, Shanghai 200032, China., Zhang DF; Endoscopy Center and Endoscopy Research Institute, Zhongshan Hospital, Fudan University, Shanghai 200032, China.; Shanghai Collaborative Innovation Center of Endoscopy, Shanghai 200032, China., Chen WF; Endoscopy Center and Endoscopy Research Institute, Zhongshan Hospital, Fudan University, Shanghai 200032, China.; Shanghai Collaborative Innovation Center of Endoscopy, Shanghai 200032, China., Li QL; Endoscopy Center and Endoscopy Research Institute, Zhongshan Hospital, Fudan University, Shanghai 200032, China.; Shanghai Collaborative Innovation Center of Endoscopy, Shanghai 200032, China., Zhou PH; Endoscopy Center and Endoscopy Research Institute, Zhongshan Hospital, Fudan University, Shanghai 200032, China.; Shanghai Collaborative Innovation Center of Endoscopy, Shanghai 200032, China. |
| Πηγή: | Bioengineering (Basel, Switzerland) [Bioengineering (Basel)] 2024 Apr 30; Vol. 11 (5). Date of Electronic Publication: 2024 Apr 30. |
| Τύπος έκδοσης: | Journal Article |
| Γλώσσα: | English |
| Στοιχεία περιοδικού: | Publisher: MDPI AG Country of Publication: Switzerland NLM ID: 101676056 Publication Model: Electronic Cited Medium: Print ISSN: 2306-5354 (Print) Linking ISSN: 23065354 NLM ISO Abbreviation: Bioengineering (Basel) Subsets: PubMed not MEDLINE |
| Imprint Name(s): | Original Publication: Basel, Switzerland : MDPI AG, [2014]- |
| Περίληψη: | Background and Aims: Accurate recognition of endoscopic instruments facilitates quantitative evaluation and quality control of endoscopic procedures. However, no relevant research has been reported. In this study, we aimed to develop a computer-assisted system, EndoAdd, for automated endoscopic surgical video analysis based on our dataset of endoscopic instrument images. Methods: Large training and validation datasets containing 45,143 images of 10 different endoscopic instruments and a test dataset of 18,375 images collected from several medical centers were used in this research. Annotated image frames were used to train the state-of-the-art object detection model, YOLO-v5, to identify the instruments. Based on the frame-level prediction results, we further developed a hidden Markov model to perform video analysis and generate heatmaps to summarize the videos. Results: EndoAdd achieved high accuracy (>97%) on the test dataset for all 10 endoscopic instrument types. The mean average accuracy, precision, recall, and F1-score were 99.1%, 92.0%, 88.8%, and 89.3%, respectively. The area under the curve values exceeded 0.94 for all instrument types. Heatmaps of endoscopic procedures were generated for both retrospective and real-time analyses. Conclusions: We successfully developed an automated endoscopic video analysis system, EndoAdd, which supports retrospective assessment and real-time monitoring. It can be used for data analysis and quality control of endoscopic procedures in clinical practice. |
| References: | J Gastroenterol Hepatol. 2022 Jan;37(1):48-55. (PMID: 34368989) Surg Endosc. 2020 Dec;34(12):5377-5383. (PMID: 31996995) NPJ Digit Med. 2023 Mar 14;6(1):41. (PMID: 36918730) Annu Int Conf IEEE Eng Med Biol Soc. 2017 Jul;2017:1756-1759. (PMID: 29060227) Med Image Anal. 2022 Nov;82:102597. (PMID: 36095907) Ann Gastroenterol Surg. 2021 Oct 08;6(1):29-36. (PMID: 35106412) Surg Endosc. 2021 Jul;35(7):4008-4015. (PMID: 32720177) Ann Surg. 2019 Sep;270(3):414-421. (PMID: 31274652) Surg Endosc. 2022 May;36(5):3160-3168. (PMID: 34231066) Ann Transl Med. 2022 Dec;10(23):1272. (PMID: 36618796) Med Educ Online. 2020 Dec;25(1):1714197. (PMID: 31920174) Gastroenterology. 2020 Jan;158(1):76-94.e2. (PMID: 31593701) Br J Surg. 2024 Jan 3;111(1):. (PMID: 37935636) Ann Surg. 2018 Jul;268(1):70-76. (PMID: 29389679) Int J Comput Assist Radiol Surg. 2017 Jun;12(6):1013-1020. (PMID: 28357628) Laryngoscope. 2022 Dec;132(12):2516-2523. (PMID: 35638245) Surg Endosc. 2021 Apr;35(4):1521-1533. (PMID: 33398560) J Am Coll Surg. 2020 May;230(5):725-732.e1. (PMID: 32156655) Int J Comput Assist Radiol Surg. 2021 Nov;16(11):2045-2054. (PMID: 34169465) Surg Endosc. 2018 Feb;32(2):553-568. (PMID: 29075965) Surg Endosc. 2020 Nov;34(11):4924-4931. (PMID: 31797047) Endoscopy. 2022 Nov;54(11):E668-E669. (PMID: 35168278) Ann Surg. 2016 Jul;264(1):32-3. (PMID: 26756757) JAMA Netw Open. 2021 Aug 2;4(8):e2120786. (PMID: 34387676) Gastrointest Endosc. 2019 Apr;89(4):806-815.e1. (PMID: 30452913) Int J Surg. 2021 Nov;95:106151. (PMID: 34695601) J Surg Educ. 2019 Nov - Dec;76(6):1629-1639. (PMID: 31272846) Int J Surg. 2020 Jul;79:88-94. (PMID: 32413503) Sensors (Basel). 2021 Aug 17;21(16):. (PMID: 34450976) |
| Grant Information: | 2019YFC1315800 National Key R&D Program of China; 82170555 National Natural Science Foundation of China; 81873552 National Natural Science Foundation of China; 81670483 National Natural Science Foundation of China; 19QA1401900 Shanghai Rising-Star Program; 19441905200 Major Project of Shanghai Municipal Science and Technology Committee; 19YF1406400 Shanghai Sailing Programs of Shanghai Municipal Science and Technology Committee; 22YF1409300 Shanghai Sailing Programs of Shanghai Municipal Science and Technology Committee |
| Contributed Indexing: | Keywords: artificial intelligence; endoscopic resection; real-time video analysis; surgical video |
| Entry Date(s): | Date Created: 20240525 Latest Revision: 20240527 |
| Update Code: | 20260130 |
| PubMed Central ID: | PMC11118061 |
| DOI: | 10.3390/bioengineering11050445 |
| PMID: | 38790312 |
| Βάση Δεδομένων: | MEDLINE |
| ISSN: | 2306-5354 |
|---|---|
| DOI: | 10.3390/bioengineering11050445 |