Bibliographic Details
| Title: |
SurgNavAR: An Augmented Reality Surgical Navigation Framework for Optical See-Through Head Mounted Displays. |
| Authors: |
Thabit A, Benmahdjoub M, Jinabade R, Salim HS, van Veelen MC, van Vledder MG, Wolvius EB, van Walsum T |
| Source: |
IEEE transactions on visualization and computer graphics [IEEE Trans Vis Comput Graph] 2026 Jul; Vol. 32 (7), pp. 7175-7187. |
| Publication Type: |
Journal Article |
| Language: |
English |
| Journal Info: |
Publisher: IEEE Computer Society Country of Publication: United States NLM ID: 9891704 Publication Model: Print Cited Medium: Internet ISSN: 1941-0506 (Electronic) Linking ISSN: 10772626 NLM ISO Abbreviation: IEEE Trans Vis Comput Graph Subsets: MEDLINE |
| Imprint Name(s): |
Original Publication: New York, NY : IEEE Computer Society, c1995- |
| MeSH Terms: |
Imaging, Three-Dimensional*/methods , Imaging, Three-Dimensional*/instrumentation , Surgery, Computer-Assisted*/instrumentation , Surgery, Computer-Assisted*/methods , Augmented Reality* , Surgical Navigation Systems* , Computer Graphics* , Smart Glasses*, Humans ; Phantoms, Imaging ; Equipment Design ; Head |
| Abstract: |
Augmented reality (AR) devices with head mounted displays (HMDs) facilitate direct superimposition of 3D preoperative imaging data onto the patient during surgery. To use an HMD-AR device as a stand-alone surgical navigation system, the device should be able to locate the patient and surgical instruments, align preoperative imaging data with the patient, and visualize navigation data during surgery. Whereas some of the technologies required for this are known, integration in such devices is cumbersome and requires specific knowledge and expertise, hampering scientific progress in this field. This work therefore aims to present and evaluate an integrated HMD-based AR surgical navigation framework that is adaptable to diverse surgical applications. The framework tracks 2D patterns as reference markers attached to the patient and surgical instruments. It allows for the calibration of surgical tools using pivot and reference-based calibration techniques. It enables image-to-patient registration using point-based matching and manual positioning. The integrated functionalities of the framework are evaluated on two HMD devices, the HoloLens 2 and Magic Leap 2, with two surgical use cases being evaluated in a phantom setup: AR-guided needle insertion and rib fracture localization. The framework was able to achieve a mean tooltip calibration accuracy of 1 mm, a registration accuracy of 3 mm, and a targeting accuracy below 5 mm on the two surgical use cases. The framework presents an easy-to-use configurable tool for HMD-based AR surgical navigation, which can be extended and adapted to many surgical applications. |
| Entry Date(s): |
Date Created: 20260519 Date Completed: 20260623 Latest Revision: 20260624 |
| Update Code: |
20260624 |
| DOI: |
10.1109/TVCG.2026.3694489 |
| PMID: |
42154689 |
| Database: |
MEDLINE |