Share Email Print

Proceedings Paper

Technical note: on-the-fly augmented reality for orthopaedic surgery using a multi-modal fiducial
Author(s): Sebastian Andress; Alex Johson; Mathias Unberath; Alexander Winkler; Kevin Yu; Javad Fotouhi; Simon Weidert; Greg Osgood; Nassir Navab
Format Member Price Non-Member Price
PDF $17.00 $21.00

Paper Abstract

C-Arm X-Ray systems are the workhorse modality for guidance of percutaneous orthopaedic surgical procedures. However, two-dimensional observations of the three-dimensional anatomy suffer from the effects of projective simplification. Consequently, many X-Ray images from various orientations need to be acquired for the surgeon to accurately assess the spatial relations between the patient’s anatomy and the surgical tools.

In this paper, we present an on-the-fly surgical support system that provides guidance using augmented reality and can be used in quasi-unprepared operating rooms. The proposed system builds upon a multi-modality marker and simultaneous localization and mapping technique to co-calibrate an optical see-through head mounted display to a C-Arm fluoroscopy system. Then, annotations on the 2-D X-Ray images can be rendered as virtual objects in 3-D providing surgical guidance. In a feasibility study on a semi-anthropomorphic phantom we found the accuracy of our system to be comparable to the traditional image-guided technique while substantially reducing the number of acquired X-Ray images as well as procedure time. Our promising results encourage further research on the interaction between virtual and real objects, that we believe will directly benefit the proposed method. Further, we would like to explore the capabilities of our on-the-fly augmented reality support system in a larger study directed towards common orthopaedic interventions.

Paper Details

Date Published: 13 March 2018
PDF: 8 pages
Proc. SPIE 10576, Medical Imaging 2018: Image-Guided Procedures, Robotic Interventions, and Modeling, 105760H (13 March 2018); doi: 10.1117/12.2319048
Show Author Affiliations
Sebastian Andress, Johns Hopkins Univ. (United States)
Ludwig-Maximilians-Univ. (Germany)
Alex Johson, Johns Hopkins Hospital (United States)
Mathias Unberath, Johns Hopkins Univ. (United States)
Alexander Winkler, Johns Hopkins Univ. (United States)
Technische Univ. München (Germany)
Kevin Yu, Johns Hopkins Univ. (United States)
Technische Univ. München (Germany)
Javad Fotouhi, Johns Hopkins Univ. (United States)
Simon Weidert, Ludwig-Maximilians-Univ. (Germany)
Greg Osgood, Johns Hopkins Hospital (United States)
Nassir Navab, Johns Hopkins Univ. (United States)
Technische Univ. München (Germany)

Published in SPIE Proceedings Vol. 10576:
Medical Imaging 2018: Image-Guided Procedures, Robotic Interventions, and Modeling
Baowei Fei; Robert J. Webster III, Editor(s)

© SPIE. Terms of Use
Back to Top
Sign in to read the full article
Create a free SPIE account to get access to
premium articles and original research
Forgot your username?