Projector-based augmented reality for intuitive intraoperative guidance in image-guided 3D interstitial brachytherapy.
OBJECTIVE
The aim of this study is to implement augmented reality in real-time image-guided interstitial brachytherapy to allow an intuitive real-time intraoperative orientation.


METHODS
The developed system consists of a common video projector, two high-resolution charge coupled device cameras, and an off-the-shelf notebook. The projector was used as a scanning device by projecting coded-light patterns to register the patient and superimpose the operating field with planning data and additional information in arbitrary colors. Subsequent movements of the nonfixed patient were detected by means of stereoscopically tracking passive markers attached to the patient.


RESULTS
In a first clinical study, we evaluated the whole process chain from image acquisition to data projection and determined overall accuracy with 10 patients undergoing implantation. The described method enabled the surgeon to visualize planning data on top of any preoperatively segmented and triangulated surface (skin) with direct line of sight during the operation. Furthermore, the tracking system allowed dynamic adjustment of the data to the patient's current position and therefore eliminated the need for rigid fixation. Because of soft-part displacement, we obtained an average deviation of 1.1 mm by moving the patient, whereas changing the projector's position resulted in an average deviation of 0.9 mm. Mean deviation of all needles of an implant was 1.4 mm (range, 0.3-2.7 mm).


CONCLUSIONS
The developed low-cost augmented-reality system proved to be accurate and feasible in interstitial brachytherapy. The system meets clinical demands and enables intuitive real-time intraoperative orientation and monitoring of needle implantation.
Krempien
Robert
R
Department of Radiation Oncology, University of Heidelberg, Heidelberg, Germany. robert_krempien@med.uni-heidelberg-de
Hoppe
Harald
H
Kahrs
Lüder
L
Daeuber
Sascha
S
Schorr
Oliver
O
Eggers
Georg
G
Bischof
Marc
M
Munter
Marc W
MW
Debus
Juergen
J
Harms
Wolfgang
W
D001918:Brachytherapy / Q000295:instrumentation* / Q000379:methods; D003626:Data Display; D004867:Equipment Design; D006801:Humans; D021621:Imaging, Three-Dimensional / Q000295:instrumentation* / Q000379:methods; D007432:Intraoperative Period; D009369:Neoplasms / Q000532:radiotherapy*; D011881:Radiotherapy, Computer-Assisted / Q000295:instrumentation* / Q000379:methods; D014057:Tomography, X-Ray Computed; D014584:User-Computer Interface