title: Personalized augmented reality for anatomy education.
abstract: Anatomy education is a challenging but vital element in forming future medical professionals. In this work, a personalized and interactive augmented reality system is developed to facilitate education. This system behaves as a "magic mirror" which allows personalized in-situ visualization of anatomy on the user's body. Real-time volume visualization of a CT dataset creates the illusion that the user can look inside their body. The system comprises a RGB-D sensor as a real-time tracking device to detect the user moving in front of a display. In addition, the magic mirror system shows text information, medical images, and 3D models of organs that the user can interact with. Through the participation of 7 clinicians and 72 students, two user studies were designed to respectively assess the precision and acceptability of the magic mirror system for education. The results of the first study demonstrated that the average precision of the augmented reality overlay on the user body was 0.96 cm, while the results of the second study indicate 86.1% approval for the educational value of the magic mirror, and 91.7% approval for the augmented reality capability of displaying organs in three dimensions. The usefulness of this unique type of personalized augmented reality technology has been demonstrated in this paper.
authors.affiliation: Chair for Computer Aided Medical Procedures & Augmented Reality, Technische Universität München, Munich, Germany.
authors.forename: Meng
authors.initials: M
authors.lastname: Ma
authors.affiliation: Chair for Computer Aided Medical Procedures & Augmented Reality, Technische Universität München, Munich, Germany.
authors.forename: Pascal
authors.initials: P
authors.lastname: Fallavollita
authors.affiliation: Ludwig-Maximilians, Universität München, Munich, Germany.
authors.forename: Ina
authors.initials: I
authors.lastname: Seelbach
authors.affiliation: Klinik Für Allgemeine, Unfall-, Hand- Und Plastische Chirurgie, Klinikum Der Universität München, Munich, Germany.
authors.forename: Anna Maria
authors.initials: AM
authors.lastname: Von Der Heide
authors.affiliation: Klinik Für Allgemeine, Unfall-, Hand- Und Plastische Chirurgie, Klinikum Der Universität München, Munich, Germany.
authors.forename: Ekkehard
authors.initials: E
authors.lastname: Euler
authors.affiliation: Anatomische Anstalt Der Ludwig-Maximilians-Universität München, Munich, Germany.
authors.forename: Jens
authors.initials: J
authors.lastname: Waschke
authors.affiliation: Chair for Computer Aided Medical Procedures & Augmented Reality, Technische Universität München, Munich, Germany.|Johns Hopkins University, Baltimore, USA.
authors.forename: Nassir
authors.initials: N
authors.lastname: Navab
mesh_terms: D000715:Anatomy / Q000193:education*; D003198:Computer Simulation; D004504:Education, Medical, Undergraduate / Q000379:methods*; D006801:Humans; D021621:Imaging, Three-Dimensional / Q000379:methods*; D014057:Tomography, X-Ray Computed; D014584:User-Computer Interface; D018910:Video Games
keywords: anatomy; augmented reality; curriculum; education; students