title: Hybrid Rendering Architecture for Realtime and Photorealistic Simulation of Robot-Assisted Surgery.
abstract: In this paper we present a method for combining realtime and non-realtime (photorealistic) rendering with open source software. Realtime rendering provides sufficient realism and is a good choice for most simulation and regression testing purposes in robot-assisted surgery. However, for proper end-to-end testing of the system, some computer vision algorithms require high fidelity images that capture more minute details of the real scene. One of the central practical obstacles to combining both worlds in a uniform way is creating models that are suitable for both kinds of rendering paradigms. We build a modeling pipeline using open source tools that builds on established, open standards for data exchange. The result is demonstrated through a unified model of the medical OpenHELP phantom used in the Gazebo robotics simulator, which can at the same time be rendered with more visual fidelity in the Cycles raytracer.
authors.affiliation: Institute for Anthropomatics and Robotics (IAR) - Intelligent Process Control and Robotics Lab (IPR), Karlsruhe Institute of Technology (KIT), Germany.
authors.forename: Sebastijan
authors.initials: S
authors.lastname: Müller
authors.affiliation: Institute for Anthropomatics and Robotics (IAR) - Intelligent Process Control and Robotics Lab (IPR), Karlsruhe Institute of Technology (KIT), Germany.
authors.forename: Andreas
authors.initials: A
authors.lastname: Bihlmaier
authors.affiliation: Institute for Anthropomatics and Robotics (IAR) - Intelligent Process Control and Robotics Lab (IPR), Karlsruhe Institute of Technology (KIT), Germany.
authors.forename: Stephan
authors.initials: S
authors.lastname: Irgenfried
authors.affiliation: Institute for Anthropomatics and Robotics (IAR) - Intelligent Process Control and Robotics Lab (IPR), Karlsruhe Institute of Technology (KIT), Germany.
authors.forename: Heinz
authors.initials: H
authors.lastname: Wörn
mesh_terms: D003198:Computer Simulation; D003199:Computer Systems; D003194:Computer-Assisted Instruction / Q000379:methods*; D000070856:High Fidelity Simulation Training / Q000379:methods*; D021621:Imaging, Three-Dimensional / Q000379:methods*; D008954:Models, Biological; D065287:Robotic Surgical Procedures; D014584:User-Computer Interface