title: Augmented reality and haptic interfaces for robot-assisted surgery.
abstract: BACKGROUND
  Current teleoperated robot-assisted minimally invasive surgical systems do not take full advantage of the potential performance enhancements offered by various forms of haptic feedback to the surgeon. Direct and graphical haptic feedback systems can be integrated with vision and robot control systems in order to provide haptic feedback to improve safety and tissue mechanical property identification.
  
  
  METHODS
  An interoperable interface for teleoperated robot-assisted minimally invasive surgery was developed to provide haptic feedback and augmented visual feedback using three-dimensional (3D) graphical overlays. The software framework consists of control and command software, robot plug-ins, image processing plug-ins and 3D surface reconstructions.
  
  
  RESULTS
  The feasibility of the interface was demonstrated in two tasks performed with artificial tissue: palpation to detect hard lumps and surface tracing, using vision-based forbidden-region virtual fixtures to prevent the patient-side manipulator from entering unwanted regions of the workspace.
  
  
  CONCLUSIONS
  The interoperable interface enables fast development and successful implementation of effective haptic feedback methods in teleoperation.
authors: Department of Mechanical Engineering, Johns Hopkins University, Baltimore, MD, USA. tyama@jhu.edu
authors: Tomonori
authors: T
authors: Yamamoto
authors: Niki
authors: N
authors: Abolhassani
authors: Sung
authors: S
authors: Jung
authors: Allison M
authors: AM
authors: Okamura
authors: Timothy N
authors: TN
authors: Judkins
mesh_terms: D000465:Algorithms; D004867:Equipment Design; D005246:Feedback; D006801:Humans; D007091:Image Processing, Computer-Assisted; D021621:Imaging, Three-Dimensional / Q000379:methods; D008297:Male; D019060:Minimally Invasive Surgical Procedures / Q000379:methods*; D015233:Models, Statistical; D011467:Prostate / Q000473:pathology*; D015203:Reproducibility of Results; D012371:Robotics / Q000295:instrumentation*; D012984:Software; D013314:Stress, Mechanical; D013499:Surface Properties; D017216:Telemedicine / Q000379:methods*