A vision-based surgical tool tracking approach for untethered surgery simulation and training.
This paper presents progress in the development of an untethered surgery simulation and training system. A surgical trainee interacts with the simulation in the most natural way possible-using standard, untethered surgical tools and hands. This natural interface requires innovations in tracking, haptic feedback, and visualization. This article describes the approach used for tool tracking with color cameras. A novel tracking algorithm is used to identify the type of tool, its position, and its orientation. Integration of the vision system with the tissue deformation and visualization modules is also discussed.
English
James
J
Energid Technologies Corporation, 124 Mount Auburn Street, Suite 200 North, Cambridge, MA 02138, USA. {jde,cyc,nmt,jjh}@energid.com
Chang
Chu-Yin
CY
Tardella
Neil
N
Hu
Jianjuen
J
D000465:Algorithms; D003198:Computer Simulation; D004501:Education, Medical / Q000379:methods*; D006801:Humans; D013525:Surgical Instruments; D013514:Surgical Procedures, Operative; D018511:Systems Integration; D014584:User-Computer Interface; D014785:Vision, Ocular