Real-time surgical tool tracking and pose estimation using a hybrid cylindrical marker.
OBJECTIVE
To provide an integrated visualisation of intraoperative ultrasound and endoscopic images to facilitate intraoperative guidance, real-time tracking of the ultrasound probe is required. State-of-the-art methods are suitable for planar targets while most of the laparoscopic ultrasound probes are cylindrical objects. A tracking framework for cylindrical objects with a large work space will improve the usability of the intraoperative ultrasound guidance.


METHODS
A hybrid marker design that combines circular dots and chessboard vertices is proposed for facilitating tracking cylindrical tools. The circular dots placed over the curved surface are used for pose estimation. The chessboard vertices are employed to provide additional information for resolving the ambiguous pose problem due to the use of planar model points under a monocular camera. Furthermore, temporal information between consecutive images is considered to minimise tracking failures with real-time computational performance.


RESULTS
Detailed validation confirms that our hybrid marker provides a large working space for different tool sizes (6-14 mm in diameter). The tracking framework allows translational movements between 40 and 185 mm along the depth direction and rotational motion around three local orthogonal axes up to [Formula: see text]. Comparative studies with the current state of the art confirm that our approach outperforms existing methods by providing nearly 100% detection rates and accurate pose estimation with mean errors of 2.8 mm and 0.72[Formula: see text]. The tracking algorithm runs at 20 frames per second for [Formula: see text] image resolution videos.


CONCLUSIONS
Experiments show that the proposed hybrid marker can be applied to a wide range of surgical tools with superior detection rates and pose estimation accuracies. Both the qualitative and quantitative results demonstrate that our framework can be used not only for assisting intraoperative ultrasound guidance but also for tracking general surgical tools in MIS.
Hamlyn Centre for Robotic Surgery, Imperial College London, London, UK. lin.zhang11@imperial.ac.uk.
Lin
http://orcid.org/0000-0003-0353-4465
L
Zhang
Hamlyn Centre for Robotic Surgery, Imperial College London, London, UK.
Menglong
M
Ye
Hamlyn Centre for Robotic Surgery, Imperial College London, London, UK.
Po-Ling
PL
Chan
Hamlyn Centre for Robotic Surgery, Imperial College London, London, UK.
Guang-Zhong
GZ
Yang
D000465:Algorithms; D004724:Endoscopy / Q000379:methods*; D006801:Humans; D009068:Movement; D061646:Operative Time; D025321:Surgery, Computer-Assisted / Q000379:methods*; D014463:Ultrasonography / Q000379:methods*
Cylindrical marker; Image guidance; Pose estimation; Surgical tool; Tracking