Tissue classification for laparoscopic image understanding based on multispectral texture analysis.
Intraoperative tissue classification is one of the prerequisites for providing context-aware visualization in computer-assisted minimally invasive surgeries. As many anatomical structures are difficult to differentiate in conventional RGB medical images, we propose a classification method based on multispectral image patches. In a comprehensiveex vivostudy through statistical analysis, we show that (1) multispectral imaging data are superior to RGB data for organ tissue classification when used in conjunction with widely applied feature descriptors and (2) combining the tissue texture with the reflectance spectrum improves the classification performance. The classifier reaches an accuracy of 98.4% on our dataset. Multispectral tissue analysis could thus evolve as a key enabling technique in computer-assisted laparoscopy.
German Cancer Research Center (DKFZ) , Department of Computer Assisted Medical Interventions, Im Neuenheimer Feld 581, Heidelberg 69120, Germany.
Yan
Y
Zhang
German Cancer Research Center (DKFZ) , Department of Computer Assisted Medical Interventions, Im Neuenheimer Feld 581, Heidelberg 69120, Germany.
Sebastian J
SJ
Wirkert
German Cancer Research Center (DKFZ) , Department of Computer Assisted Medical Interventions, Im Neuenheimer Feld 581, Heidelberg 69120, Germany.
Justin
J
Iszatt
Heidelberg University Hospital , Department for General, Visceral and Transplantation Surgery, International Office, Im Neuenheimer Feld 400, Heidelberg 69120, Germany.
Hannes
H
Kenngott
Heidelberg University Hospital , Department for General, Visceral and Transplantation Surgery, International Office, Im Neuenheimer Feld 400, Heidelberg 69120, Germany.
Martin
M
Wagner
Heidelberg University Hospital , Department for General, Visceral and Transplantation Surgery, International Office, Im Neuenheimer Feld 400, Heidelberg 69120, Germany.
Benjamin
B
Mayer
University of Heidelberg , Institute of Medical Biometry and Informatics, Im Neuenheimer Feld 130.3, Heidelberg 69120, Germany.
Christian
C
Stock
The Hamlyn Centre, Imperial College London, Bessemer Building, South Kensington Campus, London SW7 2AZ, United Kingdom; Imperial College London, Department of Surgery and Cancer, South Kensington Campus, London SW7 2AZ, United Kingdom.
Neil T
NT
Clancy
The Hamlyn Centre, Imperial College London, Bessemer Building, South Kensington Campus, London SW7 2AZ, United Kingdom; Imperial College London, Department of Surgery and Cancer, South Kensington Campus, London SW7 2AZ, United Kingdom.
Daniel S
DS
Elson
German Cancer Research Center (DKFZ) , Department of Computer Assisted Medical Interventions, Im Neuenheimer Feld 581, Heidelberg 69120, Germany.
Lena
L
Maier-Hein
multispectral laparoscopy; multispectral texture analysis; tissue classification