Automatic segmentation and supervised learning-based selection of nuclei in cancer tissue images.
Analysis of preferential localization of certain genes within the cell nuclei is emerging as a new technique for the diagnosis of breast cancer. Quantitation requires accurate segmentation of 100-200 cell nuclei in each tissue section to draw a statistically significant result. Thus, for large-scale analysis, manual processing is too time consuming and subjective. Fortuitously, acquired images generally contain many more nuclei than are needed for analysis. Therefore, we developed an integrated workflow that selects, following automatic segmentation, a subpopulation of accurately delineated nuclei for positioning of fluorescence in situ hybridization-labeled genes of interest. Segmentation was performed by a multistage watershed-based algorithm and screening by an artificial neural network-based pattern recognition engine. The performance of the workflow was quantified in terms of the fraction of automatically selected nuclei that were visually confirmed as well segmented and by the boundary accuracy of the well-segmented nuclei relative to a 2D dynamic programming-based reference segmentation method. Application of the method was demonstrated for discriminating normal and cancerous breast tissue sections based on the differential positioning of the HES5 gene. Automatic results agreed with manual analysis in 11 out of 14 cancers, all four normal cases, and all five noncancerous breast disease cases, thus showing the accuracy and robustness of the proposed approach.
Optical Microscopy and Analysis Laboratory, Advanced Technology Program, SAIC-Frederick, Inc., Frederick National Laboratory for Cancer Research, Frederick, Maryland 21702, USA. nandyk@mail.nih.gov
Kaustav
K
Nandy
Prabhakar R
PR
Gudla
Ryan
R
Amundsen
Karen J
KJ
Meaburn
Tom
T
Misteli
Stephen J
SJ
Lockett
D000465:Algorithms; D057205:Automation, Laboratory; D051792:Basic Helix-Loop-Helix Proteins / Q000235:genetics; D001943:Breast Neoplasms / Q000175:diagnosis / Q000235:genetics / Q000473:pathology*; D002467:Cell Nucleus / Q000473:pathology*; D053144:Cell Nucleus Shape; D020732:Cytogenetic Analysis / Q000379:methods; D005260:Female; D006801:Humans; D007090:Image Interpretation, Computer-Assisted; D017404:In Situ Hybridization, Fluorescence; D042361:Mammary Glands, Human / Q000473:pathology; D008954:Models, Biological; D016571:Neural Networks, Computer; D012097:Repressor Proteins / Q000235:genetics
D051792:Basic Helix-Loop-Helix Proteins; D012097:Repressor Proteins; C077478:HES5 protein, human