title: Reproducibility in the automated quantitative assessment of HER2/neu for breast cancer.
abstract: BACKGROUND
  With the emerging role of digital imaging in pathology and the application of automated image-based algorithms to a number of quantitative tasks, there is a need to examine factors that may affect the reproducibility of results. These factors include the imaging properties of whole slide imaging (WSI) systems and their effect on the performance of quantitative tools. This manuscript examines inter-scanner and inter-algorithm variability in the assessment of the commonly used HER2/neu tissue-based biomarker for breast cancer with emphasis on the effect of algorithm training.
  
  
  METHODS
  A total of 241 regions of interest from 64 breast cancer tissue glass slides were scanned using three different whole-slide images and were analyzed using two different automated image analysis algorithms, one with preset parameters and another incorporating a procedure for objective parameter optimization. Ground truth from a panel of seven pathologists was available from a previous study. Agreement analysis was used to compare the resulting HER2/neu scores.
  
  
  RESULTS
  The results of our study showed that inter-scanner agreement in the assessment of HER2/neu for breast cancer in selected fields of view when analyzed with any of the two algorithms examined in this study was equal or better than the inter-observer agreement previously reported on the same set of data. Results also showed that discrepancies observed between algorithm results on data from different scanners were significantly reduced when the alternative algorithm that incorporated an objective re-training procedure was used, compared to the commercial algorithm with preset parameters.
  
  
  CONCLUSIONS
  Our study supports the use of objective procedures for algorithm training to account for differences in image properties between WSI systems.
authors: Division of Imaging and Applied Mathematics, Office of Science and Engineering Laboratories, Center for Devices and Radiological Health, U.S. Food and Drug Administration, Silver Spring, Maryland, USA.
authors: Tyler
authors: T
authors: Keay
authors: Catherine M
authors: CM
authors: Conway
authors: Neil
authors: N
authors: O'Flaherty
authors: Stephen M
authors: SM
authors: Hewitt
authors: Katherine
authors: K
authors: Shea
authors: Marios A
authors: MA
authors: Gavrielides
keywords: Quantitative immunohistochemistry; reproducibility; whole slide imaging
references: Histopathology. 2006 Feb;48(3):258-67
references: 16430472
references: J Histochem Cytochem. 2000 Feb;48(2):303-12
references: 10639497
references: Histochem Cell Biol. 2008 Sep;130(3):447-63
references: 18679705
references: Arch Pathol Lab Med. 2006 Jul;130(7):1026-30
references: 16831029
references: J Pathol Inform. 2011;2:36
references: 21886892
references: Mod Pathol. 2001 Nov;14(11):1079-86
references: 11706067
references: IEEE Trans Med Imaging. 2009 Jun;28(6):916-25
references: 19164073
references: Arch Pathol Lab Med. 2011 Jul;135(7):896-902
references: 21732780
references: Histopathology. 2012 Jul;61(1):1-9
references: 21477260
references: Eur J Surg Oncol. 2003 Feb;29(1):20-4
references: 12559071
references: Int J Biol Markers. 2004 Jan-Mar;19(1):1-13
references: 15077921
references: Hum Pathol. 2009 Aug;40(8):1057-69
references: 19552937
references: J Clin Oncol. 2007 Jan 1;25(1):118-45
references: 17159189
references: Appl Immunohistochem Mol Morphol. 2006 Jun;14(2):132-7
references: 16785779
references: Pathol Int. 2001 Jan;51(1):33-6
references: 11148461
references: BMC Med Imaging. 2008 Jun 05;8:11
references: 18534031
references: Int J Surg Pathol. 2006 Oct;14(4):285-305
references: 17041192
references: J Clin Pathol. 2008 Jan;61(1):68-71
references: 17412872
references: Am J Clin Pathol. 2004 May;121(5):620-30
references: 15151201
references: Leuk Lymphoma. 2005 May;46(5):693-701
references: 16019506
references: Cancer Res. 2004 Dec 1;64(23):8773-7
references: 15574790
references: Am J Surg Pathol. 2000 Jul;24(7):1016-9
references: 10895825
references: Cytometry A. 2007 May;71(5):273-85
references: 17323351
references: Am J Clin Pathol. 2001 Oct;116(4):495-503
references: 11601134
references: Arch Pathol Lab Med. 2012 May;136(5):539-50
references: 22540303
references: Arch Pathol Lab Med. 2010 May;134(5):728-34
references: 20441503
references: Breast Cancer Res Treat. 2002 Jul;74(2):113-20
references: 12186371
references: Arch Pathol Lab Med. 2001 Jul;125(7):872-9
references: 11419970
references: Am J Clin Pathol. 2001 Jun;115(6):814-22
references: 11392876
references: Arch Pathol Lab Med. 2011 Feb;135(2):233-42
references: 21284444