title: Critical assessment of automated flow cytometry data analysis techniques.
abstract: Traditional methods for flow cytometry (FCM) data processing rely on subjective manual gating. Recently, several groups have developed computational methods for identifying cell populations in multidimensional FCM data. The Flow Cytometry: Critical Assessment of Population Identification Methods (FlowCAP) challenges were established to compare the performance of these methods on two tasks: (i) mammalian cell population identification, to determine whether automated algorithms can reproduce expert manual gating and (ii) sample classification, to determine whether analysis pipelines can identify characteristics that correlate with external variables (such as clinical outcome). This analysis presents the results of the first FlowCAP challenges. Several methods performed well as compared to manual gating or external variables using statistical performance measures, which suggests that automated methods have reached a sufficient level of maturity and accuracy for reliable use in FCM data analysis.
authors: Terry Fox Laboratory, British Columbia Cancer Agency, Vancouver, British Columbia, Canada.
authors: Nima
authors: N
authors: Aghaeepour
authors: Greg
authors: G
authors: Finak
authors: Holger
authors: H
authors: Hoos
authors: Tim R
authors: TR
authors: Mosmann
authors: Ryan
authors: R
authors: Brinkman
authors: Raphael
authors: R
authors: Gottardo
authors: Richard H
authors: RH
authors: Scheuermann
mesh_terms: D000465:Algorithms; D000818:Animals; D016000:Cluster Analysis; D019295:Computational Biology; D003627:Data Interpretation, Statistical; D005434:Flow Cytometry / Q000379:methods* / Q000592:standards / Q000706:statistics & numerical data; D006086:Graft vs Host Disease / Q000097:blood / Q000473:pathology; D006801:Humans; D007091:Image Processing, Computer-Assisted; D007963:Leukocytes, Mononuclear / Q000473:pathology / Q000821:virology; D016403:Lymphoma, Large B-Cell, Diffuse / Q000097:blood / Q000473:pathology; D015203:Reproducibility of Results; D012680:Sensitivity and Specificity; D012984:Software; D014901:West Nile Fever / Q000097:blood / Q000473:pathology / Q000821:virology
references: Bioinformatics. 2012 Apr 1;28(7):1009-16
references: 22383736
references: Cytometry A. 2008 Oct;73(10):926-30
references: 18752282
references: Bioinformatics. 2012 Aug 1;28(15):2052-8
references: 22595209
references: J Immunol Methods. 2000 Sep 21;243(1-2):77-97
references: 10986408
references: BMC Bioinformatics. 2010 Jan 22;11:44
references: 20096119
references: Ann N Y Acad Sci. 2009 Mar;1158:159-95
references: 19348640
references: J Comput Biol. 2012 Feb;19(2):101
references: 22300312
references: Proc Natl Acad Sci U S A. 2009 May 26;106(21):8519-24
references: 19443687
references: Arch Pathol Lab Med. 2011 Jan;135(1):44-54
references: 21204710
references: Cytometry A. 2008 Aug;73(8):693-701
references: 18496851
references: BMC Bioinformatics. 2010 Oct 09;11:502
references: 20932336
references: PLoS One. 2010 Feb 23;5(2):e9202
references: 20186320
references: BMC Bioinformatics. 2009 Apr 09;10:106
references: 19358741
references: BMC Bioinformatics. 2012 Mar 13;13 Suppl 2:S10
references: 22536861
references: Cytometry A. 2011 Feb;79(2):167-74
references: 21265010
references: Cancer Genet Cytogenet. 1999 Jun;111(2):175-7
references: 10347560
references: Cytometry A. 2007 Aug;71(8):612-24
references: 17542025
references: Am J Clin Pathol. 2012 Jan;137(1):75-85
references: 22180480
references: Cytometry A. 2012 Dec;81(12):1022-30
references: 23044634
references: Leukemia. 2010 Nov;24(11):1927-33
references: 20844562
references: Cytometry A. 2011 Jan;79(1):6-13
references: 21182178
references: BMC Immunol. 2005 Jun 24;6:13
references: 15978127
references: Nat Biotechnol. 2011 Sep 08;29(9):811-5
references: 21904331
references: Adv Bioinformatics. 2009;:247646
references: 20049161
references: Biol Blood Marrow Transplant. 2007 Jun;13(6):691-700
references: 17531779
references: Nat Biotechnol. 2011 Oct 02;29(10):886-91
references: 21964415
references: J Comput Graph Stat. 2010 Jun 1;19(2):419-438
references: 20877443
references: Science. 2011 May 6;332(6030):687-96
references: 21551058
references: BMC Bioinformatics. 2010 Jul 28;11:403
references: 20667133
references: Cytometry B Clin Cytom. 2010;78 Suppl 1:S69-82
references: 20839340
references: Nat Rev Immunol. 2012 Feb 17;12(3):191-200
references: 22343568
references: Cytometry A. 2008 Apr;73(4):321-32
references: 18307272
references: Trends Immunol. 2012 Jul;33(7):323-32
references: 22476049
references: Immunity. 2012 Jan 27;36(1):142-52
references: 22265676
references: Leuk Res. 1983;7(4):509-22
references: 6578392
references: Cytometry A. 2010 Jul;77(7):705-13
references: 20583274