title: A fully scalable online pre-processing algorithm for short oligonucleotide microarray atlases.
abstract: Rapid accumulation of large and standardized microarray data collections is opening up novel opportunities for holistic characterization of genome function. The limited scalability of current preprocessing techniques has, however, formed a bottleneck for full utilization of these data resources. Although short oligonucleotide arrays constitute a major source of genome-wide profiling data, scalable probe-level techniques have been available only for few platforms based on pre-calculated probe effects from restricted reference training sets. To overcome these key limitations, we introduce a fully scalable online-learning algorithm for probe-level analysis and pre-processing of large microarray atlases involving tens of thousands of arrays. In contrast to the alternatives, our algorithm scales up linearly with respect to sample size and is applicable to all short oligonucleotide platforms. The model can use the most comprehensive data collections available to date to pinpoint individual probes affected by noise and biases, providing tools to guide array design and quality control. This is the only available algorithm that can learn probe-level parameters based on sequential hyperparameter updates at small consecutive batches of data, thus circumventing the extensive memory requirements of the standard approaches and opening up novel opportunities to take full advantage of contemporary microarray collections.
authors.affiliation: Department of Veterinary Bioscience, University of Helsinki, Agnes Sjöbergin katu 2, PO Box 66, FI-00014 University of Helsinki, Finland. leo.lahti@iki.fi
authors.forename: Leo
authors.initials: L
authors.lastname: Lahti
authors.forename: Aurora
authors.initials: A
authors.lastname: Torrente
authors.forename: Laura L
authors.initials: LL
authors.lastname: Elo
authors.forename: Alvis
authors.initials: A
authors.lastname: Brazma
authors.forename: Johan
authors.initials: J
authors.lastname: Rung
mesh_terms: D000465:Algorithms; D001499:Bayes Theorem; D020869:Gene Expression Profiling; D006801:Humans; D020411:Oligonucleotide Array Sequence Analysis
references.citation: Nat Rev Genet. 2013 Feb;14(2):89-99
references.pmid: 23269463
references.citation: Bioinformatics. 2012 Mar 15;28(6):882-3
references.pmid: 22257669
references.citation: IEEE/ACM Trans Comput Biol Bioinform. 2011 Jan-Mar;8(1):217-25
references.pmid: 21071809
references.citation: Genome Biol. 2010;11(12):R124
references.pmid: 21182765
references.citation: J Clin Gastroenterol. 2010 Sep;44 Suppl 1:S2-5
references.pmid: 20616744
references.citation: Nucleic Acids Res. 2005 Jan 1;33(Database issue):D562-6
references.pmid: 15608262
references.citation: Biostatistics. 2003 Apr;4(2):249-64
references.pmid: 12925520
references.citation: Proc Natl Acad Sci U S A. 2004 Apr 20;101(16):6062-7
references.pmid: 15075390
references.citation: PLoS One. 2011 Feb 28;6(2):e17238
references.pmid: 21386892
references.citation: BMC Bioinformatics. 2011 Dec 07;12:467
references.pmid: 22151536
references.citation: Bioinformatics. 2006 Apr 15;22(8):943-9
references.pmid: 16473874
references.citation: Nat Biotechnol. 1996 Dec;14(13):1675-80
references.pmid: 9634850
references.citation: Bioinformatics. 2003 Jan 22;19(2):185-93
references.pmid: 12538238
references.citation: Biostatistics. 2010 Apr;11(2):242-53
references.pmid: 20097884
references.citation: Nucleic Acids Res. 2011 Jan;39(Database issue):D1002-4
references.pmid: 21071405
references.citation: Clin Microbiol Infect. 2012 Jul;18 Suppl 4:16-20
references.pmid: 22647042
references.citation: Nucleic Acids Res. 2005 Nov 10;33(20):e175
references.pmid: 16284200
references.citation: Bioinformatics. 2012 Feb 15;28(4):538-45
references.pmid: 22219206
references.citation: Nucleic Acids Res. 2003 Feb 15;31(4):e15
references.pmid: 12582260
references.citation: Proc Natl Acad Sci U S A. 2012 Apr 10;109(15):5594-9
references.pmid: 22447773
references.citation: PLoS One. 2006 Dec 20;1:e88
references.pmid: 17183719
references.citation: Proc Natl Acad Sci U S A. 2007 Jan 2;104(1):299-304
references.pmid: 17182744
references.citation: BMC Bioinformatics. 2006 Oct 23;7:464
references.pmid: 17059591
references.citation: Nucleic Acids Res. 2005 Dec 14;33(22):e193
references.pmid: 16356924
references.citation: Bioinformatics. 2012 Dec 1;28(23):3153-4
references.pmid: 23044545
references.citation: Bioinformatics. 2004 Feb 12;20(3):323-31
references.pmid: 14960458
references.citation: Bioinform Biol Insights. 2009 Jul 22;3:83-7
references.pmid: 20140068
references.citation: Environ Microbiol. 2009 Jul;11(7):1736-51
references.pmid: 19508560
references.citation: Nat Biotechnol. 2010 Apr;28(4):322-4
references.pmid: 20379172
references.citation: BMC Bioinformatics. 2011 Sep 16;12:369
references.pmid: 21923903
references.citation: Genome Biol. 2008;9(9):R139
references.pmid: 18803840
references.citation: Proc Natl Acad Sci U S A. 2001 Jan 2;98(1):31-6
references.pmid: 11134512