title: Assessing the consequences of denoising marker-based metagenomic data.
abstract: Early marker-based metagenomic studies were performed without properly accounting for the effects of noise (sequencing errors, PCR single-base errors, and PCR chimeras). Denoising algorithms have been developed, but they were validated using data derived from mock communities, in which the true sequences were known. Since the algorithms were designed to be used in real community studies, it is important to evaluate the results in such cases. With this goal in mind, we processed a real 16S rRNA metagenomic dataset through five denoising pipelines. By reconstituting the sequence reads at each stage of the pipelines, we determined how the reads were being altered. In one denoising pipeline, AmpliconNoise, we found that the algorithm that was designed to remove pyrosequencing errors changed the reads in a manner inconsistent with the known spectrum of these errors, until one of the parameters was increased substantially from its default value. Additionally, because the longest read was picked as the representative for each cluster, sequences were added to the 3' ends of shorter reads that were often dissimilar from what had been removed by the truncations of the previous filtering step. In QIIME, the denoising algorithm caused a much larger number of changes to the reads unless the parameters were changed from their defaults. The denoising pipeline in mothur avoided some of these negative side-effects because of its strict default filtering criteria, but these criteria also greatly limited the sequence information produced at the end of the pipeline. We recommend that those using these denoising pipelines be cognizant of these issues and examine how their reads are being transformed by the denoising process as a component of their analysis.
authors.affiliation: Department of Molecular, Cellular, & Biomedical Sciences, University of New Hampshire, Durham, New Hampshire, United States of America. jsh58@unh.edu
authors.forename: John M
authors.initials: JM
authors.lastname: Gaspar
authors.forename: W Kelley
authors.initials: WK
authors.lastname: Thomas
mesh_terms: D000465:Algorithms; D019295:Computational Biology / Q000379:methods; D006801:Humans; D056186:Metagenomics / Q000379:methods* / Q000592:standards; D012336:RNA, Ribosomal, 16S / Q000737:chemistry / Q000235:genetics; D012984:Software
chemical_list: D012336:RNA, Ribosomal, 16S
references.citation: Bioinformatics. 2007 Nov 1;23(21):2947-8
references.pmid: 17846036
references.citation: Genetics. 1992 Jul;131(3):609-24
references.pmid: 1321065
references.citation: Appl Environ Microbiol. 2009 Dec;75(23):7537-41
references.pmid: 19801464
references.citation: Nat Methods. 2010 Sep;7(9):668-9
references.pmid: 20805793
references.citation: Environ Microbiol. 2010 Jul;12(7):1889-98
references.pmid: 20236171
references.citation: Genome Res. 2011 Mar;21(3):494-504
references.pmid: 21212162
references.citation: Appl Environ Microbiol. 2007 Aug;73(16):5261-7
references.pmid: 17586664
references.citation: Proc Natl Acad Sci U S A. 2006 Aug 8;103(32):12115-20
references.pmid: 16880384
references.citation: Science. 1980 Jul 25;209(4455):457-63
references.pmid: 6771870
references.citation: Bioinformatics. 2010 Jan 15;26(2):266-7
references.pmid: 19914921
references.citation: Bioinformatics. 2011 Aug 15;27(16):2194-200
references.pmid: 21700674
references.citation: Bioinformatics. 2011 Jul 1;27(13):i304-9
references.pmid: 21685085
references.citation: Nucleic Acids Res. 2007;35(15):e97
references.pmid: 17670798
references.citation: Environ Microbiol. 2010 Jan;12(1):118-23
references.pmid: 19725865
references.citation: Nat Methods. 2012 Apr 27;9(5):425-6
references.pmid: 22543370
references.citation: BMC Genomics. 2011 May 19;12:245
references.pmid: 21592414
references.citation: BMC Bioinformatics. 2011 Jan 28;12:38
references.pmid: 21276213
references.citation: Nucleic Acids Res. 2009 Jun;37(10):e76
references.pmid: 19417062
references.citation: Genome Biol. 2007;8(7):R143
references.pmid: 17659080
references.citation: Nature. 2005 Sep 15;437(7057):376-80
references.pmid: 16056220
references.citation: PLoS One. 2011;6(12):e27310
references.pmid: 22194782
references.citation: Nucleic Acids Res. 2009 Jan;37(Database issue):D141-5
references.pmid: 19004872
references.citation: J Microbiol Methods. 2001 Apr;44(3):253-62
references.pmid: 11240048
references.citation: Nat Methods. 2009 Sep;6(9):639-41
references.pmid: 19668203
references.citation: Nat Methods. 2010 May;7(5):335-6
references.pmid: 20383131
references.citation: Science. 2005 Jun 10;308(5728):1635-8
references.pmid: 15831718
references.citation: Nucleic Acids Res. 2004 Mar 19;32(5):1792-7
references.pmid: 15034147