title: Effect of lossy compression of quality scores on variant calling.
abstract: Recent advancements in sequencing technology have led to a drastic reduction in genome sequencing costs. This development has generated an unprecedented amount of data that must be stored, processed, and communicated. To facilitate this effort, compression of genomic files has been proposed. Specifically, lossy compression of quality scores is emerging as a natural candidate for reducing the growing costs of storage. A main goal of performing DNA sequencing in population studies and clinical settings is to identify genetic variation. Though the field agrees that smaller files are advantageous, the cost of lossy compression, in terms of variant discovery, is unclear.Bioinformatic algorithms to identify SNPs and INDELs use base quality score information; here, we evaluate the effect of lossy compression of quality scores on SNP and INDEL detection. Specifically, we investigate how the output of the variant caller when using the original data differs from that obtained when quality scores are replaced by those generated by a lossy compressor. Using gold standard genomic datasets and simulated data, we are able to analyze how accurate the output of the variant calling is, both for the original data and that previously lossily compressed. We show that lossy compression can significantly alleviate the storage while maintaining variant calling performance comparable to that with the original data. Further, in some cases lossy compression can lead to variant calling performance that is superior to that using the original file. We envisage our findings and framework serving as a benchmark in future development and analyses of lossy genomic data compressors.
authors.affiliation: Electrical Engineering department, 350 Serra Mall, Stanford, CA, USA.
authors.forename: Idoia
authors.initials: I
authors.lastname: Ochoa
authors.affiliation: Department of Electrical Engineering, Stanford University, Stanford, CA, USA.
authors.forename: Mikel
authors.initials: M
authors.lastname: Hernaez
authors.affiliation: Department of Electrical Engineering, Stanford University, Stanford, CA, USA.
authors.forename: Rachel
authors.initials: R
authors.lastname: Goldfeder
authors.affiliation: Department of Electrical Engineering, Stanford University, Stanford, CA, USA.
authors.forename: Tsachy
authors.initials: T
authors.lastname: Weissman
authors.affiliation: Department of Medicine, Stanford University, Stanford, CA, USA.|Stanford Center for Inherited Cardiovascular Disease, Stanford University, Stanford, CA, USA.|Department of Genetics, Stanford University, Stanford, CA, USA.
authors.forename: Euan
authors.initials: E
authors.lastname: Ashley
mesh_terms: D000465:Algorithms; D044962:Data Compression; D030541:Databases, Genetic; D016678:Genome; D023281:Genomics; D006801:Humans; D017422:Sequence Analysis, DNA
keywords: Genomic data; lossy compression; quality scores; variant calling