title: Data Streaming for Metabolomics: Accelerating Data Processing and Analysis from Days to Minutes.
abstract: The speed and throughput of analytical platforms has been a driving force in recent years in the "omics" technologies and while great strides have been accomplished in both chromatography and mass spectrometry, data analysis times have not benefited at the same pace. Even though personal computers have become more powerful, data transfer times still represent a bottleneck in data processing because of the increasingly complex data files and studies with a greater number of samples. To meet the demand of analyzing hundreds to thousands of samples within a given experiment, we have developed a data streaming platform, XCMS Stream, which capitalizes on the acquisition time to compress and stream recently acquired data files to data processing servers, mimicking just-in-time production strategies from the manufacturing industry. The utility of this XCMS Online-based technology is demonstrated here in the analysis of T cell metabolism and other large-scale metabolomic studies. A large scale example on a 1000 sample data set demonstrated a 10 000-fold time savings, reducing data analysis time from days to minutes. Further, XCMS Stream has the capability to increase the efficiency of downstream biochemical dependent data acquisition (BDDA) analysis by initiating data conversion and data processing on subsets of data acquired, expanding its application beyond data transfer to smart preliminary data decision-making prior to full acquisition.
authors.affiliation: Scripps Center for Metabolomics, The Scripps Research Institute , 10550 North Torrey Pines Road, La Jolla, California 92037, United States.
authors.forename: J Rafael
authors.identifier: 0000-0001-7787-3414
authors.initials: JR
authors.lastname: Montenegro-Burke
authors.affiliation: Scripps Center for Metabolomics, The Scripps Research Institute , 10550 North Torrey Pines Road, La Jolla, California 92037, United States.
authors.forename: Aries E
authors.initials: AE
authors.lastname: Aisporna
authors.affiliation: Scripps Center for Metabolomics, The Scripps Research Institute , 10550 North Torrey Pines Road, La Jolla, California 92037, United States.
authors.forename: H Paul
authors.initials: HP
authors.lastname: Benton
authors.affiliation: Scripps Center for Metabolomics, The Scripps Research Institute , 10550 North Torrey Pines Road, La Jolla, California 92037, United States.
authors.forename: Duane
authors.initials: D
authors.lastname: Rinehart
authors.affiliation: Scripps Center for Metabolomics, The Scripps Research Institute , 10550 North Torrey Pines Road, La Jolla, California 92037, United States.
authors.forename: Mingliang
authors.initials: M
authors.lastname: Fang
authors.affiliation: Scripps Center for Metabolomics, The Scripps Research Institute , 10550 North Torrey Pines Road, La Jolla, California 92037, United States.
authors.forename: Tao
authors.initials: T
authors.lastname: Huan
authors.affiliation: Scripps Center for Metabolomics, The Scripps Research Institute , 10550 North Torrey Pines Road, La Jolla, California 92037, United States.
authors.forename: Benedikt
authors.identifier: 0000-0002-6104-0706
authors.initials: B
authors.lastname: Warth
authors.affiliation: Scripps Center for Metabolomics, The Scripps Research Institute , 10550 North Torrey Pines Road, La Jolla, California 92037, United States.
authors.forename: Erica
authors.identifier: 0000-0001-5190-1501
authors.initials: E
authors.lastname: Forsberg
authors.affiliation: Department of Immunology and Microbial Science, The Scripps Research Institute , 10550 North Torrey Pines Road, La Jolla, California 92037, United States.
authors.forename: Brian T
authors.initials: BT
authors.lastname: Abe
authors.affiliation: Metabolomics Research Platform, Faculty of Biology and Medicine, University of Lausanne , Rue du Bugnon 19, 1005 Lausanne, Switzerland.
authors.forename: Julijana
authors.initials: J
authors.lastname: Ivanisevic
authors.affiliation: Departments of Molecular and Experimental Medicine, The Scripps Research Institute , 10550 North Torrey Pines Road, La Jolla, California 92037, United States.
authors.forename: Dennis W
authors.initials: DW
authors.lastname: Wolan
authors.affiliation: Department of Immunology and Microbial Science, The Scripps Research Institute , 10550 North Torrey Pines Road, La Jolla, California 92037, United States.
authors.forename: Luc
authors.initials: L
authors.lastname: Teyton
authors.affiliation: Department of Chemistry, The Scripps Research Institute , 10550 North Torrey Pines Road, La Jolla, California 92037, United States.
authors.forename: Luke
authors.initials: L
authors.lastname: Lairson
authors.affiliation: Scripps Center for Metabolomics, The Scripps Research Institute , 10550 North Torrey Pines Road, La Jolla, California 92037, United States.|Departments of Chemistry, Molecular, and Computational Biology, The Scripps Research Institute , 10550 North Torrey Pines Road, La Jolla, California 92037, United States.
authors.forename: Gary
authors.initials: G
authors.lastname: Siuzdak
mesh_terms: D044962:Data Compression / Q000191:economics / Q000379:methods*; D057225:Data Mining / Q000191:economics / Q000379:methods*; D006801:Humans; D055432:Metabolomics / Q000191:economics / Q000379:methods*; D012984:Software; D013601:T-Lymphocytes / Q000378:metabolism*; D013997:Time Factors; D057188:Workflow