title: False precision of mass domain in HPLC-HRMS data representation.
abstract: The term precision of a value describes the total number of significant digits that are used to express that value. False precision is presented in data, where the sampling and chosen data file format coding return values with extra non-valid digits. The proper precision in value thus depends on so-called magnitude in digital data coding. The presence of the false precision is file format dependent. The amount of dataset points could be decreased by removing false precision (where it is present) to almost 10% of the raw measurement without loss of information.
authors.affiliation: University of South Bohemia in České Budějovice, Faculty of Fisheries and Protection of Waters, South Bohemian Research Center of Aquaculture and Biodiversity of Hydrocenoses, Institute of Complex Systems, Laboratory of Signal and Image processing, Zámek 136, Nové Hrady 37333, Czech Republic.
authors.forename: Jan
authors.initials: J
authors.lastname: Urban
mesh_terms: D002851:Chromatography, High Pressure Liquid / Q000592:standards*; D019295:Computational Biology; D016208:Databases, Factual; D013058:Mass Spectrometry / Q000592:standards*; D015203:Reproducibility of Results
keywords: Chromatography; Cumulative spectrum; File format; Mass spectrometry; Occurency; Precision