title: Performance evaluations of continuous glucose monitoring systems: precision absolute relative deviation is part of the assessment.
abstract: BACKGROUND
  Even though a Clinical and Laboratory Standards Institute proposal exists on the design of studies and performance criteria for continuous glucose monitoring (CGM) systems, it has not yet led to a consistent evaluation of different systems, as no consensus has been reached on the reference method to evaluate them or on acceptance levels. As a consequence, performance assessment of CGM systems tends to be inconclusive, and a comparison of the outcome of different studies is difficult.
  
  
  METHODS
  Published information and available data (as presented in this issue of Journal of Diabetes Science and Technology by Freckmann and coauthors) are used to assess the suitability of several frequently used methods [International Organization for Standardization, continuous glucose error grid analysis, mean absolute relative deviation (MARD), precision absolute relative deviation (PARD)] when assessing performance of CGM systems in terms of accuracy and precision.
  
  
  RESULTS
  The combined use of MARD and PARD seems to allow for better characterization of sensor performance. The use of different quantities for calibration and evaluation, e.g., capillary blood using a blood glucose (BG) meter versus venous blood using a laboratory measurement, introduces an additional error source. Using BG values measured in more or less large intervals as the only reference leads to a significant loss of information in comparison with the continuous sensor signal and possibly to an erroneous estimation of sensor performance during swings. Both can be improved using data from two identical CGM sensors worn by the same patient in parallel.
  
  
  CONCLUSIONS
  Evaluation of CGM performance studies should follow an identical study design, including sufficient swings in glycemia. At least a part of the study participants should wear two identical CGM sensors in parallel. All data available should be used for evaluation, both by MARD and PARD, a good PARD value being a precondition to trust a good MARD value. Results should be analyzed and presented separately for clinically different categories, e.g., hypoglycemia, exercise, or night and day.
authors.affiliation: Roche Diagnostics GmbH, Mannheim, Germany. karin.obermaier@roche.com
authors.forename: Karin
authors.initials: K
authors.lastname: Obermaier
authors.forename: Günther
authors.initials: G
authors.lastname: Schmelzeisen-Redeker
authors.forename: Michael
authors.initials: M
authors.lastname: Schoemaker
authors.forename: Hans-Martin
authors.initials: HM
authors.lastname: Klötzer
authors.forename: Harald
authors.initials: H
authors.lastname: Kirchsteiger
authors.forename: Heino
authors.initials: H
authors.lastname: Eikmeier
authors.forename: Luigi
authors.initials: L
authors.lastname: del Re
mesh_terms: D015374:Biosensing Techniques / Q000295:instrumentation* / Q000592:standards / Q000706:statistics & numerical data; D001786:Blood Glucose / Q000032:analysis*; D015190:Blood Glucose Self-Monitoring / Q000295:instrumentation / Q000592:standards / Q000706:statistics & numerical data; D002138:Calibration; D003627:Data Interpretation, Statistical; D003920:Diabetes Mellitus / Q000097:blood*; D005069:Evaluation Studies as Topic; D006801:Humans; D015203:Reproducibility of Results; D012680:Sensitivity and Specificity; D013997:Time Factors
chemical_list: D001786:Blood Glucose
references.citation: Diabetes Care. 1987 Sep-Oct;10(5):622-8
references.pmid: 3677983
references.citation: Diabetes Care. 2000 Aug;23(8):1143-8
references.pmid: 10937512
references.citation: Diabetes Care. 2004 Aug;27(8):1922-8
references.pmid: 15277418
references.citation: J Diabetes Sci Technol. 2009 Sep 01;3(5):1146-54
references.pmid: 20144429
references.citation: J Diabetes Sci Technol. 2011 Jan 01;5(1):129-35
references.pmid: 21303635
references.citation: J Diabetes Sci Technol. 2013 Jul 01;7(4):842-53
references.pmid: 23911165
references.citation: J Diabetes Sci Technol. 2012 Jan 01;6(1):1-4
references.pmid: 22401316
references.citation: Diabetes Technol Ther. 2005 Oct;7(5):665-72; discussion 673-4
references.pmid: 16241865
references.citation: J Diabetes Sci Technol. 2010 Jan 01;4(1):221-5
references.pmid: 20167187
references.citation: Diabetes Technol Ther. 2008 Apr;10(2):57-68
references.pmid: 18260769
references.citation: Diabetes Technol Ther. 2009 Dec;11(12):749-55
references.pmid: 20001675
references.citation: Diabet Med. 2009 Jul;26(7):714-21
references.pmid: 19573121