title: Performance adjusted risks: a method to improve the quality of algorithm performance while allowing all to play.
abstract: OBJECTIVE
  Differences in quality among ultrasound nuchal translucency providers or laboratories can profoundly affect Down syndrome screening results. A new method, performance adjusted risks (PAR), is developed to allow for such differences and improve performance.
  
  
  METHODS
  Individual provider and laboratory marker distribution parameters are compared with national expectations. The maximum absolute deviation over the operating range is used to derive a handicap and weighting factors. Down syndrome risks obtained from commercial software for individual women can be corrected using the weights. Those with the biggest handicap will have the greatest correction. Five theoretical examples are used to illustrate handicap calculation and prospective combined test results on 32 Down syndrome and 7205 unaffected pregnancies are used to indicate the influence of weighting on performance.
  
  
  RESULTS
  In the theoretical examples, a 10% systematic change (inaccuracy) in one or more markers or a similar change in the standard deviation (imprecision) yielded a handicap ranging from 4 to 11. Over the operating range, the individual risk reduced 40% or increased 250%. When the prospective combined test results were artificially adjusted to create 10% inaccurracy in all three markers, the detection rate was only 59% but after PAR weighting this increased to 75%.
  
  
  CONCLUSIONS
  PAR recognizes that not all providers are equal, and perfection is unrealistic. Using this approach all 'can play' while patients are protected from poor performance.
authors.affiliation: Comprehensive Genetics, Fetal Medicine Foundation of America, and Department of Obstetrics & Gynecology, Mt Sinai School of Medicine, New York, NY 10065, USA. Evans@compregen.com
authors.forename: Mark I
authors.initials: MI
authors.lastname: Evans
authors.forename: Howard S
authors.initials: HS
authors.lastname: Cuckle
mesh_terms: D000465:Algorithms; D015415:Biomarkers / Q000097:blood; D018997:Chorionic Gonadotropin, beta Subunit, Human / Q000097:blood; D004314:Down Syndrome / Q000175:diagnosis*; D005260:Female; D006801:Humans; D048208:Nuchal Translucency Measurement / Q000592:standards*; D011247:Pregnancy; D011266:Pregnancy-Associated Plasma Protein-A / Q000378:metabolism; D017064:Process Assessment, Health Care; D018570:Risk Assessment; D000509:alpha-Fetoproteins / Q000378:metabolism
chemical_list: D015415:Biomarkers; D018997:Chorionic Gonadotropin, beta Subunit, Human; D000509:alpha-Fetoproteins; D011266:Pregnancy-Associated Plasma Protein-A