title: Assessing discrimination of risk prediction rules in a clustered data setting.
abstract: The AUC (area under ROC curve) is a commonly used metric to assess discrimination of risk prediction rules; however, standard errors of AUC are usually based on the Mann-Whitney U test that assumes independence of sampling units. For ophthalmologic applications, it is desirable to assess risk prediction rules based on eye-specific outcome variables which are generally highly, but not perfectly correlated in fellow eyes [e.g. progression of individual eyes to age-related macular degeneration (AMD)]. In this article, we use the extended Mann-Whitney U test (Rosner and Glynn, Biometrics 65:188-197, 2009) for the case where subunits within a cluster may have different progression status and assess discrimination of different prediction rules in this setting. Both data analyses based on progression of AMD and simulation studies show reasonable accuracy of this extended Mann-Whitney U test to assess discrimination of eye-specific risk prediction rules.
authors.affiliation: Channing Division of Network Medicine, Brigham and Women's Hospital/Harvard Medical School, 181 Longwood Avenue, Boston, MA 02115, USA. stbar@channing.harvard.edu
authors.forename: Bernard
authors.initials: B
authors.lastname: Rosner
authors.forename: Weiliang
authors.initials: W
authors.lastname: Qiu
authors.forename: Mei-Ling T
authors.initials: ML
authors.lastname: Lee
mesh_terms: D000367:Age Factors; D000368:Aged; D000369:Aged, 80 and over; D015982:Bias; D016000:Cluster Analysis; D018450:Disease Progression; D005260:Female; D006801:Humans; D008137:Longitudinal Studies / Q000706:statistics & numerical data; D008268:Macular Degeneration / Q000453:epidemiology; D008297:Male; D008875:Middle Aged; D009885:Ophthalmology; D012372:ROC Curve; D018570:Risk Assessment / Q000706:statistics & numerical data; D018709:Statistics, Nonparametric; D014481:United States / Q000453:epidemiology