A web-based tool for the assessment of discrimination and calibration properties of prognostic models.
Prognostic models are developed to assist clinicians in making decisions regarding treatment and follow-up management. The accuracy of these models is often assessed either in terms of their discrimination performance or calibration but rarely both. In this paper, we describe the development of an online tool for discrimination using Harrell C index and calibration using a Hosmer-Lemeshow type analysis (http://clinengnhs.liv.ac.uk/AADP/AADP_Welcome.htm). We show examples of using the tool on real data. We highlight situations where the model performed well in terms of either discrimination or calibration but not both depending on the sample size of the test set. We conclude that prognostic models should be assessed both in terms of discrimination and calibration and that calibration analysis should be carried out numerically and graphically.
Department of Clinical Engineering, Royal Liverpool University Hospital, 1st Floor, Duncan Building, Daulby Street, Liverpool L7 8XP, UK. afgt@liv.ac.uk
Azzam F G
AF
Taktak
Antonio
A
Eleuteri
Stephen P
SP
Lake
Anthony C
AC
Fisher
D002138:Calibration; D020407:Internet; D008962:Models, Theoretical; D011379:Prognosis; D016019:Survival Analysis