title: Predictive validity of the Biomedical Admissions Test: an evaluation and case study.
abstract: There has been an increase in the use of pre-admission selection tests for medicine. Such tests need to show good psychometric properties. Here, we use a paper by Emery and Bell [2009. The predictive validity of the Biomedical Admissions Test for pre-clinical examination performance. Med Educ 43:557-564] as a case study to evaluate and comment on the reporting of psychometric data in the field of medical student selection (and the comments apply to many papers in the field). We highlight pitfalls when reliability data are not presented, how simple zero-order associations can lead to inaccurate conclusions about the predictive validity of a test, and how biases need to be explored and reported. We show with BMAT that it is the knowledge part of the test which does all the predictive work. We show that without evidence of incremental validity it is difficult to assess the value of any selection tests for medicine.
authors.affiliation: Division of Psychology and Language Sciences, Research Department of Clinical, Educational and Health Psychology, University College London, UK. i.mcmanus@ucl.ac.uk
authors.forename: I C
authors.initials: IC
authors.lastname: McManus
authors.forename: Eamonn
authors.initials: E
authors.lastname: Ferguson
authors.forename: Richard
authors.initials: R
authors.lastname: Wakeford
authors.forename: David
authors.initials: D
authors.lastname: Powis
authors.forename: David
authors.initials: D
authors.lastname: James
mesh_terms: D015510:Clinical Medicine / Q000193:education*; D003099:College Admission Test; D005260:Female; D005544:Forecasting; D006801:Humans; D008297:Male; D011594:Psychometrics; D015203:Reproducibility of Results; D012577:Schools, Medical