title: The Australian Medical Schools Assessment Collaboration: benchmarking the preclinical performance of medical students.
abstract: OBJECTIVE
  To report the level of participation of medical schools in the Australian Medical Schools Assessment Collaboration (AMSAC); and to measure differences in student performance related to medical school characteristics and implementation methods.
  
  
  METHODS
  Retrospective analysis of data using the Rasch statistical model to correct for missing data and variability in item difficulty. Linear model analysis of variance was used to assess differences in student performance.
  
  
  METHODS
  6401 preclinical students from 13 medical schools that participated in AMSAC from 2011 to 2013.
  
  
  METHODS
  Rasch estimates of preclinical basic and clinical science knowledge.
  
  
  RESULTS
  Representation of Australian medical schools and students in AMSAC more than doubled between 2009 and 2013. In 2013 it included 12 of 19 medical schools and 68% of medical students. Graduate-entry students scored higher than students entering straight from school. Students at large schools scored higher than students at small schools. Although the significance level was high (P < 0.001), the main effect sizes were small (4.5% and 2.3%, respectively). The time allowed per multiple choice question was not significantly associated with student performance. The effect on performance of multiple assessments compared with the test items as part of a single end-of-year examination was negligible. The variables investigated explain only 12% of the total variation in student performance.
  
  
  CONCLUSIONS
  An increasing number of medical schools are participating in AMSAC to monitor student performance in preclinical sciences against an external benchmark. Medical school characteristics account for only a small part of overall variation in student performance. Student performance was not affected by the different methods of administering test items.
authors: Sydney Medical School, Sydney, NSW, Australia. deborah.omara@sydney.edu.au.
authors: Deborah A
authors: DA
authors: O'Mara
authors: Monash University, Melbourne, VIC, Australia.
authors: Ben J
authors: BJ
authors: Canny
authors: Sydney Medical School, Sydney, NSW, Australia.
authors: Imogene P
authors: IP
authors: Rothnie
authors: University of Wollongong, Wollongong, NSW, Australia.
authors: Ian G
authors: IG
authors: Wilson
authors: EPEC (Excel Psychological and Educational Consultancy), Melbourne, VIC, Australia.
authors: John
authors: J
authors: Barnard
authors: Sydney Medical School, Sydney, NSW, Australia.
authors: Llewelyn
authors: L
authors: Davies
mesh_terms: D001315:Australia; D019985:Benchmarking / Q000592:standards; D002983:Clinical Competence / Q000592:standards*; D003299:Cooperative Behavior; D006801:Humans; D012577:Schools, Medical / Q000458:organization & administration / Q000592:standards*; D013337:Students, Medical