title: The objective structured clinical examination revisited for postgraduate trainees in general practice.
abstract: OBJECTIVE
  To investigate if the psychometric qualities of an OSCE consisting of more complex simulated patient encounters remain valid and reliable in the assessment of postgraduate trainees in general practice.
  
  
  METHODS
  In this intervention study without control group, the traditional OSCE was formally replaced by the new, complex version. The study population was composed by all postgraduate trainees (second and third phase) in general practice during the ongoing academic year. Data were handled and collected as part of the formal assessment program. Univariate analyses, the variance of scores and multivariate analyses were performed to assess the test qualities.
  
  
  RESULTS
  A total of 340 students participated. Average final scores were slightly higher for third-phase students (t-test, p =0.05). Overall test scores were equally distributed on station level, circuit level and phase level. A multiple regression analysis revealed that test scores were dependent on the stations and circuits, but not on the master phase.
  
  
  CONCLUSIONS
  In a changing learning environment, assessment and evaluation strategies require reorientation. The reliability and validity of the OSCE remain subject to discussion. In particular, when it comes to content and design, the traditional OSCE might underestimate the performance level of postgraduate trainees in general practice. A reshaping of this OSCE to a more sophisticated design with more complex patient encounters appears to restore the validity of the test results.
authors.affiliation: Academic Centre of General Practice, Department of Public Health and Primary Care, University of Leuven, Belgium.
authors.forename: Birgitte
authors.initials: B
authors.lastname: Schoenmakers
authors.affiliation: Department of Public Health and Primary Care, Campus Drie Eiken, University of Antwerp, Belgium.
authors.forename: Johan
authors.initials: J
authors.lastname: Wens
mesh_terms: D004503:Education, Medical, Graduate / Q000379:methods*; D004521:Educational Measurement / Q000379:methods; D058006:General Practice / Q000193:education*; D006801:Humans; D016544:Patient Simulation; D010865:Pilot Projects; D011594:Psychometrics; D015203:Reproducibility of Results; D013337:Students, Medical
keywords: OSCE; assessment; general practice; postgraduate medical trainees