title: Concurrent validity of the Osteopathic General Surgery In-Service Examination.
abstract: BACKGROUND
  Performance on the Osteopathic General Surgery In-Service Examination (ISE) has been shown to improve over time for osteopathic general surgery residents. The training level-specific concurrent validity of the ISE, however, has not been evaluated.
  
  
  OBJECTIVE
  To investigate whether residents' scores will improve as they move from level 1 through level 5 of the ISE.
  
  
  METHODS
  In this retrospective study, performance on the ISE was obtained from the American College of Osteopathic Surgeons for all of the osteopathic general surgery residency programs from 2008 through 2012. The weighted raw score and standardized score performance mean and standard deviation were determined across training levels. One-way t tests were performed between residency years and ISE scores. Parametric statistics were calculated with α set to .05.
  
  
  RESULTS
  The authors evaluated 1952 examinations during the study period. Of the 49 programs screened, 33 (67.3%) met inclusion criteria for the present study. Analysis of variance tests showed that there was significant variation in raw and standardized outcomes between residency levels (both P<.001). One-tailed t tests for both raw and standardized outcomes showed that all scores' differences between examinee levels were statistically significant (P<.001), with the exception of raw scores between level 4 and level 5 examinees (P=.20).
  
  
  CONCLUSIONS
  There is near-uniform concurrent validity of the ISE by osteopathic general surgery training level. This psychometric characteristic supports the construct validity of this standardized test.
authors.affiliation: Owensboro Health Surgical Specialists, Ridgecrest Medical Park, 2801 New Hartford Rd, Owensboro, KY 42303-1320. John.FalconeMD@owensborohealth.org.
authors.forename: John L
authors.initials: JL
authors.lastname: Falcone
authors.forename: Marc E
authors.initials: ME
authors.lastname: Rosen
mesh_terms: D002983:Clinical Competence; D004521:Educational Measurement / Q000379:methods*; D005260:Female; D013502:General Surgery / Q000193:education*; D006801:Humans; D007396:Internship and Residency; D008297:Male; D010021:Osteopathic Medicine / Q000193:education*; D055360:Osteopathic Physicians / Q000193:education* / Q000592:standards*; D012189:Retrospective Studies