title: Predictive measures of a resident's performance on written Orthopaedic Board scores.
abstract: OBJECTIVE
  Residency programs are continually attempting to predict the performance of both current and potential residents. Previous studies have supported the use of USMLE Steps 1 and 2 as predictors of Orthopaedic In-Training Examination (OITE) and eventual American Board of Orthopaedic Surgery success, while others show no significant correlation. A strong performance on OITE examinations does correlate with strong residency performance, and some believe OITE scores are good predictors of future written board success. The current study was designed to examine potential differences in resident assessment measures and their predictive value for written boards.
  
  
  METHODS
  A retrospective review of resident performance data was performed for the past 10 years. Personalized information was removed by the residency coordinator. USMLE Step 1, USMLE Step 2, Orthopaedic In-Training Examination (from first to fifth years of training), and written orthopaedic specialty board scores were collected. Subsequently, the residents were separated into two groups, those scoring above the 35(th) percentile on written boards and those scoring below. Data were analyzed using correlation and regression analyses to compare and contrast the scores across all tests.
  
  
  RESULTS
  A significant difference was seen between the groups in regard to USMLE scores for both Step 1 and 2. Also, a significant difference was found between OITE scores for both the second and fifth years. Positive correlations were found for USMLE Step 1, Step 2, OITE 2 and OITE 5 when compared to performance on written boards. One resident initially failed written boards, but passed on the second attempt This resident consistently scored in the 20(th) and 30(th) percentiles on the in-training examinations.
  
  
  CONCLUSIONS
  USMLE Step 1 and 2 scores along with OITE scores are helpful in gauging an orthopaedic resident's performance on written boards. Lower USMLE scores along with consistently low OITE scores likely identify residents at risk of failing their written boards. Close monitoring of the annual OITE scores is recommended and may be useful to identify struggling residents. Future work involving multiple institutions is warranted and would ensure applicability of our findings to other orthopedic residency programs.
authors.affiliation: Division of Orthopaedic Surgery and Rehabilitation, Southern Illinois University School of Medicine, Springfield, IL 62794-9679, USA.
authors.forename: Bradley W
authors.initials: BW
authors.lastname: Dyrstad
authors.forename: David
authors.initials: D
authors.lastname: Pope
authors.forename: Joseph C
authors.initials: JC
authors.lastname: Milbrandt
authors.forename: Ryan T
authors.initials: RT
authors.lastname: Beck
authors.forename: Anita L
authors.initials: AL
authors.lastname: Weinhoeft
authors.forename: Osaretin B
authors.initials: OB
authors.lastname: Idusuyi
mesh_terms: D002983:Clinical Competence / Q000592:standards*; D004521:Educational Measurement / Q000706:statistics & numerical data*; D006801:Humans; D007087:Illinois; D007396:Internship and Residency / Q000592:standards*; D008007:Licensure, Medical / Q000592:standards*; D009985:Orthopedics / Q000193:education* / Q000592:standards*; D012189:Retrospective Studies
references.citation: J Gen Intern Med. 1992 Jan-Feb;7(1):63-7
references.pmid: 1548550
references.citation: Clin Orthop Relat Res. 2006 Aug;449:50-5
references.pmid: 16735881
references.citation: J Bone Joint Surg Am. 2009 Nov;91(11):2750-5
references.pmid: 19884456
references.citation: Mil Med. 2007 Jun;172(6):640-3
references.pmid: 17615848
references.citation: Clin Orthop Relat Res. 1989 Apr;(241):257-64
references.pmid: 2924475
references.citation: Acad Med. 2009 Oct;84(10 Suppl):S21-4
references.pmid: 19907379
references.citation: Acad Med. 1993 Feb;68(2 Suppl):S51-6
references.pmid: 8431254
references.citation: J Med Educ. 1984 Apr;59(4):341-4
references.pmid: 6708072
references.citation: Bull Hosp Jt Dis. 2002-2003;61(1-2):49-57
references.pmid: 12828380
references.citation: Ambul Pediatr. 2007 Mar-Apr;7(2):192-5
references.pmid: 17368416
references.citation: Acad Med. 1990 Jul;65(7):454-7
references.pmid: 2242200
references.citation: Clin Orthop Relat Res. 2009 Sep;467(9):2436-45
references.pmid: 19557490
references.citation: Am J Surg. 1982 Sep;144(3):292-4
references.pmid: 7114363
references.citation: J Bone Joint Surg Am. 2002 Nov;84(11):2090-6
references.pmid: 12429773
references.citation: Clin Orthop Relat Res. 2010 Oct;468(10):2797-802
references.pmid: 20352386
references.citation: J Bone Joint Surg Am. 2006 Mar;88(3):671-6
references.pmid: 16510836
references.citation: Clin Orthop Relat Res. 2002 Jun;(399):265-71
references.pmid: 12011720
references.citation: South Med J. 2005 May;98(5):528-32
references.pmid: 15954509
references.citation: J Pediatr. 2008 Sep;153(3):425-8
references.pmid: 18534245
references.citation: Am J Surg. 2004 Aug;188(2):161-4
references.pmid: 15249242
references.citation: J Bone Joint Surg Am. 2004 May;86(5):1092-5
references.pmid: 15118058
references.citation: Clin Orthop Relat Res. 2007 Jun;459:255-9
references.pmid: 17415012
references.citation: Am J Surg. 2010 Feb;199(2):216-22
references.pmid: 19892313