title: Reliability and validity of long case and short case in internal medicine board certification examination.
abstract: OBJECTIVE
  To be certified for the Thai Board of Internal Medicine, each candidate must pass both written and clinical examinations performed in different academic years. The present study aimed to assess the reliability and validity of the long case and short case which contribute major fractions in the clinical part of board certifying examination.
  
  
  METHODS
  Data from 585 internal medicine residents entering a first-attempt clinical part in board certifying examination during the academic year 2005-2007 were collected. Inter-rater reliability and construct validity of the long case and short case were then examined.
  
  
  RESULTS
  Good to excellent intraclass correlation (ICC) of scores from different examiners was demonstrated (ICC between 0.71 and 0.97) and the variation ranged from 15.3 to 27.3%. For different occasions of examination, class normalized gain was between -0.7 and -9.0% and negative individual normalized gain was observed in 45.6% to 48.2% of the candidates.
  
  
  CONCLUSIONS
  Acceptable inter-rater reliability was demonstrated in long case and short case in clinical examination for the Thai Board of Internal Medicine. But construct validity for this type of clinical assessment was not established.
authors.affiliation: Subcommittee for Training and Examination, The Royal College of Physicians of Thailand. siade@mahidol.ac.th
authors.forename: Nitipatana
authors.initials: N
authors.lastname: Chierakul
authors.forename: Somwang
authors.initials: S
authors.lastname: Danchaivijitr
authors.forename: Paka
authors.initials: P
authors.lastname: Kontee
authors.forename: Chana
authors.initials: C
authors.lastname: Naruman
mesh_terms: D000328:Adult; D002568:Certification / Q000458:organization & administration*; D002983:Clinical Competence; D006801:Humans; D007388:Internal Medicine / Q000193:education*; D008875:Middle Aged; D015588:Observer Variation; D015203:Reproducibility of Results; D013785:Thailand; D013997:Time Factors