title: Conceptualization and measurement of clinical competence of residents: a brief rating form and its psychometric properties.
abstract: Conceptualization and measurement of clinical competence of residents are of interest to medical educators. Yet there is a scarcity of operational tools with satisfactory psychometric support for measuring clinical competence. In this study, we investigated the underlying structure, criterion-related validity and alpha reliability of a brief rating form (20 items) developed to assess clinical competence of residents. The study sample consisted of 882 physicians (654 men, 228 women) in postgraduate training at Thomas Jefferson University Hospital between 1998 and 2000. Construct validity of the form was supported by factor analysis. Two relevant factors emerged: 'Knowledge, Data-Gathering and Processing Skills', and 'Interpersonal Skills and Attitudes'. Criterion-related validity was supported by significant linear associations between factor scores and performance on the medical licensing examinations. Alpha reliability coefficients for the two factors were 0.98 and 0.97, respectively. This brief rating form can be employed as one measure to evaluate clinical competence of residents with reasonable confidence in its measurement properties.
authors.affiliation: Center for Research in Medical Education and Health Care, Jefferson Medical College of Thomas Jefferson University, Philadelphia, Pennsylvania, USA. Thomas.Nasca@mail.tju.edu
authors.forename: Thomas J
authors.initials: TJ
authors.lastname: Nasca
authors.forename: Joseph S
authors.initials: JS
authors.lastname: Gonnella
authors.forename: Mohammadreza
authors.initials: M
authors.lastname: Hojat
authors.forename: Jon
authors.initials: J
authors.lastname: Veloski
authors.forename: James B
authors.initials: JB
authors.lastname: Erdmann
authors.forename: Mary
authors.initials: M
authors.lastname: Robeson
authors.forename: Timothy P
authors.initials: TP
authors.lastname: Brigham
authors.forename: Clara
authors.initials: C
authors.lastname: Callahan
mesh_terms: D002983:Clinical Competence / Q000592:standards* / Q000706:statistics & numerical data; D004521:Educational Measurement / Q000379:methods*; D005163:Factor Analysis, Statistical; D005260:Female; D005568:Forms and Records Control; D006785:Hospitals, University; D006801:Humans; D007396:Internship and Residency / Q000592:standards*; D007398:Interpersonal Relations; D019359:Knowledge; D008297:Male; D015143:Philadelphia; D011594:Psychometrics / Q000379:methods*