Assessment of pediatricians by a regulatory authority.
OBJECTIVE
To determine whether it is possible to develop feasible, valid, and reliable multisource feedback data for pediatricians.


METHODS
Surveys with 40, 22, 38, and 37 items were developed for assessment of pediatricians by patients, co-workers, medical colleagues, and themselves, respectively, using 5-point scales with an "unable to assess" category. Items addressed key competencies related to communication skills, professionalism, collegiality, continuing professional development, and collaboration. Each pediatrician was assessed by 25 patients, 8 medical colleagues, and 8 co-workers. Feasibility was assessed with response rates for each instrument. Validity was assessed with rating profiles, the percentage of participants unable to assess the physician for each item, and exploratory factor analyses to determine which items grouped together into scales. Cronbach's alpha and generalizability coefficient analyses assessed reliability.


RESULTS
One hundred pediatricians participated. The mean number of respondents per physician was 23.4 (93.6%) for patients, 7.6 (94.8%) for co-workers, and 7.6 (95.5%) for medical colleagues. The mean ratings ranged from 4 to 5 for each item on each scale. Few items had high percentages of "unable to assess" responses. The factor analyses revealed a 4-factor solution for the patient survey, a 3-factor solution for the co-worker survey, and a 4-factor solution for the medical colleague survey, accounting for at least 64% of the variance. All instruments had high internal consistency. The generalizability coefficients were .85 for patients, .87 for co-workers, and .78 for medical colleagues.


CONCLUSIONS
Surveys can be developed to provide feedback data on key competencies.
Violato
Claudio
C
Department of Community Health Sciences, Faculty of Medicine, University of Calgary, Calgary, AB, Canada. violato@ucalgary.ca
Lockyer
Jocelyn M
JM
Fidler
Herta
H
D002170:Canada; D003625:Data Collection; D006282:Health Personnel / Q000523:psychology; D006801:Humans; D007400:Interprofessional Relations; D010361:Patients / Q000523:psychology; D010372:Pediatrics / Q000592:standards*; D010817:Physician-Patient Relations; D012647:Self-Assessment; D012955:Societies, Medical; D011795:Surveys and Questionnaires