A multi source feedback program for anesthesiologists.
OBJECTIVE
To assess the feasibility, validity, and reliability of a multi source feedback program for anesthesiologists.


METHODS
Surveys with 11, 19, 29 and 29 items were developed for patients, coworkers, medical colleagues and self, respectively, using five-point scales with an 'unable to assess' category. The items addressed communication skills, professionalism, collegiality, continuing professional development and collaboration. Each anesthesiologist was assessed by eight medical colleagues, eight coworkers, and 30 patients. Feasibility was assessed by response rates for each instrument. Validity was assessed by rating profiles, the percentage of participants unable to assess the physician for each item, and exploratory factor analyses to determine which items grouped together into scales. Cronbach's alpha and generalizability coefficient analyses assessed reliability.


RESULTS
One hundred and eighty-six physicians participated. The mean number and percentage return rate of respondents per physician was 17.7 (56.2%) for patients, 7.8 (95.1%) for coworkers, and 7.8 (94.6%) for medical colleagues. The mean ratings ranged from four to five for each item on each scale. There were relatively few items with high percentages of 'unable to assess'. The factor analyses revealed a two-factor solution for the patient, a two-factor solution for the coworker and a three-factor solution for the medical colleague survey, accounting for at least 70% of the variance. All instruments had a high internal consistency reliability (Cronbach's alpha > 0.95). The generalizability coefficients were 0.65 for patients, 0.56 for coworkers and 0.69 for peers.


CONCLUSIONS
It is feasible to develop multi source feedback instruments for anesthesiologists that are valid and reliable.
Lockyer
Jocelyn M
JM
Continuing Medical Education and Professional Development, Faculty of Medicine, University of Calgary, 3330 Hospital Drive N.W., Calgary, Alberta, T2N 4N1, Canada. lockyer@ucalgary.ca
Violato
Claudio
C
Fidler
Herta
H
D000776:Anesthesiology; D001291:Attitude of Health Personnel; D003142:Communication; D005163:Factor Analysis, Statistical; D005240:Feasibility Studies; D005246:Feedback / Q000502:physiology*; D019538:Health Care Surveys / Q000706:statistics & numerical data*; D006282:Health Personnel / Q000523:psychology / Q000706:statistics & numerical data*; D006801:Humans; D033183:Interdisciplinary Communication; D007400:Interprofessional Relations; D010817:Physician-Patient Relations; D011361:Professional Competence / Q000706:statistics & numerical data; D011594:Psychometrics; D015203:Reproducibility of Results