Questionnaires for 360-degree assessment of consultant psychiatrists: development and psychometric properties.
BACKGROUND
Expert clinical judgement combines technical proficiency with humanistic qualities.


OBJECTIVE
To test the psychometric properties of questionnaires to assess the humanistic qualities of working with colleagues and relating to patients using multisource feedback.


METHODS
Analysis of self-ratings by 347 consultant psychiatrists and ratings by 4422 colleagues and 6657 patients.


RESULTS
Mean effectiveness as rated by self, colleagues and patients, was 4.6, 5.0 and 5.2 respectively (where 1=very low and 6=excellent). The instruments are internally consistent (Cronbach's alpha >0.95). Principal components analysis of the colleague questionnaire yielded seven factors that explain 70.2% of the variance and accord with the domain structure. Colleague and patient ratings correlate with one another (r=0.39, P<0.001) but not with the self-rating. Ratings from 13 colleagues and 25 patients are required to achieve a generalisability coefficient (Erho(2)) of 0.75.


CONCLUSIONS
Reliable 360-degree assessment of humane judgement is feasible for psychiatrists who work in large multiprofessional teams and who have large case-loads.
Lelliott
Paul
P
Royal College of Psychiatrists' Research and Training Unit, Standon House, London, UK. plelliott@cru.rcpsych.ac.uk
Williams
Richard
R
Mears
Alex
A
Andiappan
Manoharan
M
Owen
Helen
H
Reading
Paul
P
Coyle
Nick
N
Hunter
Stephen
S
D001291:Attitude of Health Personnel; D002983:Clinical Competence / Q000592:standards; D003253:Consultants; D006801:Humans; D008605:Mental Health Services / Q000592:standards; D018024:Peer Review, Health Care / Q000379:methods / Q000592:standards; D010817:Physician-Patient Relations; D010818:Practice Patterns, Physicians' / Q000592:standards; D011570:Psychiatry; D011594:Psychometrics / Q000379:methods / Q000592:standards; D012647:Self-Assessment; D013223:Statistics as Topic; D011795:Surveys and Questionnaires / Q000592:standards*