'Team observation': a six-year study of the development and use of multi-source feedback (360-degree assessment) in obstetrics and gynaecology training in the UK.
Multi-source feedback, or 360-degree assessment, is an important part of the assessment of people in the workplace, in both health and industry. Almost all published work concentrates on content validity and generalizability. However, an assessment system needs construct validity, and has to have practicability and acceptability, without sacrificing fitness for purpose, content validity or inter-rater reliability. This was a six-year study of the first UK-wide hospital-based multi-source feedback system, in the specialty of obstetrics and gynaecology. This paper describes the development of the assessment tool, its use and the analyses of the results in several areas. These are picking up poor performance, congratulating good behaviour, construct validity, the number of domains to be measured, and the minimum number of raters. The study demonstrated that the Team Observation system in reality only measured a very limited number of attributes, and that the main construct under scrutiny is interpersonal behaviour. The system can identify those who may have a problem, using less than 10 raters, and yet the process can be a positive experience for the large majority of people who have been assessed.
Wood
Laurence
L
West Midlands Deanery, Edgbaston, Birmingham, UK.
Wall
David
D
Bullock
Alison
A
Hassell
Andrew
A
Whitehouse
Andrew
A
Campbell
Ian
I
D002983:Clinical Competence; D003479:Curriculum; D003627:Data Interpretation, Statistical; D003697:Delphi Technique; D004503:Education, Medical, Graduate / Q000458:organization & administration*; D004521:Educational Measurement / Q000379:methods*; D005246:Feedback; D005260:Female; D006176:Gynecology / Q000193:education*; D006801:Humans; D007398:Interpersonal Relations; D019370:Observation; D009774:Obstetrics / Q000193:education*; D006113:United Kingdom