The Bristol Radiology Report Assessment Tool (BRRAT): developing a workplace-based assessment tool for radiology reporting skills.
OBJECTIVE
To review the development of a workplace-based assessment tool to assess the quality of written radiology reports and assess its reliability, feasibility, and validity.


METHODS
A comprehensive literature review and rigorous Delphi study enabled the development of the Bristol Radiology Report Assessment Tool (BRRAT), which consists of 19 questions and a global assessment score. Three assessors applied the assessment tool to 240 radiology reports provided by 24 radiology trainees.


RESULTS
The reliability coefficient for the 19 questions was 0.79 and the equivalent coefficient for the global assessment scores was 0.67. Generalizability coefficients demonstrate that higher numbers of assessors and assessments are needed to reach acceptable levels of reliability for summative assessments due to assessor subjectivity.


CONCLUSIONS
The study methodology gives good validity and strong foundation in best-practice. The assessment tool developed for radiology reporting is reliable and most suited to formative assessments.
Department of Radiology, Queen Alexandra Hospital, Portsmouth, UK. Electronic address: aw7823@hotmail.com.
A
A
Wallis
A
A
Edey
D
D
Prothero
P
P
McCoubrie
D002983:Clinical Competence / Q000592:standards*; D004503:Education, Medical, Graduate / Q000592:standards*; D004521:Educational Measurement / Q000592:standards*; D005240:Feasibility Studies; D006801:Humans; D011871:Radiology / Q000592:standards*; D015203:Reproducibility of Results; D011795:Surveys and Questionnaires / Q000592:standards*; D006113:United Kingdom; D017132:Workplace / Q000592:standards*