Reliability of the BI-RADS Final Assessment Categories and Management Recommendations in a Telemammography Context.
OBJECTIVE
The aim of this study was to evaluate the intradevice and interdevice reliability of four alternatives for telemammography-computed radiography, printed film, a film digitizer, and a digital camera-in terms of interpretation agreement when using the BI-RADS®lexicon.


METHODS
The ethics committee of the authors' institution approved this retrospective study. A factorial design with repeated measures with 1,960 interpretations was used (70 patients, seven radiologists, and four devices). Reliability was evaluated using the κ coefficient for intradevice and interdevice agreement on malignancy classification and on BI-RADS final assessment category.


RESULTS
Agreement on malignancy classification was higher than agreement for BI-RADS final assessment category. Interdevice agreement on malignancy classification between the film digitizer and computed radiography was ranked as almost perfect (P < .001), whereas interdevice agreement for the other alternatives was ranked as substantial (P < .001), with observed agreement ranging from 85% to 91% and κ values ranging from 0.70 to 0.81. Interdevice agreement on BI-RADS final assessment category was ranked as substantial or moderate (P < .001), with observed agreement ranging from 64% to 77% and κ values ranging from 0.52 to 0.69. Interdevice agreement was higher than intradevice agreement.


CONCLUSIONS
The results of this study show very high interdevice agreement, especially for management recommendations derived from malignancy classification, which is one of the most important outcomes in screening programs. This study provides evidence to suggest the interchangeability of the devices evaluated, thereby enabling the provision of low-cost medical imaging services to underserved populations.
Electrophysiology and Telemedicine Laboratory, University of Los Andes, Bogotá, Colombia. Electronic address: ant-sala@uniandes.edu.co.
Antonio J
AJ
Salazar
Department of Diagnostic Imaging, Fundación Santa Fe de Bogotá University Hospital, Bogotá, Colombia.
Javier A
JA
Romero
School of Government, University of Los Andes, Bogotá, Colombia.
Oscar A
OA
Bernal
Department of Diagnostic Imaging, Fundación Santa Fe de Bogotá University Hospital, Bogotá, Colombia.
Angela P
AP
Moreno
Department of Diagnostic Imaging, Fundación Santa Fe de Bogotá University Hospital, Bogotá, Colombia.
Sofía C
SC
Velasco
D001943:Breast Neoplasms / Q000000981:diagnostic imaging* / Q000628:therapy; D005260:Female; D006801:Humans; D008327:Mammography / Q000295:instrumentation*; D015588:Observer Variation; D000072177:Radiologists; D015203:Reproducibility of Results; D012189:Retrospective Studies; D019112:Teleradiology / Q000295:instrumentation* / Q000379:methods / Q000592:standards; D014057:Tomography, X-Ray Computed
BI-RADS; breast cancer; film digitizer; mammography; reliability; telemammography