Observer agreement in the angiographic assessment of arteriovenous malformations of the brain.
OBJECTIVE
We aimed to determine intraobserver and interobserver agreement in the characterization of brain arteriovenous malformation (AVM) angioarchitecture on intra-arterial digital subtraction angiograms.


METHODS
Five experienced interventional neuroradiologists independently reviewed 40 anonymized angiograms obtained at the time of first-ever AVM diagnosis. The allocation of the films to observers was balanced for AVM size and complexity. Every observer was compared with himself and all the others by distributing the films in 2 batches 3 months apart. The observers used standard forms to collect both quantitative and categorized qualitative angiographic data. To measure agreement we used the kappa statistic (kappa) for nominal data, weighted kappa for ordinal and discrete interval data, and Bland & Altman analysis for continuous data.


RESULTS
Intraobserver agreement was generally moderate to substantial, with 95% confidence intervals ranging from fair to almost perfect. However, for every characteristic, interobserver agreement was less than intraobserver agreement. Interobserver agreement was generally slight to moderate, with 95% confidence intervals ranging from less than chance to almost perfect.


CONCLUSIONS
This study demonstrates the need for robust and generalizeable definitions of AVM angioarchitecture and methods of nidus size measurement-with proof of good intraobserver and interobserver agreement-for future efforts to understand the prognosis and best treatment of AVMs.
Al-Shahi
Rustam
R
Department of Clinical Neurosciences, Edinburgh University, Western General Hospital, Edinburgh, Scotland. Rustam.Al-Shahi@ed.ac.uk
Pal
Nandita
N
Lewis
Steff C
SC
Bhattacharya
Jo J
JJ
Sellar
Robin J
RJ
Warlow
Charles P
CP
D000328:Adult; D015901:Angiography, Digital Subtraction / Q000592:standards* / Q000706:statistics & numerical data; D001165:Arteriovenous Malformations / Q000000981:diagnostic imaging* / Q000453:epidemiology; D002533:Cerebral Angiography / Q000592:standards* / Q000706:statistics & numerical data; D015331:Cohort Studies; D006801:Humans; D015588:Observer Variation; D015203:Reproducibility of Results