How reliable and accurate is the AO/OTA comprehensive classification for adult long-bone fractures?
BACKGROUND
Reliable classification of fractures is important for treatment allocation and study comparisons. The overall accuracy of scoring applied to a general population of fractures is little known. This study aimed to investigate the accuracy and reliability of the comprehensive Arbeitsgemeinschaft für Osteosynthesefragen/Orthopedic Trauma Association classification for adult long-bone fractures and identify factors associated with poor coding agreement.


METHODS
Adults (>16 years) with long-bone fractures coded in a Fracture and Dislocation Registry at the Stavanger University Hospital during the fiscal year 2008 were included. An unblinded reference code dataset was generated for the overall accuracy assessment by two experienced orthopedic trauma surgeons. Blinded analysis of intrarater reliability was performed by rescoring and of interrater reliability by recoding of a randomly selected fracture sample. Proportion of agreement (PA) and kappa (κ) statistics are presented. Uni- and multivariate logistic regression analyses of factors predicting accuracy were performed.


RESULTS
During the study period, 949 fractures were included and coded by 26 surgeons. For the intrarater analysis, overall agreements were κ = 0.67 (95% confidence interval [CI]: 0.64-0.70) and PA 69%. For interrater assessment, κ = 0.67 (95% CI: 0.62-0.72) and PA 69%. The accuracy of surgeons' blinded recoding was κ = 0.68 (95% CI: 0.65- 0.71) and PA 68%. Fracture type, frequency of the fracture, and segment fractured significantly influenced accuracy whereas the coder's experience did not.


CONCLUSIONS
Both the reliability and accuracy of the comprehensive Arbeitsgemeinschaft für Osteosynthesefragen/Orthopedic Trauma Association classification for long-bone fractures ranged from substantial to excellent. Variations in coding accuracy seem to be related more to the fracture itself than the surgeon.


METHODS
Diagnostic study, level I.
Department of Orthopedic Surgery, Stavanger University Hospital, Stavanger, Norway.
Terje
T
Meling
Knut
K
Harboe
Cathrine H
CH
Enoksen
Morten
M
Aarflot
Astvaldur J
AJ
Arthursson
Kjetil
K
Søreide
D000328:Adult; D005260:Female; D050723:Fractures, Bone / Q000145:classification* / Q000175:diagnosis / Q000000981:diagnostic imaging / Q000473:pathology; D006801:Humans; D008297:Male; D008875:Middle Aged; D015588:Observer Variation; D011859:Radiography; D015203:Reproducibility of Results; D012955:Societies, Medical