A critical assessment of factors influencing reliability in the classification of fractures, using fractures of the tibial plafond as a model.
OBJECTIVE
To investigate three factors that may influence the reliability of a fracture classification system: (a) the quality of the radiographs; (b) the ability of observers to identify the fracture fragments; and (c) the use of binary decision making.


METHODS
Assessment of interobserver reliability of blinded observers.


METHODS
Medical school department of orthopaedics.


METHODS
Two attending orthopaedists, two PGY-5 orthopaedic residents, and two PGY-3 orthopaedic residents served as observers.


METHODS
Observers classified radiographs of twenty-five tibial plafond fractures according to the Rüedi-Allgöwer and binary classification systems, and also rated the quality of each radiograph as adequate or inadequate for accurately classifying the fracture. At a second session, observers classified the same radiographs after marking the fragments of the tibial articular surface, as well as radiographs that had the articular fragments premarked by the senior author.


METHODS
Pairwise interobserver reliability was analyzed by kappa statistics, and mean kappa values were compared for each method of fracture classification.


RESULTS
No difference in interobserver reliability was detected between the Rüedi-Allgöwer and binary classification systems. Interobserver agreement on the adequacy of the radiographs was poorer than agreement on the classification of the fractures themselves. Having observers mark the fragments of the tibial articular surface had no effect on interobserver reliability; having the articular fragments premarked, however, significantly improved interobserver reliability in classifying the fractures.


CONCLUSIONS
The results of this study underscore the complexity of tibial plafond fractures and the difficulty observers have in reliably interpreting fracture radiographs. Fracture classification systems, such as the Rüedi-Allgöwer, predicated on identification of the number and displacement of articular fragments, may inherently perform poorly on reliability analyses because of observer difficulty in reliably identifying the fragments. Because binary decision making did not improve the reliability of fracture classification in this study, further investigation of the effectiveness of binary decision making may be advisable before such strategies are put into widespread use.
Dirschl
D R
DR
Department of Orthopaedics, University of North Carolina School of Medicine, Chapel Hill, USA.
Adams
G L
GL
D000328:Adult; D016512:Ankle Injuries / Q000145:classification* / Q000000981:diagnostic imaging*; D003663:Decision Trees; D006801:Humans; D008953:Models, Anatomic; D015588:Observer Variation; D011859:Radiography; D015203:Reproducibility of Results; D012680:Sensitivity and Specificity; D013978:Tibial Fractures / Q000145:classification* / Q000000981:diagnostic imaging*