title: Interobserver variability in applying a radiographic definition for ARDS.
abstract: BACKGROUND
  Acute lung injury (ALI) and ARDS are currently defined by the American-European Consensus Conference (AECC) definition criteria, which contain a radiographic criterion. The accuracy or reliability of this consensus radiographic definition has not been evaluated, and no radiographic definition of ALI-ARDS has been evaluated by a large international group of experts.
  
  
  OBJECTIVE
  To study the interobserver variability in applying the AECC radiographic criterion for ALI-ARDS.
  
  
  METHODS
  Survey.
  
  
  METHODS
  A convenience sample of 21 experts selected from participants attending the 1997 Toronto Mechanical Ventilation Workshop and from members of the National Institutes of Health ARDS Network.
  
  
  METHODS
  Participants reviewed 28 randomly selected chest radiograph from critically ill, hypoxemic (PaO(2)/fraction of inspired oxygen ratio, < 300) patients and decided whether the radiograph fulfilled the AECC definition for ALI-ARDS.
  
  
  RESULTS
  Interobserver agreement in applying the AECC definition for ALI-ARDS was moderate (kappa = 0.55; 95% confidence interval, 0.52 to 0.57). Thirteen radiographs (43%) showed nearly complete agreement (defined as 20 or 21 readers in agreement). Nine radiographs (32%) had more than or equal to five dissenting readers. The percentage of radiographs interpreted as consistent with ALI-ARDS by individual readers ranged from 36 to 71%. Participants commented that mild infiltrates, pleural effusions, atelectasis, isolated lower lobe involvement, radiographic technique, and overlying monitoring equipment posed the most difficulties.
  
  
  CONCLUSIONS
  The radiographic criterion used in the current AECC definition for ALI-ARDS showed high interobserver variability when applied by expert investigators in the fields of mechanical ventilation and ARDS. This variability may result in differences in ALI-ARDS populations at different clinical research centers and may make it difficult for clinicians to apply the results of clinical trials to their patients. Modifications to the radiographic criterion or annotated reference radiograph may improve the reliability of future definitions for ALI-ARDS.
authors.affiliation: Harborview Medical Center and the Division of Pulmonary and Critical Care Medicine, University of Washington, Seattle WA 98104, USA. nodrog@u.washington.edu
authors.forename: G D
authors.initials: GD
authors.lastname: Rubenfeld
authors.forename: E
authors.initials: E
authors.lastname: Caldwell
authors.forename: J
authors.initials: J
authors.lastname: Granton
authors.forename: L D
authors.initials: LD
authors.lastname: Hudson
authors.forename: M A
authors.initials: MA
authors.lastname: Matthay
mesh_terms: D000293:Adolescent; D000328:Adult; D002648:Child; D002675:Child, Preschool; D006801:Humans; D007442:Intubation, Intratracheal; D015588:Observer Variation; D011446:Prospective Studies; D013902:Radiography, Thoracic; D015203:Reproducibility of Results; D012121:Respiration, Artificial; D012128:Respiratory Distress Syndrome / Q000000981:diagnostic imaging* / Q000628:therapy; D011795:Surveys and Questionnaires