title: The kappa statistic was representative of empirically observed inter-rater agreement for physical findings.
abstract: OBJECTIVE
  To determine empirically chance agreement between different clinicians evaluating physical examination findings in children with acute abdominal pain.
  
  
  METHODS
  Cross-sectional study of children age 3 to 18 years treated in a pediatric emergency department for acute abdominal pain. Three different examiners were provided the same historic information and asked to predict, independently and prior to examining the patient, the presence or absence of seven different clinical findings. Agreement between pairs of observers on these predicted findings was determined, and was defined as observed chance agreement. Actual examination findings were also recorded, and expected agreement due to chance was determined from the kappa statistic calculation.
  
  
  RESULTS
  There were 68 pair of observations between two pediatric examiners, and 46 pair between pediatric and surgical examiners. Observed and expected chance agreement were very similar for six of the seven clinical findings. Agreement beyond chance for the actual exam findings was generally poor, with kappa less than 0.5 for all but one finding.
  
  
  CONCLUSIONS
  Expected chance agreement, as calculated from the kappa statistic, is a reasonable reflection of empirically observed chance agreement between clinicians.
authors.affiliation: Department of Pediatrics, Section of Emergency Medicine, Medical College of Wisconsin, and Children's Research Institute, P.O. Box 1997, Milwaukee, WI 53201, USA. mgorelic@mcw.edu
authors.forename: Marc H
authors.initials: MH
authors.lastname: Gorelick
authors.forename: Kenneth
authors.initials: K
authors.lastname: Yen
mesh_terms: D015746:Abdominal Pain / Q000209:etiology*; D000208:Acute Disease; D000293:Adolescent; D002648:Child; D002675:Child, Preschool; D003430:Cross-Sectional Studies; D004635:Emergency Medicine / Q000592:standards*; D005260:Female; D006801:Humans; D008297:Male; D015233:Models, Statistical; D015588:Observer Variation; D010372:Pediatrics / Q000592:standards*; D015203:Reproducibility of Results