title: What levels of agreement can be expected between histopathologists assigning cases to discrete nominal categories? A study of the diagnosis of hyperplastic and adenomatous colorectal polyps.
abstract: OBJECTIVE
  To assess the levels of agreement between histopathologists for a two-class nominal categorization process--the discrimination between hyperplastic and adenomatous colorectal polyps.
  
  
  METHODS
  Fifty hyperplastic and 50 adenomatous polyps received consecutively in the laboratory were categorized by nine histopathologists, and the level of agreement between all observers and the original diagnosis was assessed using kappa statistics.
  
  
  RESULTS
  For the eight observers with 11 months or more experience in histopathology, there was a high level of agreement with kappa statistics ranging from 0.84 to 0.98. This process was performed rapidly with an average of 13 to 22 seconds spent on each case. One observer with only 6-weeks' experience of histopathology had a lower overall level of agreement with kappa statistics ranging from 0.46 to 0.54, but the performance on the later cases was much higher.
  
  
  CONCLUSIONS
  The level of agreement in the distinction between hyperplastic and adenomatous colorectal polyps is high among histopathologists with at least moderate amounts of experience in histopathology. The one virtually naïve observer showed a marked learning response during the study without feedback on case outcome. This suggests that histopathologists are very reliable in assigning cases to distinct nominal categories and that learning of these processes occurs early in a histopathologist's career.
authors.affiliation: Department of Pathology, University of Sheffield Medical School, England. s.s.cross@sheffield.ac.uk
authors.forename: S S
authors.initials: SS
authors.lastname: Cross
authors.forename: S
authors.initials: S
authors.lastname: Betmouni
authors.forename: J L
authors.initials: JL
authors.lastname: Burton
authors.forename: A K
authors.initials: AK
authors.lastname: Dubé
authors.forename: K M
authors.initials: KM
authors.lastname: Feeley
authors.forename: M R
authors.initials: MR
authors.lastname: Holbrook
authors.forename: R J
authors.initials: RJ
authors.lastname: Landers
authors.forename: P B
authors.initials: PB
authors.lastname: Lumb
authors.forename: T J
authors.initials: TJ
authors.lastname: Stephenson
mesh_terms: D018256:Adenomatous Polyps / Q000175:diagnosis*; D015179:Colorectal Neoplasms / Q000175:diagnosis*; D003951:Diagnostic Errors / Q000706:statistics & numerical data; D006801:Humans; D006965:Hyperplasia / Q000175:diagnosis; D007422:Intestines / Q000473:pathology*; D015233:Models, Statistical; D015588:Observer Variation; D015203:Reproducibility of Results