title: An interobserver reproducibility study on invasiveness of bladder cancer using virtual microscopy and heatmaps.
abstract: OBJECTIVE
  The distinction between non-invasive (pTa) and invasive (pT1) non-muscle invasive bladder cancer (NMIBC) is subject to considerable interobserver variation. We aimed to generate a teaching set of images based on the diagnostic opinions of a panel of expert genitourinary pathologists.
  
  
  RESULTS
  Twenty-five transurethral resection specimens initially reported as pT1 NMIBC from two university hospitals were selected on the basis of potential uncertainty of stromal invasion. Digitized slides were reviewed independently by a panel of eight genitourinary pathologists, who annotated any invasive area if present. Annotations were reviewed by the lead panel, and heatmaps of annotated areas were constructed. Reasons for discrepancies were analysed, and kappa scores were calculated to determine agreement among the eight panellists. Full agreement by the eight panellists was obtained in 11 of 25 cases (44%), with a multi-rater (Fleiss) kappa of 0.47 (P < 0.0001). After joint review of the seven discordant (agreement <75% of panellists) cases, consensus was obtained for six cases, and a teaching set of images was generated.
  
  
  CONCLUSIONS
  Interobserver agreement among the panellists in the selected cases was moderate, but consensus could be reached in almost all cases. Heatmaps proved to be instrumental in generating a teaching set of images for standardization of histological criteria for NMIBC invasion.
authors.affiliation: Department of Pathology, Groupe Hospitalier La Pitié-Salpêtrière, Université Pierre et Marie Curie, Paris, France.
authors.forename: Eva
authors.initials: E
authors.lastname: Compérat
authors.forename: Lars
authors.initials: L
authors.lastname: Egevad
authors.forename: Antonio
authors.initials: A
authors.lastname: Lopez-Beltran
authors.forename: Philippe
authors.initials: P
authors.lastname: Camparo
authors.forename: Ferran
authors.initials: F
authors.lastname: Algaba
authors.forename: Mahul
authors.initials: M
authors.lastname: Amin
authors.forename: Jonathan I
authors.initials: JI
authors.lastname: Epstein
authors.forename: Hans
authors.initials: H
authors.lastname: Hamberg
authors.forename: Christina
authors.initials: C
authors.lastname: Hulsbergen-van de Kaa
authors.forename: Glen
authors.initials: G
authors.lastname: Kristiansen
authors.forename: Rodolfo
authors.initials: R
authors.lastname: Montironi
authors.forename: Chin-Chen
authors.initials: CC
authors.lastname: Pan
authors.forename: Fabrice
authors.initials: F
authors.lastname: Heloir
authors.forename: Kilian
authors.initials: K
authors.lastname: Treurniet
authors.forename: Jenna
authors.initials: J
authors.lastname: Sykes
authors.forename: Theo H
authors.initials: TH
authors.lastname: Van der Kwast
mesh_terms: D000368:Aged; D000369:Aged, 80 and over; D005260:Female; D006801:Humans; D008297:Male; D008853:Microscopy / Q000379:methods; D008875:Middle Aged; D009361:Neoplasm Invasiveness / Q000473:pathology*; D009367:Neoplasm Staging; D015588:Observer Variation; D010338:Pathology, Clinical / Q000193:education; D015203:Reproducibility of Results; D001749:Urinary Bladder Neoplasms / Q000145:classification / Q000473:pathology* / Q000601:surgery; D014584:User-Computer Interface
keywords: bladder cancer; interobserver variation; pT1 bladder cancer; pathological stage; virtual microscopy