title: Interobserver agreement for EUS in the evaluation and diagnosis of submucosal masses.
abstract: BACKGROUND
  EUS is an accurate means of evaluating and diagnosing submucosal lesions of the GI tract. The aim of this study was to prospectively determine interobserver agreement for the EUS classification of submucosal masses among endosonographers with different levels of training and experience from multiple centers.
  
  
  METHODS
  Twenty patients with submucosal mass lesions diagnosed by upper endoscopy underwent EUS. Surgical findings were available for 16 patients. In 4 patients with obvious cystic/vascular structures (i.e., varices) no surgical specimen was necessary. A blinded observer developed a study videotape of critical endoscopic and EUS real-time imaging for each lesion. The videotape was distributed to 10 endosonographers, each with at least 1 year of experience, who independently reviewed the videotape and recorded their diagnosis based on EUS features. These endosonographers used previously agreed-upon standardized EUS diagnostic criteria for each category of lesion. A kappa (kappa) statistic, used to evaluate agreement, was calculated for each lesion category for the 10 endosonographers as a group and individually. An overall kappa statistic was also calculated. Significance was analyzed with a two-tailed t test.
  
  
  RESULTS
  Agreement was excellent for cystic lesions (kappa = 0.80) and extrinsic compressions (kappa = 0.94), good for lipoma (kappa = 0.65), fair for leiomyoma and vascular lesions (kappa = 0.53 and 0.54, respectively), and poor for other submucosal lesions (kappa = 0.34). Overall agreement among observers was good (kappa = 0.63). Furthermore, a significant association was noted between total years of EUS experience and the number of correct answers (p = 0.01).
  
  
  CONCLUSIONS
  Interobserver agreement is good for characterizing submucosal masses by EUS. However, it appears to be better for some lesions than others. The overall length of experience with EUS appears to play an important role in the accuracy of this modality in the evaluation of submucosal lesions.
authors.affiliation: Divisions of Gastroenterology and Hepatology, Winthrop-University Hospital/SUNY at Stony Brook, Long Island NY 11501, USA.
authors.forename: F
authors.initials: F
authors.lastname: Gress
authors.forename: C
authors.initials: C
authors.lastname: Schmitt
authors.forename: T
authors.initials: T
authors.lastname: Savides
authors.forename: D O
authors.initials: DO
authors.lastname: Faigel
authors.forename: M
authors.initials: M
authors.lastname: Catalano
authors.forename: W
authors.initials: W
authors.lastname: Wassef
authors.forename: L
authors.initials: L
authors.lastname: Roubein
authors.forename: N
authors.initials: N
authors.lastname: Nickl
authors.forename: D
authors.initials: D
authors.lastname: Ciaccia
authors.forename: M
authors.initials: M
authors.lastname: Bhutani
authors.forename: B
authors.initials: B
authors.lastname: Hoffman
authors.forename: J
authors.initials: J
authors.lastname: Affronti
mesh_terms: D019160:Endosonography / Q000706:statistics & numerical data*; D005753:Gastric Mucosa / Q000000981:diagnostic imaging*; D005770:Gastrointestinal Neoplasms / Q000000981:diagnostic imaging*; D006801:Humans; D007413:Intestinal Mucosa / Q000000981:diagnostic imaging*; D015588:Observer Variation; D011446:Prospective Studies