title: Colposcopy Quality Control: Establishing Colposcopy Criterion Standards for the National Cancer Institute ALTS Trial Using Cervigrams.
abstract: OBJECTIVE
  The colposcopy quality control (QC) group of the Atypical Squamous Cells of Undetermined Significance-Low-Grade Squamous Intraepithelial Lesions (ASCUS/ LSIL) Triage Study (ALTS) monitors colposcopists at four clinical centers by direct observation and indirectly by assessment of digitized computer colposcopic images transferred nightly by modem. The purpose of this preclinical study was to determine the agreement among colposcopy QC monitors' colposcopic impressions and biopsy site placement through evaluation of cervical photographic images.
  
  
  METHODS
  A nonparticipant selected 100 Cervigram slides representing four pathologically confirmed categories: cervical intraepihelial neoplasia 1(CIN), CIN2 and CIN3, normal, and cancer. our colposcopy QC monitors and two certified Cervigram evaluators independently interpreted the images for colpocopic impression on two separate occasions. Measures of agreement were calculated for intraobserver, pairwise interobserver, and observer versus histological diagnoses. Participants also indicated the most severe biopsy site by marking an χ on a 4 × 6-inch color print duplication. Mean distances between biopsy site annotations for each pair of evaluators were calculated.
  
  
  RESULTS
  The ALTS observer agreement with histology ranged from 75.3% (K = .66) to 47.4% (K = .36) for the first evaluation and 71.1 % (K = .63) to 50.5% (K = .38) for the second evaluation. ALTS interobserver agreement varied between 71 % and 57% for the first interpretation and 76% and I2% for the second evaluation. ALTS intraobserver agreement varied from 86% (K = .86) to 68.0% (K = .60). The mean listances between biopsy site annotations for each pair of ALTS observers varied from 0.99 ± 0.93 mm to 1.44 ± 1.19 nm.
  
  
  CONCLUSIONS
  The ALTS colposcopy QC monitors achieved poor to good observer agreement with histology, fair to excellent interobserver agreement, and good to excellent intraobserver agreement in assessing the severity of cervical images. These levels of agreement are similar to many reported by pathologists for cervical cytology and histology interpretations. Monitors also demonstrated a very narrow variation of distance (< 2 mm) for ideal biopsy site placement.
authors.affiliation: *The Department of Family Medicine and §Office of Biostatistics, Medical College of Georgia, Augusta, GA; †The Student Health Service, University of California at Santa Barbara, Santa Barbara, CA; ‡Department of Obstetrics and Gynecology, Beth Israel Deaconess Hospital, Boston, MA; ¶Department of Community and Family Medicine, Dartmouth Medical School, Hanover, NH; #Women's Cancer Center, Royal Hospital for Women, Sydney, Australia; ** Omnia, Inc., Philadelphia, PA; and ††The National Cancer Institute, Rockville, MD.
authors.forename: D G
authors.initials: DG
authors.lastname: Ferris
authors.forename: J T
authors.initials: JT
authors.lastname: Cox
authors.forename: L
authors.initials: L
authors.lastname: Burke
authors.forename: M S
authors.initials: MS
authors.lastname: Litaker
authors.forename: D M
authors.initials: DM
authors.lastname: Harper
authors.forename: M J
authors.initials: MJ
authors.lastname: Campion
authors.forename: M D
authors.initials: MD
authors.lastname: Greenberg
authors.forename: L
authors.initials: L
authors.lastname: McShane
authors.forename: L M
authors.initials: LM
authors.lastname: Wun