title: Interrater reliability in interpretation of electrocorticographic seizure detections of the responsive neurostimulator.
abstract: OBJECTIVE
  Electrocorticographic (ECoG) recordings from patients with medically intractable partial-onset seizures treated with a responsive neurostimulator system (the RNS System) that detects and stores physician-specified ECoG events provide a new data resource. Interpretation of these recordings has not yet been validated. The purpose was to evaluate the interrater interpretation of chronic ambulatory ECoG recordings obtained by the RNS System.
  
  
  METHODS
  Five pairs of five experts independently classified 7,221 ECoG recordings obtained from 128 patients with medically intractable partial seizures who participated in a randomized controlled trial of the safety and efficacy of the RNS System. ECoG detections--"long episodes" or "saturations"--were classified as "seizures" or "not seizures" based on a reference definition. Interrater agreement rates and kappa score reliabilities were calculated between rater pairs from the ECoG sample as a whole and within individual patients who had more than the median number of individual ECoG recordings.
  
  
  RESULTS
  The overall interrater agreement was 79%, with a reliability κ = 0.57 (moderate agreement). Agreement between pairs of reviewers ranged from 0.69 to 0.85. Agreement rates were 94% or better for 50% of patients. Only 25% of patients had ECoG recordings agreement rates worse than 75%. ECoGs with mixed interpretations (one reviewer "seizure"/the other--"not seizure") consisted of periods of low amplitude activity that evolved in amplitude or periodic discharges near 2 Hz.
  
  
  CONCLUSIONS
  Although reliability as a whole was moderate, for the majority of patients, detections yielded highly reliably interpreted events of either electrographic seizures or nonictal epileptiform activity.
authors.affiliation: Department of Neurology, University of Virginia, Charlottesville, Virginia, U.S.A.
authors.forename: Mark
authors.initials: M
authors.lastname: Quigg
authors.affiliation: NeuroPace Inc, Mountain View, California, U.S.A.
authors.forename: Felice
authors.initials: F
authors.lastname: Sun
authors.affiliation: Department of Neurology, University of Virginia, Charlottesville, Virginia, U.S.A.
authors.forename: Nathan B
authors.initials: NB
authors.lastname: Fountain
authors.affiliation: Department of Neurology, Dartmouth University, Lebanon, New Hampshire, U.S.A.
authors.forename: Barbara C
authors.initials: BC
authors.lastname: Jobst
authors.affiliation: Department of Neurology, Oregon Health and Science University, Portland, Oregon, U.S.A.
authors.forename: Victoria S S
authors.initials: VS
authors.lastname: Wong
authors.affiliation: NeuroPace Inc, Mountain View, California, U.S.A.
authors.forename: Emily
authors.initials: E
authors.lastname: Mirro
authors.affiliation: Department of Neurology, Oregon Health and Science University, Portland, Oregon, U.S.A.
authors.forename: Sarah
authors.initials: S
authors.lastname: Brown
authors.affiliation: Department of Neurology, Oregon Health and Science University, Portland, Oregon, U.S.A.
authors.forename: David C
authors.initials: DC
authors.lastname: Spencer
mesh_terms: D000328:Adult; D058256:Brain Waves / Q000502:physiology*; D004569:Electroencephalography; D004828:Epilepsies, Partial / Q000628:therapy*; D005260:Female; D006801:Humans; D058542:Implantable Neurostimulators; D008297:Male; D015203:Reproducibility of Results; D012189:Retrospective Studies; D016896:Treatment Outcome
keywords: Brain electrical stimulation; EEG; Electrocorticography; Focal epilepsy; Seizure detection