title: Multiple classifier systems for automatic sleep scoring in mice.
abstract: BACKGROUND
  Electroencephalogram (EEG) and electromyogram (EMG) recordings are often used in rodents to study sleep architecture and sleep-associated neural activity. These recordings must be scored to designate what sleep/wake state the animal is in at each time point. Manual sleep-scoring is very time-consuming, so machine-learning classifier algorithms have been used to automate scoring.
  
  
  METHODS
  Instead of using single classifiers, we implement a multiple classifier system. The multiple classifier is built from six base classifiers: decision tree, k-nearest neighbors, naïve Bayes, support vector machine, neural net, and linear discriminant analysis. Decision tree and k-nearest neighbors were improved into ensemble classifiers by using bagging and random subspace. Confidence scores from each classifier were combined to determine the final classification. Ambiguous epochs can be rejected and left for a human to classify.
  
  
  RESULTS
  Support vector machine was the most accurate base classifier, and had error rate of 0.054. The multiple classifier system reduced the error rate to 0.049, which was not significantly different from a second human scorer. When 10% of epochs were rejected, the remaining epochs' error rate dropped to 0.018.
  
  
  CONCLUSIONS
  Compared with the most accurate single classifier (support vector machine), the multiple classifier reduced errors by 9.4%. The multiple classifier surpassed the accuracy of a second human scorer after rejecting only 2% of epochs.
  
  
  CONCLUSIONS
  Multiple classifier systems are an effective way to increase automated sleep scoring accuracy. Improvements in autoscoring will allow sleep researchers to increase sample sizes and recording lengths, opening new experimental possibilities.
authors.affiliation: Center for Sleep and Circadian Biology, Northwestern University, Department of Neurobiology, 2205 Tech Drive Hogan 2-160, Evanston, IL 60208, United States. Electronic address: v-gao@u.northwestern.edu.
authors.forename: Vance
authors.initials: V
authors.lastname: Gao
authors.affiliation: Center for Sleep and Circadian Biology, Northwestern University, Department of Neurobiology, 2205 Tech Drive Hogan 2-160, Evanston, IL 60208, United States.
authors.forename: Fred
authors.initials: F
authors.lastname: Turek
authors.affiliation: Center for Sleep and Circadian Biology, Northwestern University, Department of Neurobiology, 2205 Tech Drive Hogan 2-160, Evanston, IL 60208, United States.
authors.forename: Martha
authors.initials: M
authors.lastname: Vitaterna
mesh_terms: D000465:Algorithms; D000818:Animals; D004569:Electroencephalography / Q000379:methods*; D004576:Electromyography / Q000379:methods*; D000069550:Machine Learning; D051379:Mice; D012815:Signal Processing, Computer-Assisted; D012894:Sleep Stages / Q000502:physiology*
keywords: Autoscoring; Electroencephalogram; Machine learning; Mouse; Multiple classifier system; Sleep; Sleep scoring