title: Evaluation of methods for differential expression analysis on multi-group RNA-seq count data.
abstract: BACKGROUND
  RNA-seq is a powerful tool for measuring transcriptomes, especially for identifying differentially expressed genes or transcripts (DEGs) between sample groups. A number of methods have been developed for this task, and several evaluation studies have also been reported. However, those evaluations so far have been restricted to two-group comparisons. Accumulations of comparative studies for multi-group data are also desired.
  
  
  METHODS
  We compare 12 pipelines available in nine R packages for detecting differential expressions (DE) from multi-group RNA-seq count data, focusing on three-group data with or without replicates. We evaluate those pipelines on the basis of both simulation data and real count data.
  
  
  RESULTS
  As a result, the pipelines in the TCC package performed comparably to or better than other pipelines under various simulation scenarios. TCC implements a multi-step normalization strategy (called DEGES) that internally uses functions provided by other representative packages (edgeR, DESeq2, and so on). We found considerably different numbers of identified DEGs (18.5 ~ 45.7% of all genes) among the pipelines for the same real dataset but similar distributions of the classified expression patterns. We also found that DE results can roughly be estimated by the hierarchical dendrogram of sample clustering for the raw count data.
  
  
  CONCLUSIONS
  We confirmed the DEGES-based pipelines implemented in TCC performed well in a three-group comparison as well as a two-group comparison. We recommend using the DEGES-based pipeline that internally uses edgeR (here called the EEE-E pipeline) for count data with replicates (especially for small sample sizes). For data without replicates, the DEGES-based pipeline with DESeq2 (called SSS-S) can be recommended.
authors.affiliation: Graduate School of Agricultural and Life Sciences, The University of Tokyo, 1-1-1 Yayoi, Bunkyo-ku, Tokyo, 113-8657, Japan. tm2015@bi.a.u-tokyo.ac.jp.
authors.forename: Min
authors.initials: M
authors.lastname: Tang
authors.affiliation: Graduate School of Agricultural and Life Sciences, The University of Tokyo, 1-1-1 Yayoi, Bunkyo-ku, Tokyo, 113-8657, Japan. wukong@bi.a.u-tokyo.ac.jp.
authors.forename: Jianqiang
authors.initials: J
authors.lastname: Sun
authors.affiliation: Graduate School of Agricultural and Life Sciences, The University of Tokyo, 1-1-1 Yayoi, Bunkyo-ku, Tokyo, 113-8657, Japan. shimizu@bi.a.u-tokyo.ac.jp.
authors.forename: Kentaro
authors.initials: K
authors.lastname: Shimizu
authors.affiliation: Graduate School of Agricultural and Life Sciences, The University of Tokyo, 1-1-1 Yayoi, Bunkyo-ku, Tokyo, 113-8657, Japan. kadota@bi.a.u-tokyo.ac.jp.
authors.forename: Koji
authors.initials: K
authors.lastname: Kadota
mesh_terms: D000818:Animals; D019540:Area Under Curve; D003198:Computer Simulation; D005260:Female; D020869:Gene Expression Profiling / Q000379:methods*; D005786:Gene Expression Regulation; D006801:Humans; D008253:Macaca mulatta / Q000235:genetics; D008297:Male; D002679:Pan troglodytes / Q000235:genetics; D015203:Reproducibility of Results; D017423:Sequence Analysis, RNA / Q000379:methods*; D012984:Software; D059467:Transcriptome / Q000235:genetics