title: A Turing test for artificial expression data.
abstract: BACKGROUND
  The lack of reliable, comprehensive gold standards complicates the development of many bioinformatics tools, particularly for the analysis of expression data and biological networks. Simulation approaches can provide provisional gold standards, such as regulatory networks, for the assessment of network inference methods. However, this just defers the problem, as it is difficult to assess how closely simulators emulate the properties of real data.
  
  
  RESULTS
  In analogy to Turing's test discriminating humans and computers based on responses to questions, we systematically compare real and artificial systems based on their gene expression output. Different expression data analysis techniques such as clustering are applied to both types of datasets. We define and extract distributions of properties from the results, for instance, distributions of cluster quality measures or transcription factor activity patterns. Distributions of properties are represented as histograms to enable the comparison of artificial and real datasets. We examine three frequently used simulators that generate expression data from parameterized regulatory networks. We identify features distinguishing real from artificial datasets that suggest how simulators could be adapted to better emulate real datasets and, thus, become more suitable for the evaluation of data analysis tools.
  
  
  BACKGROUND
  See http://www2.bio.ifi.lmu.de/∼kueffner/attfad/ and the supplement for precomputed analyses; other compendia can be analyzed via the CRAN package attfad. The full datasets can be obtained from http://www2.bio.ifi.lmu.de/∼kueffner/attfad/data.tar.gz.
authors: Department of Informatics, Ludwig-Maximilians Universität, 80333 München, Germany.
authors: Robert
authors: R
authors: Maier
authors: Ralf
authors: R
authors: Zimmer
authors: Robert
authors: R
authors: Küffner
mesh_terms: D016000:Cluster Analysis; D004926:Escherichia coli / Q000235:genetics; D015870:Gene Expression; D020869:Gene Expression Profiling / Q000379:methods*; D006801:Humans; D012441:Saccharomyces cerevisiae / Q000235:genetics; D012984:Software