Validating module network learning algorithms using simulated data.
BACKGROUND
In recent years, several authors have used probabilistic graphical models to learn expression modules and their regulatory programs from gene expression data. Despite the demonstrated success of such algorithms in uncovering biologically relevant regulatory relations, further developments in the area are hampered by a lack of tools to compare the performance of alternative module network learning strategies. Here, we demonstrate the use of the synthetic data generator SynTReN for the purpose of testing and comparing module network learning algorithms. We introduce a software package for learning module networks, called LeMoNe, which incorporates a novel strategy for learning regulatory programs. Novelties include the use of a bottom-up Bayesian hierarchical clustering to construct the regulatory programs, and the use of a conditional entropy measure to assign regulators to the regulation program nodes. Using SynTReN data, we test the performance of LeMoNe in a completely controlled situation and assess the effect of the methodological changes we made with respect to an existing software package, namely Genomica. Additionally, we assess the effect of various parameters, such as the size of the data set and the amount of noise, on the inference performance.


RESULTS
Overall, application of Genomica and LeMoNe to simulated data sets gave comparable results. However, LeMoNe offers some advantages, one of them being that the learning process is considerably faster for larger data sets. Additionally, we show that the location of the regulators in the LeMoNe regulation programs and their conditional entropy may be used to prioritize regulators for functional validation, and that the combination of the bottom-up clustering strategy with the conditional entropy-based assignment of regulators improves the handling of missing or hidden regulators.


CONCLUSIONS
We show that data simulators such as SynTReN are very well suited for the purpose of developing, testing and improving module network algorithms. We used SynTReN data to develop and test an alternative module network learning strategy, which is incorporated in the software package LeMoNe, and we provide evidence that this alternative strategy has several advantages with respect to existing methods.
Michoel
Tom
T
Bioinformatics & Evolutionary Genomics, Department of Plant Systems Biology, VIB/Ghent University, Ghent, Belgium. tom.michoel@psb.ugent.be
Maere
Steven
S
Bonnet
Eric
E
Joshi
Anagha
A
Saeys
Yvan
Y
Van den Bulcke
Tim
T
Van Leemput
Koenraad
K
van Remortel
Piet
P
Kuiper
Martin
M
Marchal
Kathleen
K
Van de Peer
Yves
Y
D000465:Algorithms; D001185:Artificial Intelligence; D003198:Computer Simulation; D005786:Gene Expression Regulation / Q000502:physiology; D008954:Models, Biological; D010363:Pattern Recognition, Automated / Q000379:methods; D020543:Proteome / Q000378:metabolism*; D015398:Signal Transduction / Q000502:physiology*; D012984:Software; D012986:Software Validation; D049490:Systems Biology / Q000379:methods
D020543:Proteome