title: Deconvoluting simulated metagenomes: the performance of hard- and soft- clustering algorithms applied to metagenomic chromosome conformation capture (3C).
abstract: BACKGROUND
  Chromosome conformation capture, coupled with high throughput DNA sequencing in protocols like Hi-C and 3C-seq, has been proposed as a viable means of generating data to resolve the genomes of microorganisms living in naturally occuring environments. Metagenomic Hi-C and 3C-seq datasets have begun to emerge, but the feasibility of resolving genomes when closely related organisms (strain-level diversity) are present in the sample has not yet been systematically characterised.
  
  
  METHODS
  We developed a computational simulation pipeline for metagenomic 3C and Hi-C sequencing to evaluate the accuracy of genomic reconstructions at, above, and below an operationally defined species boundary. We simulated datasets and measured accuracy over a wide range of parameters. Five clustering algorithms were evaluated (2 hard, 3 soft) using an adaptation of the extended B-cubed validation measure.
  
  
  RESULTS
  When all genomes in a sample are below 95% sequence identity, all of the tested clustering algorithms performed well. When sequence data contains genomes above 95% identity (our operational definition of strain-level diversity), a naive soft-clustering extension of the Louvain method achieves the highest performance.
  
  
  CONCLUSIONS
  Previously, only hard-clustering algorithms have been applied to metagenomic 3C and Hi-C data, yet none of these perform well when strain-level diversity exists in a metagenomic sample. Our simple extension of the Louvain method performed the best in these scenarios, however, accuracy remained well below the levels observed for samples without strain-level diversity. Strain resolution is also highly dependent on the amount of available 3C sequence data, suggesting that depth of sequencing must be carefully considered during experimental design. Finally, there appears to be great scope to improve the accuracy of strain resolution through further algorithm development.
authors.affiliation: ithree institute, University of Technology Sydney , Sydney , NSW , Australia.
authors.forename: Matthew Z
authors.initials: MZ
authors.lastname: DeMaere
authors.affiliation: ithree institute, University of Technology Sydney , Sydney , NSW , Australia.
authors.forename: Aaron E
authors.initials: AE
authors.lastname: Darling
keywords: 3C; Chromosome conformation capture; Clustering; External index; HiC; Metagenomics; Microbial ecology; Read mapping; Simulation pipeline; Soft clustering; Synthetic microbial communities