Petabyte-scale innovations at the European Nucleotide Archive.
Dramatic increases in the throughput of nucleotide sequencing machines, and the promise of ever greater performance, have thrust bioinformatics into the era of petabyte-scale data sets. Sequence repositories, which provide the feed for these data sets into the worldwide computational infrastructure, are challenged by the impact of these data volumes. The European Nucleotide Archive (ENA; http://www.ebi.ac.uk/embl), comprising the EMBL Nucleotide Sequence Database and the Ensembl Trace Archive, has identified challenges in the storage, movement, analysis, interpretation and visualization of petabyte-scale data sets. We present here our new repository for next generation sequence data, a brief summary of contents of the ENA and provide details of major developments to submission pipelines, high-throughput rule-based validation infrastructure and data integration approaches.
Cochrane
Guy
G
EMBL-European Bioinformatics Institute, Wellcome Trust Genome Campus, Hinxton, Cambridge CB10 1SD, UK. cochrane@ebi.ac.uk
Akhtar
Ruth
R
Bonfield
James
J
Bower
Lawrence
L
Demiralp
Fehmi
F
Faruque
Nadeem
N
Gibson
Richard
R
Hoad
Gemma
G
Hubbard
Tim
T
Hunter
Christopher
C
Jang
Mikyung
M
Juhos
Szilveszter
S
Leinonen
Rasko
R
Leonard
Steven
S
Lin
Quan
Q
Lopez
Rodrigo
R
Lorenc
Dariusz
D
McWilliam
Hamish
H
Mukherjee
Gaurab
G
Plaister
Sheila
S
Radhakrishnan
Rajesh
R
Robinson
Stephen
S
Sobhany
Siamak
S
Hoopen
Petra Ten
PT
Vaughan
Robert
R
Zalunin
Vadim
V
Birney
Ewan
E
D030561:Databases, Nucleic Acid; D020407:Internet; D017421:Sequence Analysis / Q000639:trends*; D018511:Systems Integration