Cost-effective cloud computing: a case study using the comparative genomics tool, roundup.
BACKGROUND
Comparative genomics resources, such as ortholog detection tools and repositories are rapidly increasing in scale and complexity. Cloud computing is an emerging technological paradigm that enables researchers to dynamically build a dedicated virtual cluster and may represent a valuable alternative for large computational tools in bioinformatics. In the present manuscript, we optimize the computation of a large-scale comparative genomics resource-Roundup-using cloud computing, describe the proper operating principles required to achieve computational efficiency on the cloud, and detail important procedures for improving cost-effectiveness to ensure maximal computation at minimal costs.


METHODS
Utilizing the comparative genomics tool, Roundup, as a case study, we computed orthologs among 902 fully sequenced genomes on Amazon's Elastic Compute Cloud. For managing the ortholog processes, we designed a strategy to deploy the web service, Elastic MapReduce, and maximize the use of the cloud while simultaneously minimizing costs. Specifically, we created a model to estimate cloud runtime based on the size and complexity of the genomes being compared that determines in advance the optimal order of the jobs to be submitted.


RESULTS
We computed orthologous relationships for 245,323 genome-to-genome comparisons on Amazon's computing cloud, a computation that required just over 200 hours and cost $8,000 USD, at least 40% less than expected under a strategy in which genome comparisons were submitted to the cloud randomly with respect to runtime. Our cost savings projections were based on a model that not only demonstrates the optimal strategy for deploying RSD to the cloud, but also finds the optimal cluster size to minimize waste and maximize usage. Our cost-reduction model is readily adaptable for other comparative genomics tools and potentially of significant benefit to labs seeking to take advantage of the cloud as an alternative to local computing infrastructure.
Center for Biomedical Informatics, Harvard Medical School, Boston, MA 02115.
Parul
P
Kudtarkar
Todd F
TF
Deluca
Vincent A
VA
Fusaro
Peter J
PJ
Tonellato
Dennis P
DP
Wall
PLoS Comput Biol. 2009 Jan;5(1):e1000262
19148271
J Biomed Inform. 2010 Apr;43(2):342-53
19715773
Nucleic Acids Res. 2003 Jul 1;31(13):3497-500
12824352
BMC Bioinformatics. 2010 May 18;11:259
20482786
Bioinformatics. 2003 Sep 1;19(13):1710-1
15593400
Bioinformatics. 2006 Aug 15;22(16):2044-6
16777906
Comput Appl Biosci. 1997 Oct;13(5):555-6
9367129
Genome Med. 2010 Aug 06;2(8):51
20691073
J Mol Biol. 1990 Oct 5;215(3):403-10
2231712
Methods Mol Biol. 2007;396:95-110
18025688
Proc Natl Acad Sci U S A. 1990 Jul;87(14):5509-13
2196570
Nat Biotechnol. 2010 Nov;28(11):1181-5
21057489
Methods Mol Biol. 2007;406:89-112
18287689