title: A Run-time System for Efficient Execution of Scientific Workflows on Distributed Environments.
abstract: Scientific workflow systems have been introduced in response to the demand of researchers from several domains of science who need to process and analyze increasingly larger datasets. The design of these systems is largely based on the observation that data analysis applications can be composed as pipelines or networks of computations on data. In this work, we present a runtime support system that is designed to facilitate this type of computation in distributed computing environments. Our system is optimized for data-intensive workflows, in which efficient management and retrieval of data, coordination of data processing and data movement, and check-pointing of intermediate results are critical and challenging issues. Experimental evaluation of our system shows that linear speedups can be achieved for sophisticated applications, which are implemented as a network of multiple data processing components.
authors.affiliation: Department of Computer Science, Universidade Federal de Minas Gerais, 31270-010 Belo Horizonte, MG - Brazil, tel +55(31)3499-5860 - fax +55(31)3499-5858.
authors.forename: George
authors.initials: G
authors.lastname: Teodoro
authors.forename: Tulio
authors.initials: T
authors.lastname: Tavares
authors.forename: Renato
authors.initials: R
authors.lastname: Ferreira
authors.forename: Tahsin
authors.initials: T
authors.lastname: Kurc
authors.forename: Wagner
authors.initials: W
authors.lastname: Meira
authors.forename: Dorgival
authors.initials: D
authors.lastname: Guedes
authors.forename: Tony
authors.initials: T
authors.lastname: Pan
authors.forename: Joel
authors.initials: J
authors.lastname: Saltz