Approaches to distributed execution of scientific workflows in Kepler
| Autor: | Yann Frauel, Paweł Ciecieląg, Ilkay Altintas, Isabel Campos Plasencia, Marcin Plociennik, David Abramson, Jianwu Wang, Frederic Imbeaux, Tomasz Żok, Michal Owsiak, Wojciech Pych, Daniel Crawl, B. Guillerminet, M. López-Caniego, Bartek Palak |
|---|---|
| Přispěvatelé: | European Commission, European Atomic Energy Community, Commissariat à l'Ènergie Atomique et aux Ènergies Alternatives (France), Ministry of Science and Higher Education (Poland), Ministerio de Economía y Competitividad (España), National Science Foundation (US) |
| Rok vydání: | 2013 |
| Předmět: |
020203 distributed computing
Distributed execution Algebra and Number Theory business.industry Computer science Distributed computing Scientific workflow Cloud computing 02 engineering and technology computer.file_format Grid Kepler Kepler scientific workflow system Theoretical Computer Science Workflow Computational Theory and Mathematics 0202 electrical engineering electronic engineering information engineering 020201 artificial intelligence & image processing Nimrod Executable business computer Information Systems |
| Zdroj: | Digital.CSIC. Repositorio Institucional del CSIC instname |
| Popis: | et al. The Kepler scientific workflow system enables creation, execution and sharing of workflows across a broad range of scientific and engineering disciplines while also facilitating remote and distributed execution of workflows. In this paper, we present and compare different approaches to distributed execution of workflows using the Kepler environment, including a distributed data-parallel framework using Hadoop and Stratosphere, and Cloud and Grid execution using Serpens, Nimrod/K and Globus actors. We also present real-life applications in computational chemistry, bioinformatics and computational physics to demonstrate the usage of different distributed computing capabilities of Kepler in executable workflows. We further analyze the differences of each approach and provide a guidance for their applications. The research leading to these results has received funding from different projects and funding schema, including: the European Community’s Seventh Framework Programme under grant agreement RI-261323 (EGI-InsPIRE), the European Communities under the contracts of Association between EURATOM and CEA, IPPLM, carried out within the framework of the Task Force on Integrated Tokamak Modeling of the EFDA, the Polish project PLGrid Plus under the contract POIG 02.03.00-00-096/10, NSF ABI Award DBI-1062565 for bioKepler, partial financial support from the Spanish Ministerio de Economia y Competitividad AYA 2010-21766-C03-01 and Consolider Ingenio 2010 CSD2010-00064 projects, and from the Juan de la Cierva programme. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|