Transparent Data Access for Scientific Workflows Across Clouds
| Autor: | Renata Slota, Jacek Kitowski, Łukasz Dutka, Michal Orzechowski, Bartosz Baliś |
|---|---|
| Rok vydání: | 2020 |
| Předmět: |
Database
Computer science business.industry Data management 020206 networking & telecommunications 02 engineering and technology computer.software_genre Workflow Data access 0202 electrical engineering electronic engineering information engineering 020201 artificial intelligence & image processing business computer Workflow management system |
| Zdroj: | Euro-Par 2019: Parallel Processing Workshops ISBN: 9783030483395 Euro-Par Workshops |
| Popis: | We present a scientific workflow data management solution that combines global data access with a block-level optimization of data transfer, wherein only the data blocks that are used by a remote job are transferred over the network, significantly reducing data movement for specific common data access patterns. We propose the implementation of the solution based on the HyperFlow workflow management system and the Onedata data management platform. Preliminary results confirm the advantages of the proposed solution. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|