Time-critical data management in clouds: challenges and a Dynamic Real-time Infrastructure Planner (DRIP) solution
| Autor: | Baptiste Grenier, Junchao Wang, Huan Zhou, Jani Heikkinen, Spiros Koulouzis, Paul Martin, Zhiming Zhao, Cees de Laat, Yang Hu, Thierry Carval |
|---|---|
| Přispěvatelé: | System and Network Engineering (IVI, FNWI) |
| Jazyk: | angličtina |
| Rok vydání: | 2020 |
| Předmět: |
Service (systems architecture)
Service quality time-critical services Computer Networks and Communications business.industry Computer science Data management 020206 networking & telecommunications Cloud computing 02 engineering and technology Infrastructure optimization Data science Computer Science Applications Theoretical Computer Science virtual research environment Computational Theory and Mathematics 13. Climate action research infrastructure 0202 electrical engineering electronic engineering information engineering 020201 artificial intelligence & image processing Data as a service business Dynamic Real-Time Infrastructure Planner e-infrastructure Software |
| Zdroj: | Concurrency And Computation-practice & Experience (1532-0626) (Wiley), 2020-08, Vol. 32, N. 16, P. e5269 (17p.) Concurrency and Computation: Practice and Experience Concurrency and Computation: Practice and Experience, 32(16):e5269. John Wiley and Sons Ltd |
| ISSN: | 1532-0634 1532-0626 |
| DOI: | 10.1002/cpe.5269 |
| Popis: | The increasing volume of data being produced, curated, and made available by research infrastructures in the environmental science domain require services that are able to optimize the delivery and staging of data for researchers and other users of scientific data. Specialized data services for managing data life cycle, for creating and delivering data products, and for customized data processing and analysis all play a crucial role in how these research infrastructures serve their communities, and many of these activities are time‐critical—needing to be carried out frequently within specific time windows. We describe our experiences identifying the time‐critical requirements of environmental scientists making use of computational research support environments. We present a microservice‐based infrastructure optimization suite, the Dynamic Real‐Time Infrastructure Planner, used for constructing virtual infrastructures for research applications on demand. We provide a case study whereby our suite is used to optimize runtime service quality for a data subscription service provided by the Euro‐Argo using EGI Federated Cloud and EUDAT's B2SAFE services, and to consider how such a case study relates to other application scenarios. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|
Plný text