Kulla, a container-centric construction model for building infrastructure-agnostic distributed and parallel applications
| Autor: | Javier Garcia-Blas, Victor J. Sosa-Sosa, Hugo G. Reyes-Anastacio, J.L. Gonzalez-Compean, Jesus Carretero |
|---|---|
| Přispěvatelé: | Comunidad de Madrid, European Commission |
| Rok vydání: | 2020 |
| Předmět: |
Construction model
Dataflow Data parallelism Computer science Distributed computing Interoperability Task parallelism 02 engineering and technology Virtual containers Block (programming) 0502 economics and business 0202 electrical engineering electronic engineering information engineering Use case Parallel patterns Infrastructure-agnostic applications Pipelines Informática Recursion 05 social sciences 020207 software engineering Hardware and Architecture Parallel programming model Container (abstract data type) 050203 business & management Software Information Systems |
| Zdroj: | Journal of Systems and Software e-Archivo. Repositorio Institucional de la Universidad Carlos III de Madrid instname |
| ISSN: | 0164-1212 |
| DOI: | 10.1016/j.jss.2020.110665 |
| Popis: | This paper presents the design, development, and implementation of Kulla, a virtual container-centric construction model that mixes loosely coupled structures with a parallel programming model for building infrastructure-agnostic distributed and parallel applications. In Kulla, applications, dependencies and environment settings, are mapped with construction units called Kulla-Blocks. A parallel programming model enables developers to couple those interoperable structures for creating constructive structures named Kulla-Bricks. In these structures, continuous dataflow and parallel patterns can be created without modifying the code of applications. Methods such as Divide&Containerize (data parallelism), Pipe&Blocks (streaming), and Manager/Block (task parallelism) were developed to create Kulla-Bricks. Recursive combinations of Kulla instances can be grouped in deployment structures called Kulla-Boxes, which are encapsulated into VCs to create infrastructure-agnostic parallel and/or distributed applications. Deployment strategies were created for Kulla-Boxes to improve the IT resource profitability. To show the feasibility and flexibility of this model, solutions combining real-world applications were implemented by using Kulla instances to compose parallel and/or distributed system deployed on different IT infrastructures. An experimental evaluation based on use cases solving satellite and medical image processing problems revealed the efficiency of Kulla model in comparison with some traditional state-of-the-art solutions. This work has been partially supported by the EU project "ASPIDE: Exascale Programing Models for Extreme Data Processing" under grant 801091 and the project "CABAHLA-CM: Convergencia Big data-Hpc: de los sensores a las Aplicaciones" S2018/TCS-4423 from Madrid Regional Government . |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|
Full Text from ScienceDirect