Evaluating Replication for Parallel Jobs: An Efficient Approach
| Autor: | Zhan Qiu, Juan F. Perez |
|---|---|
| Rok vydání: | 2016 |
| Předmět: |
020203 distributed computing
Computer science business.industry Distributed computing Replica Quality of service Reliability (computer networking) Cloud computing 02 engineering and technology Grid Replication (computing) Computational Theory and Mathematics Hardware and Architecture 020204 information systems Server Signal Processing 0202 electrical engineering electronic engineering information engineering business Computer network |
| Zdroj: | IEEE Transactions on Parallel and Distributed Systems. 27:2288-2302 |
| ISSN: | 1045-9219 |
| DOI: | 10.1109/tpds.2015.2496593 |
| Popis: | Many modern software applications rely on parallel job processing to exploit large resource pools available in cloud and grid infrastructures. The response time of a parallel job, made of many subtasks, is determined by the last subtask that finishes. Thus, a single laggard subtask or a failure, requiring re-processing, may increase the response time substantially. To overcome these issues, we explore concurrent replication with canceling. This mechanism executes two job replicas concurrently, and retrieves the result of the first replica that completes, immediately canceling the other one. To analyze this mechanism we propose a stochastic model that considers replication at both job-level and task-level. We find that task-level replication achieves a much higher reliability and shorter response times than job-level replication. We also observe that the impact of replication depends on the system utilization, the subtask reliability, and the correlation among replica failures. Based on the model, we propose a resource-provisioning strategy that determines the minimum number of computing nodes needed to achieve a service-level objective (SLO) defined as a response-time percentile. This strategy is evaluated by considering realistic traffic patterns from a parallel cluster, where task-level replication shows the potential to reduce the resource requirements for tight response-time SLOs. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|