Hierarchical resource allocation and consolidation framework in a multi-core server cluster using a Markov decision process model

Autor: Massoud Pedram, Shuang Chen, Yanzhi Wang, Pu Zhao, Xue Lin
Jazyk: angličtina
Rok vydání: 2017
Předmět:
lcsh:Computer engineering. Computer hardware
Linear programming
Computer Networks and Communications
Computer science
Distributed computing
Request–response
power aware computing
Real-time computing
request dispatch problem
Markov process
resource allocation
lcsh:TK7885-7895
02 engineering and technology
multicore server cluster
lcsh:QA75.5-76.95
symbols.namesake
continuous-time Markov decision process
Artificial Intelligence
Server
Computer cluster
joint optimisation framework
0202 electrical engineering
electronic engineering
information engineering

contracts
DVFS
linear programming-based CTMDP solving method
Electrical and Electronic Engineering
hierarchical resource allocation and consolidation framework
Frequency scaling
Markov processes
cloud computing
020206 networking & telecommunications
linear programming
service level agreements
request dispatching
020202 computer hardware & architecture
Computer Science Applications
multiprocessing systems
Service level
symbols
dynamic voltage and frequency scaling
Markov decision process
lcsh:Electronic computers. Computer science
SLA-based resource allocation problem
Information Systems
two-tier hierarchical solution
Zdroj: IET Cyber-Physical Systems (2017)
DOI: 10.1049/iet-cps.2017.0060
Popis: This paper investigates a service level agreements (SLAs)-based resource allocation problem in a server cluster. The objective is to maximise the total profit, which is the total revenue minus the operational cost of the server cluster. The total revenue depends on the average request response time, whereas the operating cost depends on the total energy consumption of the server cluster. A joint optimisation framework is proposed, comprised of request dispatching, dynamic voltage and frequency scaling (DVFS) for individual cores of the servers, as well as server- and core-level consolidations. Each DVFS-enabled core in the server cluster is modelled by using a continuous-time Markov decision process (CTMDP). A near-optimal solution comprised of a central manager and distributed local agents is presented. Each local agent employs linear programming-based CTMDP solving method to solve the DVFS problem for the corresponding core. On the other hand, the central manager solves the request dispatch problem and finds the optimal number of ON cores and servers, thereby achieving a desirable tradeoff between service response time and power consumption. To reduce the computational overhead, a two-tier hierarchical solution is utilized. Experimental results demonstrate the outstanding performance of the proposed algorithm over the baseline algorithms.
Databáze: OpenAIRE