Design, Implementation, and Evaluation of a NUMA-Aware Cache for iSCSI Storage Servers
| Autor: | Dantong Yu, Shudong Jin, Yufei Ren, Thomas G. Robertazzi, Tan Li |
|---|---|
| Rok vydání: | 2015 |
| Předmět: |
Remote direct memory access
Computer science Cache coloring CPU cache Thread (computing) Cache pollution computer.software_genre Instruction set Storage area network Non-uniform memory access HyperSCSI Server Latency (engineering) Multicore architecture Hardware_MEMORYSTRUCTURES business.industry Cache-only memory architecture Uniform memory access Computational Theory and Mathematics Hardware and Architecture Signal Processing Operating system Page cache iSCSI Cache business computer Computer network |
| Zdroj: | IEEE Transactions on Parallel and Distributed Systems. 26:413-422 |
| ISSN: | 1045-9219 |
| DOI: | 10.1109/tpds.2014.2311817 |
| Popis: | In an iSCSI based storage area network, target hosts serve concurrent I/O requests from initiators to achieve both high throughput and low latency. Existing iSCSI leverages the OS page cache to ensure data sharing and reuse. However, the non-uniform memory access (NUMA) architecture introduces another dimension of complexity, i.e., asymmetric memory access in multi-core and many-core platforms. Within a NUMA platform, an iSCSI target often dispatches an access request with a cache hit to an I/O thread remote to cached data, and thus cannot fully utilize multi-core systems. We encounter this problem in the context of ultra high-speed data transfer between two iSCSI storage systems, during which inferior NUMA remote memory access lags behind available high network bandwidth, and thereby becomes a bottleneck of the entire end-to-end data transfer path. We design a NUMA-aware cache mechanism to align cache memory with local NUMA nodes and threads, and then schedule I/O requests to those threads that are local to the data being accessed. This NUMA-aware solution results in lower access latency and higher system throughput. We implement a cache system within the Linux SCSI target framework, and evaluated it on our NUMA-based iSCSI testbed. Experimental results show the NUMA-aware cache can significantly improve the performance of iSCSI as measured by several benchmark tools and confirm its viability in data intensive applications and real-life workloads. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|