Octopus + : An RDMA-Enabled Distributed Persistent Memory File System

Autor:	Youmin Chen, Jiwu Shu, Zhu Bohong, Qing Wang, Youyou Lu
Rok vydání:	2021
Předmět:	File system Remote direct memory access biology Computer science business.industry computer.software_genre Networking hardware Octopus Hardware and Architecture biology.animal Computer data storage Operating system business computer
Zdroj:	ACM Transactions on Storage. 17:1-25
ISSN:	1553-3093 1553-3077
Popis:	Non-volatile memory and remote direct memory access (RDMA) provide extremely high performance in storage and network hardware. However, existing distributed file systems strictly isolate file system and network layers, and the heavy layered software designs leave high-speed hardware under-exploited. In this article, we propose an RDMA-enabled distributed persistent memory file system, Octopus + , to redesign file system internal mechanisms by closely coupling non-volatile memory and RDMA features. For data operations, Octopus + directly accesses a shared persistent memory pool to reduce memory copying overhead, and actively fetches and pushes data all in clients to rebalance the load between the server and network. For metadata operations, Octopus + introduces self-identified remote procedure calls for immediate notification between file systems and networking, and an efficient distributed transaction mechanism for consistency. Octopus + is enabled with replication feature to provide better availability. Evaluations on Intel Optane DC Persistent Memory Modules show that Octopus + achieves nearly the raw bandwidth for large I/Os and orders of magnitude better performance than existing distributed file systems.
Databáze:	OpenAIRE
Externí odkaz:	https://explore.openaire.eu/search/publication?articleId=doi_________::72f184fca35889e99c3ac35e31eb1959 https://doi.org/10.1145/3448418 Zobrazit plný text záznamu