Analysis of NVMe over fabrics with SCinet DTN-as-a-Service

Autor: Xiao Wang, Jim Chen, Se-young Yu, Fei Yeh, Anna Giannakou, Marc Lyonnais, Joe Mambretti, Eric Pouyoul
Rok vydání: 2021
Předmět:
Zdroj: Cluster Computing. 25:2991-3003
ISSN: 1573-7543
1386-7857
DOI: 10.1007/s10586-021-03433-x
Popis: Supporting transfers of science big data over Wide Area Networks (WANs) with Data Transfer Nodes (DTNs) requires optimizing multiple parameters within the underlying infrastructure. New solutions for such data movement require new paradigms and technologies, such as NVMe over Fabrics, which provides high-performance data movement with direct remote NVMe device access over traditional fabrics. However, recent NVMe over Fabrics studies have been limited to local storage fabrics. To support increasing demands for the large volume of science data movement during Supercomputing (SC) conferences, we proposed a SCinet DTN-as-a-Service framework orchestrating the desired optimization to meet users, applications, and providers’ requirements. Furthermore, we extend the SCinet DTN-as-a-Service framework to incorporate new techniques, solve optimization issues in data-intensive science and evaluate NVMe over Fabrics with multiple WAN testbeds to examine its performance and discover new opportunities for optimization.
Databáze: OpenAIRE