OctopusFS in action
| Autor: | Nikolaos D. Karmiris, Elena Kakoulli, Herodotos Herodotou |
|---|---|
| Rok vydání: | 2018 |
| Předmět: |
Computer science
Distributed computing Interface (computing) General Engineering 02 engineering and technology Directory Storage management Action (philosophy) 020204 information systems Spark (mathematics) Data_FILES 0202 electrical engineering electronic engineering information engineering Data-intensive computing Distributed File System |
| Zdroj: | Proceedings of the VLDB Endowment. 11:1914-1917 |
| ISSN: | 2150-8097 |
| DOI: | 10.14778/3229863.3236223 |
| Popis: | The continuous improvements in memory, storage devices, and network technologies of commodity hardware introduce new challenges and opportunities in tiered storage management. Whereas past work is exploiting storage tiers in pairs or for specific applications, OctopusFS---a novel distributed file system that is aware of the underlying storage media---offers a comprehensive solution to managing multiple storage tiers in a distributed setting. OctopusFS contains auto-mated data-driven policies for managing the placement and retrieval of data across the nodes and storage tiers of the cluster. It also exposes the network locations and storage tiers of the data in order to allow higher-level systems to make locality-aware and tier-aware decisions. This demonstration will showcase the web interface of OctopusFS, which enables users to (i) view detailed utilization information for the various storage tiers and nodes, (ii) browse the directory namespace and perform file-related actions, and (iii) execute caching-related operations while observing their performance impact on MapReduce and Spark workloads. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|