An Efficient Gear-shifting Power-proportional Distributed File System
| Autor: | Re-, Han, Le, Hieu Hanh, Hikida, Satoshi, Yokota, Haruo |
|---|---|
| Jazyk: | angličtina |
| Rok vydání: | 2015 |
| Předmět: |
Computer science
Distributed computing Computer file Device file computer.file_format Unix file types Virtual file system Replication (computing) Torrent file File Control Block Self-certifying File System Metadata management Versioning file system Network File System File area network SSH File Transfer Protocol Distributed File System computer File system fragmentation |
| Zdroj: | Lecture Notes in Computer Science ISBN: 9783319228518 DEXA (2) |
| Popis: | Recently, power-aware distributed file systems for efficient big data processing have increasingly moved toward power proportional designs. However, inefficient gear-shifting in such systems is an important issue that can seriously degrade their performance. To address this issue, we propose and evaluate an efficient gear-shifting power proportional distributed file system. The proposed system utilizes flexible data placement that reduces the amount of reflected data and has an architecture that improves the metadata management to achieve high-efficiency gear-shifting. Extensive empirical experiments using actual machines based on the HDFS demonstrated that the proposed system gains up to \(22\,\%\) better throughput-per-watt performance. Moreover, a suitable metadata management setting corresponding to the amount of data updated while in low gear is found from the experimental results. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|