Peer-to-peer storage engine for schemaless immutable data

Autor: Quenum, José Ghislain, Shipena, Alexander Brown
Zdroj: International Journal of Cloud Computing; 2021, Vol. 10 Issue: 1 p655-668, 14p
Abstrakt: We present TaYo, a peer-to-peer storage engine explicitly designed for immutable datawhich bypasses the file system during the storage. TaYo uses content-addressable storage (CAS) and Cuckoo hashing to generate a hash of the content that then serves as its identity. In TaYo, we have two I/O operations: read and write. To write data to TaYo, we split it into eight chunks, record the structure in a separate index and assign the chunks to worker processes that write concurrently. Each chunk is replicated twice. To read data, the client has to provide the identifier which the index uses to locate and re-assemble the chunks. TaYo uses a semi-activereplication technique, a blend of active and passive replication while storing the data. It uses a consensus protocol built on top of Raft to guarantee consistency among the replicas.
Databáze: Supplemental Index