Embedding an Extra Layer of Data Compression Scheme for Efficient Management of Big-Data

Autor: Suvajit Majumder, Sayan Pal, Amit Kr. Gupta, Indranil Das, Indrajit Bhattacharya
Rok vydání: 2015
Předmět:
Zdroj: Advances in Intelligent Systems and Computing ISBN: 9788132222460
DOI: 10.1007/978-81-322-2247-7_71
Popis: Use of Smartphone as mobile nodes in different communication infrastructures is excessively explored in recent years. Such smart phones can be considered as a good candidate for situations like Disaster Management, where there is no infrastructure available to support communication and connectivity among the group members is a prime objective. Disaster rescue operations are generally based on location intensive operations including neighboring nodes’ locations and their availability. The storage limitations of such devices ask for suitable strategies to store information efficiently. In this work, a method has been proposed that employs an extra layer of compression, while storing location data in the form of latitude-longitude (lat-long) pairs, to the HBase database. Location data in a mobile network is big-data, as continuous collection of such information adds numerous data inputs. By incurring a negligible overhead on the system in the form of small encoding and decoding time, the proposed method obtains almost 70 % compression ratio, even for thousands of input data. In this work Huffman lossless encoding scheme has been used.
Databáze: OpenAIRE