Multi-threaded compression of Earth observation time-series data

Autor:	D. Swanepoel, F. van den Bergh
Jazyk:	angličtina
Rok vydání:	2017
Předmět:	data compression multi-threading time-series hdf hdf5 modis Mathematical geography. Cartography GA1-1776
Zdroj:	International Journal of Digital Earth, Vol 10, Iss 12, Pp 1214-1230 (2017)
Druh dokumentu:	article
ISSN:	1753-8947 1753-8955 17538947
DOI:	10.1080/17538947.2017.1301580
Popis:	Earth observation data are typically compressed using general-purpose single-threaded compression algorithms that operate at a fraction of the bandwidth of modern storage and processing systems. We present evidence that recently developed multi-threaded compression codecs offer substantial benefits over widely used single-threaded codecs in terms of compression efficiency when applied to a selection of moderate resolution imaging spectroradiometer (MODIS) datasets stored in the HDF5 format. Compression codecs from the LZ77 and Rice families are shown to vary in efficacy when applied to different MODIS data products, highlighting the need for compression strategies to be tailored to different classes of data. We also introduce LPC-Rice, a new multi-threaded codec, that performs particularly well when applied to time-series data.
Databáze:	Directory of Open Access Journals
Externí odkaz:	https://doaj.org/article/b0de4ea25afc4632b7a506dfc8f7cea7 Zobrazit plný text záznamu View record in DOAJ Plný text ve formátu PDF Plný text ve formátu HTML
Nepřihlášeným uživatelům se plný text nezobrazuje	K zobrazení výsledku je třeba se přihlásit.