Efficient and Flexible Hierarchical Data Layouts for a Unified Encoding of Scalar Field Precision and Resolution
| Autor: | Valerio Pascucci, Peer-Timo Bremer, Pavol Klacansky, Harsh Bhatia, Will Usher, Duong Hoang, Brian Summa, Peter Lindstrom |
|---|---|
| Rok vydání: | 2021 |
| Předmět: |
Computer science
Scalar (mathematics) 020207 software engineering 02 engineering and technology computer.file_format Terabyte External Data Representation Computer Graphics and Computer-Aided Design Hierarchical database model Data modeling Data set Data quality Signal Processing JPEG 2000 0202 electrical engineering electronic engineering information engineering Computer Vision and Pattern Recognition Algorithm computer Scalar field Software |
| Zdroj: | IEEE Transactions on Visualization and Computer Graphics. 27:603-613 |
| ISSN: | 2160-9306 1077-2626 |
| Popis: | To address the problem of ever-growing scientific data sizes making data movement a major hindrance to analysis, we introduce a novel encoding for scalar fields: a unified tree of resolution and precision, specifically constructed so that valid cuts correspond to sensible approximations of the original field in the precision-resolution space. Furthermore, we introduce a highly flexible encoding of such trees that forms a parameterized family of data hierarchies. We discuss how different parameter choices lead to different trade-offs in practice, and show how specific choices result in known data representation schemes such as zfp [52] , idx [58] , and jpeg 2000 [76] . Finally, we provide system-level details and empirical evidence on how such hierarchies facilitate common approximate queries with minimal data movement and time, using real-world data sets ranging from a few gigabytes to nearly a terabyte in size. Experiments suggest that our new strategy of combining reductions in resolution and precision is competitive with state-of-the-art compression techniques with respect to data quality, while being significantly more flexible and orders of magnitude faster, and requiring significantly reduced resources. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|