Pangeo Forge: Crowdsourcing Analysis-Ready, Cloud Optimized Data Production

Autor: Charles Stern, Ryan Abernathey, Joseph Hamman, Rachel Wegener, Chiara Lepore, Sean Harkins, Alexander Merose
Jazyk: angličtina
Rok vydání: 2022
Předmět:
Zdroj: Frontiers in Climate, Vol 3 (2022)
Druh dokumentu: article
ISSN: 2624-9553
DOI: 10.3389/fclim.2021.782909
Popis: Pangeo Forge is a new community-driven platform that accelerates science by providing high-level recipe frameworks alongside cloud compute infrastructure for extracting data from provider archives, transforming it into analysis-ready, cloud-optimized (ARCO) data stores, and providing a human- and machine-readable catalog for browsing and loading. In abstracting the scientific domain logic of data recipes from cloud infrastructure concerns, Pangeo Forge aims to open a door for a broader community of scientists to participate in ARCO data production. A wholly open-source platform composed of multiple modular components, Pangeo Forge presents a foundation for the practice of reproducible, cloud-native, big-data ocean, weather, and climate science without relying on proprietary or cloud-vendor-specific tooling.
Databáze: Directory of Open Access Journals