A new end-to-end workflow for the Community Earth System Model (version 2.0) for the Coupled Model Intercomparison Project Phase 6 (CMIP6)
Autor: | Eric Nienhouse, Alice Bertini, Gary Strand, John M. Dennis, Kevin Paul, Mariana Vertenstein, Sheri Mickelson |
---|---|
Rok vydání: | 2020 |
Předmět: |
Coupled model intercomparison project
Speedup 010504 meteorology & atmospheric sciences business.industry Computer science lcsh:QE1-996.5 Volume (computing) 02 engineering and technology 01 natural sciences lcsh:Geology Uncompressed video Software Workflow End-to-end principle 0202 electrical engineering electronic engineering information engineering 020201 artificial intelligence & image processing Software engineering business Publication 0105 earth and related environmental sciences |
Zdroj: | Geoscientific Model Development, Vol 13, Pp 5567-5581 (2020) |
ISSN: | 1991-9603 |
DOI: | 10.5194/gmd-13-5567-2020 |
Popis: | The complexity of each Coupled Model Intercomparison Project grows with every new generation. The Phase 5 effort saw a dramatic increase in the number of experiments that were performed and the number of variables that were requested compared to its previous generation, Phase 3. The large increase in data volume stressed the resources of several centers including at the National Center for Atmospheric Research. During Phase 5, we missed several deadlines and we struggled to get the data out to the community for analysis. In preparation for the current generation, Phase 6, we examined the weaknesses in our workflow and addressed the performance issues with new software tools. Through this investment, we were able to publish approximately 565 TB of compressed data to the community, with another 30 TB yet to be published. When compared to the volumes we produced in the previous generation, 165 TB of uncompressed data, we were able to provide 6 times the amount of data and we accomplish this within one-third of the time. This provided us with an approximate 18 times faster speedup. While this paper discusses the improvements we have made to our own workflow for the Coupled Model Intercomparison Project Phase 6 (CMIP6), we hope to encourage other centers to evaluate and invest in their own workflows in order to be successful in these types of modeling campaigns. |
Databáze: | OpenAIRE |
Externí odkaz: | |
Nepřihlášeným uživatelům se plný text nezobrazuje | K zobrazení výsledku je třeba se přihlásit. |