Globus Automation Services: Research Process Automation Across the Space-Time Continuum

Autor: Ananthakrishnan,Rachana, Bottigliero, Joe, Bryan, Josh, Chard, Kyle, Chard, Ryan, Foster, Ian, Lewis, Jake, McKee, Kurt, Nikolaidis, Ada, Pruyne, Jim, Raumann, Brigitte, Rosen, Stephen, Ur, Blase, Wang, Lei
Rok vydání: 2022
DOI: 10.5281/zenodo.6878902
Popis: Automation is increasingly important within scientific research in order to enhance reliability, productivity, and reproducibility. To address the specialized needs of research resources and activities, we have developed a new set of automation services within the Globus research data management platform for executing what we call flows: sequences of actions triggered by external events. These Globus automation services feature, in particular: 1) cloud hosting for reliable execution of even long-lived flows despite episodic failures; 2) an extensible asynchronous action provider API for invoking arbitrary actions, including action providers for Globus Transfer and funcX supporting interactions with different storage systems and compute platforms, respectively; and 3) integration with the Globus Auth identity and access management service for secure invocation of actions on remote resources. Together, these methods permit researchers to outsource and automate the management of a broad range of research tasks to a reliable, scalable, and secure cloud platform.
NSF 1835890
Databáze: OpenAIRE