Delivering data reduction pipelines to science users
| Autor: | Wolfram Freudling, Martino Romaniello |
|---|---|
| Rok vydání: | 2016 |
| Předmět: |
0209 industrial biotechnology
Database Computer science 02 engineering and technology computer.software_genre 01 natural sciences Visualization Reduction (complexity) Tree (data structure) 020901 industrial engineering & automation Workflow 0103 physical sciences Representation (mathematics) 010303 astronomy & astrophysics computer Data reduction |
| Zdroj: | Observatory Operations: Strategies, Processes, and Systems VI. |
| ISSN: | 0277-786X |
| DOI: | 10.1117/12.2232734 |
| Popis: | The European Southern Observatory has a long history of providing specialized data processing algorithms, called recipes, for most of its instruments. These recipes are used for both operational purposes at the observatory sites, and for data reduction by the scientists at their home institutions. The two applications require substantially different environments for running and controlling the recipes. In this papers, we describe the ESOReflex environment that is used for running recipes on the users’ desktops. ESOReflex is a workflow driven data reduction environment. It allows intuitive representation, execution and modification of the data reduction workflow, and has facilities for inspection of and interaction with the data. It includes fully automatic data organization and visualization, interaction with recipes, and the exploration of the provenance tree of intermediate and final data products. ESOReflex uses a number of innovative concepts that have been described in Ref. 1. In October 2015, the complete system was released to the public. ESOReflex allows highly efficient data reduction, using its internal bookkeeping database to recognize and skip previously completed steps during repeated processing of the same or similar data sets. It has been widely adopted by the science community for the reduction of VLT data. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|