Adding Workflow Management Flexibility to LSST Pipelines Execution

Autor: Gower, Michelle, Kowalik, Mikolaj, Lust, Nate B., Bosch, James F., Jenness, Tim

Data processing pipelines need to be executed at scales ranging from small runs up through large production data release runs resulting in millions of data products. As part of the Rubin Observatory's pipeline execution system, BPS is the abstraction

Externí odkaz: http://arxiv.org/abs/2211.15795

Abstracting the storage and retrieval of image data at the LSST

Autor: Jenness, Tim, Bosch, James F., Schellart, Pim, Lim, Kian-Ta, Salnikov, Andrei, Gower, Michelle

Writing generic data processing pipelines requires that the algorithmic code does not ever have to know about data formats of files, or the locations of those files. At LSST we have a software system known as "the Data Butler," that abstracts these d

Externí odkaz: http://arxiv.org/abs/1812.08085

LSST: from Science Drivers to Reference Design and Anticipated Data Products

Autor: Ivezić, Željko, Kahn, Steven M., Tyson, J. Anthony, Abel, Bob, Acosta, Emily, Allsman, Robyn, Alonso, David, AlSayyad, Yusra, Anderson, Scott F., Andrew, John, Angel, James Roger P., Angeli, George Z., Ansari, Reza, Antilogus, Pierre, Araujo, Constanza, Armstrong, Robert, Arndt, Kirk T., Astier, Pierre, Aubourg, Éric, Auza, Nicole, Axelrod, Tim S., Bard, Deborah J., Barr, Jeff D., Barrau, Aurelian, Bartlett, James G., Bauer, Amanda E., Bauman, Brian J., Baumont, Sylvain, Becker, Andrew C., Becla, Jacek, Beldica, Cristina, Bellavia, Steve, Bianco, Federica B., Biswas, Rahul, Blanc, Guillaume, Blazek, Jonathan, Blandford, Roger D., Bloom, Josh S., Bogart, Joanne, Bond, Tim W., Borgland, Anders W., Borne, Kirk, Bosch, James F., Boutigny, Dominique, Brackett, Craig A., Bradshaw, Andrew, Brandt, William Nielsen, Brown, Michael E., Bullock, James S., Burchat, Patricia, Burke, David L., Cagnoli, Gianpietro, Calabrese, Daniel, Callahan, Shawn, Callen, Alice L., Chandrasekharan, Srinivasan, Charles-Emerson, Glenaver, Chesley, Steve, Cheu, Elliott C., Chiang, Hsin-Fang, Chiang, James, Chirino, Carol, Chow, Derek, Ciardi, David R., Claver, Charles F., Cohen-Tanugi, Johann, Cockrum, Joseph J., Coles, Rebecca, Connolly, Andrew J., Cook, Kem H., Cooray, Asantha, Covey, Kevin R., Cribbs, Chris, Cui, Wei, Cutri, Roc, Daly, Philip N., Daniel, Scott F., Daruich, Felipe, Daubard, Guillaume, Daues, Greg, Dawson, William, Delgado, Francisco, Dellapenna, Alfred, de Peyster, Robert, de Val-Borro, Miguel, Digel, Seth W., Doherty, Peter, Dubois, Richard, Dubois-Felsmann, Gregory P., Durech, Josef, Economou, Frossie, Eracleous, Michael, Ferguson, Henry, Figueroa, Enrique, Fisher-Levine, Merlin, Focke, Warren, Foss, Michael D., Frank, James, Freemon, Michael D., Gangler, Emmanuel, Gawiser, Eric, Geary, John C., Gee, Perry, Geha, Marla, Gessner, Charles J. B., Gibson, Robert R., Gilmore, D. Kirk, Glanzman, Thomas, Glick, William, Goldina, Tatiana, Goldstein, Daniel A., Goodenow, Iain, Graham, Melissa L., Gressler, William J., Gris, Philippe, Guy, Leanne P., Guyonnet, Augustin, Haller, Gunther, Harris, Ron, Hascall, Patrick A., Haupt, Justine, Hernandez, Fabio, Herrmann, Sven, Hileman, Edward, Hoblitt, Joshua, Hodgson, John A., Hogan, Craig, Huang, Dajun, Huffer, Michael E., Ingraham, Patrick, Innes, Walter R., Jacoby, Suzanne H., Jain, Bhuvnesh, Jammes, Fabrice, Jee, James, Jenness, Tim, Jernigan, Garrett, Jevremović, Darko, Johns, Kenneth, Johnson, Anthony S., Johnson, Margaret W. G., Jones, R. Lynne, Juramy-Gilles, Claire, Jurić, Mario, Kalirai, Jason S., Kallivayalil, Nitya J., Kalmbach, Bryce, Kantor, Jeffrey P., Karst, Pierre, Kasliwal, Mansi M., Kelly, Heather, Kessler, Richard, Kinnison, Veronica, Kirkby, David, Knox, Lloyd, Kotov, Ivan V., Krabbendam, Victor L., Krughoff, K. Simon, Kubánek, Petr, Kuczewski, John, Kulkarni, Shri, Ku, John, Kurita, Nadine R., Lage, Craig S., Lambert, Ron, Lange, Travis, Langton, J. Brian, Guillou, Laurent Le, Levine, Deborah, Liang, Ming, Lim, Kian-Tat, Lintott, Chris J., Long, Kevin E., Lopez, Margaux, Lotz, Paul J., Lupton, Robert H., Lust, Nate B., MacArthur, Lauren A., Mahabal, Ashish, Mandelbaum, Rachel, Marsh, Darren S., Marshall, Philip J., Marshall, Stuart, May, Morgan, McKercher, Robert, McQueen, Michelle, Meyers, Joshua, Migliore, Myriam, Miller, Michelle, Mills, David J., Miraval, Connor, Moeyens, Joachim, Monet, David G., Moniez, Marc, Monkewitz, Serge, Montgomery, Christopher, Mueller, Fritz, Muller, Gary P., Arancibia, Freddy Muñoz, Neill, Douglas R., Newbry, Scott P., Nief, Jean-Yves, Nomerotski, Andrei, Nordby, Martin, O'Connor, Paul, Oliver, John, Olivier, Scot S., Olsen, Knut, O'Mullane, William, Ortiz, Sandra, Osier, Shawn, Owen, Russell E., Pain, Reynald, Palecek, Paul E., Parejko, John K., Parsons, James B., Pease, Nathan M., Peterson, J. Matt, Peterson, John R., Petravick, Donald L., Petrick, M. E. Libby, Petry, Cathy E., Pierfederici, Francesco, Pietrowicz, Stephen, Pike, Rob, Pinto, Philip A., Plante, Raymond, Plate, Stephen, Price, Paul A., Prouza, Michael, Radeka, Veljko, Rajagopal, Jayadev, Rasmussen, Andrew P., Regnault, Nicolas, Reil, Kevin A., Reiss, David J., Reuter, Michael A., Ridgway, Stephen T., Riot, Vincent J., Ritz, Steve, Robinson, Sean, Roby, William, Roodman, Aaron, Rosing, Wayne, Roucelle, Cecille, Rumore, Matthew R., Russo, Stefano, Saha, Abhijit, Sassolas, Benoit, Schalk, Terry L., Schellart, Pim, Schindler, Rafe H., Schmidt, Samuel, Schneider, Donald P., Schneider, Michael D., Schoening, William, Schumacher, German, Schwamb, Megan E., Sebag, Jacques, Selvy, Brian, Sembroski, Glenn H., Seppala, Lynn G., Serio, Andrew, Serrano, Eduardo, Shaw, Richard A., Shipsey, Ian, Sick, Jonathan, Silvestri, Nicole, Slater, Colin T., Smith, J. Allyn, Smith, R. Chris, Sobhani, Shahram, Soldahl, Christine, Storrie-Lombardi, Lisa, Stover, Edward, Strauss, Michael A., Street, Rachel A., Stubbs, Christopher W., Sullivan, Ian S., Sweeney, Donald, Swinbank, John D., Szalay, Alexander, Takacs, Peter, Tether, Stephen A., Thaler, Jon J., Thayer, John Gregg, Thomas, Sandrine, Thukral, Vaikunth, Tice, Jeffrey, Trilling, David E., Turri, Max, Van Berg, Richard, Berk, Daniel Vanden, Vetter, Kurt, Virieux, Francoise, Vucina, Tomislav, Wahl, William, Walkowicz, Lucianne, Walsh, Brian, Walter, Christopher W., Wang, Daniel L., Wang, Shin-Yawn, Warner, Michael, Wiecha, Oliver, Willman, Beth, Winters, Scott E., Wittman, David, Wolff, Sidney C., Wood-Vasey, W. Michael, Wu, Xiuqin, Xin, Bo, Yoachim, Peter, Zhan, Hu

(Abridged) We describe here the most ambitious survey currently planned in the optical, the Large Synoptic Survey Telescope (LSST). A vast array of science will be enabled by a single wide-deep-fast sky survey, and LSST will have unique survey capabi

Externí odkaz: http://arxiv.org/abs/0805.2366

The Vera C. Rubin Observatory Data Butler and pipeline execution system

Autor: Ibsen, Jorge, Chiozzi, Gianluca, Jenness, Tim, Bosch, James F., Salnikov, Andrei, Lust, Nate B., Pease, Nathan M., Gower, Michelle, Kowalik, Mikolaj, Dubois-Felsmann, Gregory P., Mueller, Fritz, Schellart, Pim

Publikováno v: Proceedings of SPIE; August 2022, Vol. 12189 Issue: 1 p1218911-1218911-14