Concept and benchmark results for Big Data energy forecasting based on Apache Spark

Autor: Jorge Ángel González Ordiano, Andreas Bartschat, Nicole Ludwig, Eric Braun, Simon Waczowicz, Nicolas Renkamp, Nico Peter, Clemens Düpmeier, Ralf Mikut, Veit Hagenmeyer
Jazyk: angličtina
Rok vydání: 2018
Předmět:
Zdroj: Journal of Big Data, Vol 5, Iss 1, Pp 1-11 (2018)
Druh dokumentu: article
ISSN: 2196-1115
DOI: 10.1186/s40537-018-0119-6
Popis: Abstract The present article describes a concept for the creation and application of energy forecasting models in a distributed environment. Additionally, a benchmark comparing the time required for the training and application of data-driven forecasting models on a single computer and a computing cluster is presented. This comparison is based on a simulated dataset and both R and Apache Spark are used. Furthermore, the obtained results show certain points in which the utilization of distributed computing based on Spark may be advantageous.
Databáze: Directory of Open Access Journals