Towards a Statistical Evaluation of PigLatin Joins

Autor: M. Mogrovejo, Renato Javier, Monteiro, José Maria, C. Machado, Javam, M. Viana, Carlos Juliano, Lifschitz, Sérgio
Jazyk: angličtina
Rok vydání: 2013
Předmět:
Zdroj: Journal of Information and Data Management; Vol 4 No 3 (2013): SBBD 2013; 483
Journal of Information and Data Management; v. 4 n. 3 (2013): SBBD 2013; 483
Journal of Information and Data Management; v. 4, n. 3 (2013): SBBD 2013; 483
ISSN: 2178-7107
Popis: There are different scalable data management solutions which can take advantage of cloud features making them more attractive for a deployment in such environments. One of the most critical operations in data processing is joining large data sets. This is one of the most expensive and hardest operations to optimize. We are mainly concerned here with join operations expressed in PigLatin, an abstract query language for a high-level platform, called Pig, which creates MapReduce programs with Hadoop. In this work we explore statistical methods, namely multiple regression analysis, in order to predict three distinct join types execution times, comparing them with actual running times.
Databáze: OpenAIRE