Towards a Statistical Evaluation of PigLatin Joins
Autor: | M. Mogrovejo, Renato Javier, Monteiro, José Maria, C. Machado, Javam, M. Viana, Carlos Juliano, Lifschitz, Sérgio |
---|---|
Jazyk: | angličtina |
Rok vydání: | 2013 |
Předmět: | |
Zdroj: | Journal of Information and Data Management; Vol 4 No 3 (2013): SBBD 2013; 483 Journal of Information and Data Management; v. 4 n. 3 (2013): SBBD 2013; 483 Journal of Information and Data Management; v. 4, n. 3 (2013): SBBD 2013; 483 |
ISSN: | 2178-7107 |
Popis: | There are different scalable data management solutions which can take advantage of cloud features making them more attractive for a deployment in such environments. One of the most critical operations in data processing is joining large data sets. This is one of the most expensive and hardest operations to optimize. We are mainly concerned here with join operations expressed in PigLatin, an abstract query language for a high-level platform, called Pig, which creates MapReduce programs with Hadoop. In this work we explore statistical methods, namely multiple regression analysis, in order to predict three distinct join types execution times, comparing them with actual running times. |
Databáze: | OpenAIRE |
Externí odkaz: |