Data stream treatment using sliding windows with MapReduce
| Autor: | María José Basgall, Waldo Hasperué, Marcelo Naiouf |
|---|---|
| Jazyk: | angličtina |
| Rok vydání: | 2016 |
| Předmět: | |
| Zdroj: | Journal of Computer Science and Technology, Vol 16, Iss 02, Pp 76-83 (2016) |
| Druh dokumentu: | article |
| ISSN: | 1666-6046 1666-6038 |
| Popis: | Knowledge Discovery in Databases (KDD) techniques present limitations when the volume of data to process is very large. Any KDD algorithm needs to do several iterations on the complete set of data in order to carry out its work. For continuous data stream processing it is necessary to store part of it in a temporal window. In this paper, we present a technique that uses the size of the temporal window in a dynamic way, based on the frequency of the data arrival and the response time of the KDD task. The obtained results show that this technique reaches a great size window where each example of the stream is used in more than one iteration of the KDD task. |
| Databáze: | Directory of Open Access Journals |
| Externí odkaz: |
|