From a stream of relational queries to distributed stream processing

Autor: Henrique Andrade, Robert Soulé, Huayong Wang, Kun-Lung Wu, Buǧra Gedik, Qiong Zou, Martin Hirzel
Rok vydání: 2010
Předmět:
Zdroj: Proceedings of the VLDB Endowment. 3:1394-1405
ISSN: 2150-8097
Popis: Applications from several domains are now being written to process live data originating from hardware and software-based streaming sources. Many of these applications have been written relying solely on database and data warehouse technologies, despite their lack of need for transactional support and ACID properties. In several extreme high-load cases, this approach does not scale to the processing speeds that these applications demand. In this paper we demonstrate an application acceleration approach whereby a regular ODBC-based application is converted into a true streaming application with minimal disruption from a software engineering standpoint. We showcase our approach on three real-world applications. We experimentally demonstrate the substantial performance improvements that can be observed when contrasting the accelerated implementation with the original database-oriented implementation.
Databáze: OpenAIRE