One SQL to Rule Them All - an Efficient and Syntactically Idiomatic Approach to Management of Streams and Tables
| Autor: | Fabian Hueske, Tyler Akidau, Kenneth Knowles, Julian Hyde, Kathryn Knight, Edmon Begoli |
|---|---|
| Rok vydání: | 2019 |
| Předmět: |
SQL
Syntax (programming languages) Computer science business.industry Programming language Semantics (computer science) Event (computing) Data management 02 engineering and technology computer.software_genre Set (abstract data type) Stream processing 020204 information systems 0202 electrical engineering electronic engineering information engineering 020201 artificial intelligence & image processing Timestamp business computer computer.programming_language |
| Zdroj: | SIGMOD Conference |
| DOI: | 10.1145/3299869.3314040 |
| Popis: | Real-time data analysis and management are increasingly critical for today's businesses. SQL is the de facto lingua franca for these endeavors, yet support for robust streaming analysis and management with SQL remains limited. Many approaches restrict semantics to a reduced subset of features and/or require a suite of non-standard constructs. Additionally, use of event timestamps to provide native support for analyzing events according to when they actually occurred is not pervasive, and often comes with important limitations. We present a three-part proposal for integrating robust streaming into SQL, namely: (1) time-varying relations as a foundation for classical tables as well as streaming data, (2) event time semantics, (3) a limited set of optional keyword extensions to control the materialization of time-varying query results. We show how with these minimal additions it is possible to utilize the complete suite of standard SQL semantics to perform robust stream processing. We motivate and illustrate these concepts using examples and describe lessons learned from implementations in Apache Calcite, Apache Flink, and Apache Beam. We conclude with syntax and semantics of a concrete proposal for extensions of the SQL standard and note further areas of exploration. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|