Write a Blog >>

Distributed Complex Event Processing has emerged as a well-established paradigm to detect situations of interest from basic sensor streams, building an operator graph between sensors and applications. In order to detect event patterns that correspond to situations of interest, each operator correlates events on its incoming streams according to a sliding window mechanism. To increase the throughput of an operator, different windows can be assigned to different operator instances—i.e., identical operator copies—which process them in parallel. This implies that events that are part of multiple overlapping windows are replicated to different operator instances. The communication overhead of replicating the events can be reduced by assigning overlapping windows to the same operator instance. However, this imposes a higher processing load on the single operator instance, possibly overloading it. In this paper, we address the trade-off between processing load and communication overhead when assigning overlapping windows to a single operator instance. Controlling the trade-off is challenging and cannot be solved with traditional reactive methods. To this end, we propose a model-based batch scheduling controller building on prediction. Evaluations show that our approach is able to significantly save bandwidth, while keeping a user-defined latency bound in the operator instances.

Wed 21 Jun

Displayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change

11:00 - 12:30
Session 2: High Performance and DistributionDEBS Research Papers at Sala d'Actes, Vertex Building
Chair(s): Guido Salvaneschi TU Darmstadt
11:00
25m
Talk
Minimizing Communication Overhead in Window-Based Parallel Complex Event Processing. (Research Paper)
DEBS Research Papers
Ruben Mayer University of Stuttgart, Muhammad Adnan Tariq University of Stuttgart, Kurt Rothermel Universitaet Stuttgart
11:25
25m
Talk
Low-Latency Sliding-Window Aggregation in Worst-Case Constant Time. (Research Paper)
DEBS Research Papers
Kanat Tangwongsan Mahidol University International College, Martin Hirzel IBM Research, Scott Schneider IBM Research
11:50
20m
Talk
Hardware Accelerated Application Integration Processing. (Industry Paper)
DEBS Research Papers
Daniel Ritter SAP SE, Jonas Dann SAP SE, Norman May SAP SE, Stefanie Rinderle-Ma University of Vienna
12:10
20m
Talk
Chronograph—A Distributed Processing Platform for Online and Batch Computations on Event-sourced Graphs. (Experience Paper)
DEBS Research Papers
Benjamin Erb Ulm University, Germany , Echo Meißner Institute of Distributed Systems, Ulm University, Jakob Pietron Ulm University, Frank Kargl Ulm University