Article in Proceedings INPROC-2019-25

BibliographySlo, Ahmad; Bhowmik, Sukanya; Rothermel, Kurt: eSPICE: Probabilistic Load Shedding from Input Event Streams in Complex Event Processing.
In: Proceedings of Middleware '19: 20th International Middleware Conference (Middleware '19) Dec 08-13 2019. Davis, CA, USA . ACM, New York, NY, USA.
University of Stuttgart, Faculty of Computer Science, Electrical Engineering, and Information Technology.
pp. 1-13, english.
ACM Press, December 8, 2019.
Article in Proceedings (Conference Paper).
CR-SchemaH.3.4 (Information Storage and Retrieval Systems and Software)
KeywordsComplex Event Processing; Stream Processing; Load Shedding; Approximate Computing; latency bound; QoS
Abstract

Complex event processing systems process the input event streams on-the-fly. Since input event rate could overshoot the system’s capabilities and results in violating a defined latency bound, load shedding is used to drop a portion of the input event streams. The crucial question here is how many and which events to drop so the defined latency bound is maintained and the degradation in the quality of results is minimized. In stream processing domain, different load shedding strategies have been proposed but they mainly depend on the importance of individual tuples (events). However, as complex event processing systems perform pattern detection, the importance of events is also influenced by other events in the same pattern. In this paper, we propose a load shedding framework called eSPICE for complex event processing systems. eSPICE depends on building a probabilistic model that learns about the importance of events in a window. The position of an event in a window and its type are used as features to build the model. Further, we provide algorithms to decide when to start dropping events and how many events to drop. Moreover, we extensively evaluate the performance of eSPICE on two real-world datasets.

Full text and
other links
PDF (1092009 Bytes)
CopyrightThis is the author's version of the work. It is posted here by permission of ACM for your personal use. Not for redistribution. The definitive version will be published in the Proceedings of ACM Middleware 2019
Contactahmad.slo@ipvs.uni-stuttgart.de
Department(s)University of Stuttgart, Institute of Parallel and Distributed Systems, Distributed Systems
Entry dateNovember 12, 2019
   Publ. Department   Publ. Institute   Publ. Computer Science