Article in Proceedings INPROC-2009-94

BibliographyCipriani, Nazario; Eissele, Mike; Brodt, Andreas; Großmann, Matthias; Mitschang, Bernhard: NexusDS: A Flexible and Extensible Middleware for Distributed Stream Processing.
In: ACM (ed.): IDEAS '09: Proceedings of the 2008 International Symposium on Database Engineering & Applications.
University of Stuttgart : Collaborative Research Center SFB 627 (Nexus: World Models for Mobile Context-Based Systems).
pp. 152-161, english.
ACM, September 2009.
Article in Proceedings (Conference Paper).
CR-SchemaC.2 (Computer-Communication Networks)
C.5 (Computer System Implementation)
H.2 (Database Management)
KeywordsData Stream Processing; Stream Databases; Middleware Platforms for DataManagement; P2P and Networked DataManagement; Database Services and Applications
Abstract

ABSTRACT

Techniques for efficient and distributed processing of huge, unbound data streams have made some impact in the database community. Sensors and data sources, such as position data of moving objects, continuously produce data that is consumed, e.g., by location-aware applications. Depending on the domain of interest, e.g. visualization, the processing of such data often depends on domain-specific functionality. This functionality is specified in terms of dedicated operators that may require specialized hardware, e.g. GPUs. This creates a strong dependency which a data stream processing system must consider when deploying such operators. Many data stream processing systems have been presented so far. However, these systems assume homogeneous computing nodes, do not consider operator deployment constraints, and are not designed to address domain-specific needs.

In this paper, we identify necessary features that a exible and extensible middleware for distributed stream processing of context data must satisfy. We present NexusDS, our approach to achieve these requirements. In NexusDS, data processing is specified by orchestrating data flow graphs, which are modeled as processing pipelines of predefined and general operators as well as custom-built and domain-specific ones. We focus on easy extensibility and support for domain-specific operators and services that may even utilize specific hardware available on dedicated computing nodes

Department(s)University of Stuttgart, Institute of Parallel and Distributed Systems, Applications of Parallel and Distributed Systems
Project(s)SFB-627, B1 (University of Stuttgart, Institute of Parallel and Distributed Systems, Applications of Parallel and Distributed Systems)
Entry dateNovember 9, 2009