Article in Proceedings INPROC-2021-05

BibliographyGiebler, Corinna; Gröger, Christoph; Hoos, Eva; Eichler, Rebecca; Schwarz, Holger; Mitschang, Bernhard: The Data Lake Architecture Framework.
In: Datenbanksysteme für Business, Technologie und Web (BTW 2021), 19. Fachtagung des GI-Fachbereichs Datenbanken und Informationssysteme (DBIS), 13.-17. September 2021, Dresden, Germany.
University of Stuttgart, Faculty of Computer Science, Electrical Engineering, and Information Technology.
pp. 351-370, english.
Gesellschaft für Informatik, September 17, 2021.
DOI: 10.18420/btw2021-19.
Article in Proceedings (Conference Paper).
CR-SchemaH.4 (Information Systems Applications)
Abstract

During recent years, data lakes emerged as a way to manage large amounts of heterogeneous data for modern data analytics. Although various work on individual aspects of data lakes exists, there is no comprehensive data lake architecture yet. Concepts that describe themselves as a “data lake architecture†are only partial. In this work, we introduce the data lake architecture framework. It supports the definition of data lake architectures by defining nine architectural aspects, i.e., perspectives on a data lake, such as data storage or data modeling, and by exploring the interdependencies between these aspects. The included methodology helps to choose appropriate concepts to instantiate each aspect. To evaluate the framework, we use it to configure an exemplary data lake architecture for a real-world data lake implementation. This final assessment shows that our framework provides comprehensive guidance in the configuration of a data lake architecture.

Department(s)University of Stuttgart, Institute of Parallel and Distributed Systems, Applications of Parallel and Distributed Systems
Entry dateAugust 13, 2021
   Publ. Institute   Publ. Computer Science