Article in Proceedings INPROC-2019-15

BibliographyGiebler, Corinna; Gröger, Christoph; Hoos, Eva; Schwarz, Holger: Modeling Data Lakes with Data Vault: Practical Experiences, Assessment, and Lessons Learned.
In: Proceedings of the 38th Conference on Conceptual Modeling (ER 2019).
University of Stuttgart, Faculty of Computer Science, Electrical Engineering, and Information Technology.
pp. 1-14, german.
Springer, November 4, 2019.
Article in Proceedings (Conference Paper).
CR-SchemaH.2.1 (Database Management Logical Design)
KeywordsData Lakes; Data Vault; Data Modeling; Industry Experience; Assessment; Lessons Learned
Abstract

Data lakes have become popular to enable organization-wide analytics on heterogeneous data from multiple sources. Data lakes store data in their raw format and are often characterized as schema-free. Nevertheless, it turned out that data still need to be modeled, as neglecting data modeling may lead to issues concerning e.g., quality and integration. In current research literature and industry practice, Data Vault is a popular modeling technique for structured data in data lakes. It promises a flexible, extensible data model that preserves data in their raw format. However, hardly any research or assessment exist on the practical usage of Data Vault for modeling data lakes. In this paper, we assess the Data Vault model’s suitability for the data lake context, present lessons learned, and investigate success factors for the use of Data Vault. Our discussion is based on the practical usage of Data Vault in a large, global manufacturer’s data lake and the insights gained in real-world analytics projects.

ContactSenden Sie eine E-Mail an Corinna.Giebler@ipvs.uni-stuttgart.de
Department(s)University of Stuttgart, Institute of Parallel and Distributed Systems, Applications of Parallel and Distributed Systems
Entry dateJuly 4, 2019
   Publ. Department   Publ. Institute   Publ. Computer Science