Artikel in Tagungsband INPROC-2019-15

Giebler, Corinna; Gröger, Christoph; Hoos, Eva; Schwarz, Holger: Modeling Data Lakes with Data Vault: Practical Experiences, Assessment, and Lessons Learned.
In: Proceedings of the 38th Conference on Conceptual Modeling (ER 2019).
Universität Stuttgart, Fakultät Informatik, Elektrotechnik und Informationstechnik.
S. 1-14, deutsch.
Springer, 4. November 2019.
Artikel in Tagungsband (Konferenz-Beitrag).
CR-Klassif.H.2.1 (Database Management Logical Design)
KeywordsData Lakes; Data Vault; Data Modeling; Industry Experience; Assessment; Lessons Learned

Data lakes have become popular to enable organization-wide analytics on heterogeneous data from multiple sources. Data lakes store data in their raw format and are often characterized as schema-free. Nevertheless, it turned out that data still need to be modeled, as neglecting data modeling may lead to issues concerning e.g., quality and integration. In current research literature and industry practice, Data Vault is a popular modeling technique for structured data in data lakes. It promises a flexible, extensible data model that preserves data in their raw format. However, hardly any research or assessment exist on the practical usage of Data Vault for modeling data lakes. In this paper, we assess the Data Vault model’s suitability for the data lake context, present lessons learned, and investigate success factors for the use of Data Vault. Our discussion is based on the practical usage of Data Vault in a large, global manufacturer’s data lake and the insights gained in real-world analytics projects.

KontaktSenden Sie eine E-Mail an
Abteilung(en)Universität Stuttgart, Institut für Parallele und Verteilte Systeme, Anwendersoftware
Eingabedatum4. Juli 2019
   Publ. Abteilung   Publ. Institut   Publ. Informatik