Artikel in Tagungsband INPROC-2003-02

Bibliograph.
Daten
Rantzau, Ralf: Processing Frequent Itemset Discovery Queries by Division and Set Containment Join Operators.
In: Zaki, Mohammed (Hrsg); Aggarwal, Charu (Hrsg): Proceedings of the ACM SIGMOD Workshop on Research Issues in Data Mining and Knowledge Discovery (DMKD), San Diego, California, USA, June 13, 2003.
Universität Stuttgart, Fakultät Informatik.
Report No. 03-05, S. 20-27, englisch.
Rensselaer Polytechnic Institute, Troy, New York 12180-3590, USA, Juni 2003.
Artikel in Tagungsband (Konferenz-Beitrag).
CR-Klassif.H.2.4 (Database Management Systems)
H.2.8 (Database Applications)
Keywordsassociation rule discovery; relational division; set containment join
Kurzfassung

SQL-based data mining algorithms are rarely used in practice today. Most performance experiments have shown that SQL-based approaches are inferior to main-memory algorithms. Nevertheless, database vendors try to integrate analysis functionalities to some extent into their query execution and optimization components in order to narrow the gap between data and processing. Such a database support is particularly important when data mining applications need to analyze very large datasets or when they need access current data, not a possibly outdated copy of it.

We investigate approaches based on SQL for the problem of finding frequent itemsets in a transaction table, including an algorithm that we recently proposed, called Quiver, which employs universal and existential quantifications. This approach employs a table schema for itemsets that is similar to the commonly used vertical layout for transactions: each item of an itemset is stored in a separate row. We argue that expressing the frequent itemset discovery problem using quantifications offers interesting opportunities to process such queries using set containment join or set containment division operators, which are not yet available in commercial database systems. Initial performance experiments reveal that Quiver cannot be processed efficiently by commercial DBMS. However, our experiments with query execution plans that use operators realizing set containment tests suggest that an efficient processing of Quiver is possible.

Volltext und
andere Links
PDF (202152 Bytes)
DMKD 2003
CopyrightAssociation for Computing Machinery (ACM)
Kontaktrrantzau@acm.org
Abteilung(en)Universität Stuttgart, Institut für Parallele und Verteilte Höchstleistungsrechner, Anwendersoftware
Projekt(e)ORBIT
Eingabedatum19. Mai 2003
   Publ. Abteilung   Publ. Institut   Publ. Informatik