| Bibliography | Kiefer, Cornelia: Quality Indicators for Text Data.
In: Meyer, Holger (ed.); Ritter, Norbert (ed.); Thor, Andreas (ed.); Nicklas, Daniela (ed.); Heuer, Andreas (ed.); Klettke, Meike (ed.): 18. Fachtagung des GI-Fachbereichs ,,Datenbanken und Informationssysteme (DBIS), 4.-8. März 2019, Rostock, Germany, Workshopband..
University of Stuttgart, Faculty of Computer Science, Electrical Engineering, and Information Technology.
Dagstuhl Reports, pp. 145-154, english.
Bonn: Gesellschaft f\"{u}r Informatik e.V. (GI), March 4, 2019.
Article in Proceedings (Conference Paper).
|
|---|
| Abstract | Textual data sets vary in terms of quality. They have different characteristics such as the average sentence length or the amount of spelling mistakes and abbreviations. These text characteristics have influence on the quality of text mining results. They may be measured automatically by means of quality indicators. We present indicators, which we implemented based on natural language processing libraries such as Stanford CoreNLP and NLTK. We discuss design decisions in the implementation of exemplary indicators and provide all indicators on GitHub. In the evaluation, we investigate freetexts from production, news, prose, tweets and chat data and show that the suggested indicators predict the quality of two text mining modules.
|
|---|