Diploma Thesis DIP-2017-14

BibliographyBanzhaf, Clint: Extracting Facial Data using Feature-based Image Processing and Correlating it with Alternative Biosensors Metrics.
University of Stuttgart, Faculty of Computer Science, Electrical Engineering, and Information Technology, Diploma Thesis (2017).
119 pages, english.
CR-SchemaI.2.10 (Vision and Scene Understanding)
I.4.8 (Image Processing and Computer Vision Scene Analysis)
I.5.4 (Pattern Recognition Applications)
Abstract

Extracting facial data has recently drawn more attention due to an ongoing progress in research and increase in its accuracy. Thanks to mobile platforms, the necessary but ordinary cameras are remarkably widespread nowadays. Big companies, like Google, have entered the market with their own cloud-based and mobile face analysis solutions. Possible applications for extracted facial data range from more user-friendly devices to user-interface evaluation and marketing. This thesis starts with an introduction to the topic of facial data extraction. It outlines several interesting applications, important techniques and existing frameworks first. Afterwards, the main contribution is presented: OpenFace++, an improved and extended variant of the existing OpenFace face analysis framework. Like OpenFace, the proposed OpenFace++ framework aims to close an unsatisfying gap in available functionality between commercial and free open-source solutions. OpenFace++ adds several new features to OpenFace. Amongst others, the added highlights are facial expression recognition, attention estimation, and cross-platform compatibility. OpenFace++ works on Android out-of-the-box. The work is completed by presenting a user-study which was conducted to investigate the reliability of extracted facial data. The first experiment evaluates the detectability of eye-closeness states. Results show that facial data extraction can outperform competing solutions. The second experiment shows that face orientation extraction also works reliably compared to a gyrometer. Finally, the third experiment demonstrates that the new facial expression detection can detect many cases very accurately. The thesis finishes with some suggestions for further improvements on OpenFace++ in the future.

Full text and
other links
PDF (15751617 Bytes)
Department(s)University of Stuttgart, Institute of Visualisation and Interactive Systems, Visualisation and Interactive Systems
Superviser(s)Schmidt, Prof. Albrecht; Kosch, Thomas; Hassib, Mariam; Jillich, Benjamin
Entry dateJuly 5, 2018
   Publ. Computer Science