Bachelorarbeit BCLR-2025-14

Bibliograph.
Daten
Hina, Amtal Mateen: Explaining Disagreement in Visual Question Answering Using Eye Tracking on Questions.
Universität Stuttgart, Fakultät Informatik, Elektrotechnik und Informationstechnik, Bachelorarbeit Nr. 14 (2025).
51 Seiten, englisch.
Kurzfassung

While observing the different answers of participants to the same question of Visual Question Answering (VQA) the question came up: What are the reasons behind the disagreement in the answers? Previous work has investigated if the gaze data of participants on the images can explain the disagreement. The novel approach was to use the gaze data on questions instead of the images. The mandatory goal is to find out whether there are differences in visual attention between participants who gave different answers. Secondly, we identify cases of disagreements caused by synonyms, granularity and spelling mistakes. To obtain these goals, we analysed the answers and gaze data and manually inspected the examples where differences in visual attention support the disagreement. The textual analysis of answers finds 1169 out of 3990 examples of disagreement caused by small mistakes, don’t know (lack of information), synonyms and granular. On the other hand, there is no significant difference in the gaze metrics between cases of agreement and disagreement. Moreover, manual inspection only reveals 47 out of 3990 examples. Overall, we find that the difference in visual attention to the question is not able to explain the answers’ disagreement. Keywords: Visual Question Answering (VQA) · VQA-MHUG · Question-image pair (QI pair) · Gaze data · Disagreement · Natural Language Processing (NLP

Abteilung(en)Universität Stuttgart, Institut für Visualisierung und Interaktive Systeme, Visualisierung und Interaktive Systeme
BetreuerBulling, Prof. Andreas; Hindennach, Susanne
Eingabedatum10. Juli 2025
   Publ. Institut   Publ. Informatik