Master Thesis MSTR-2025-10

BibliographyHorstmann, Jonas: Analysis of different preconditioners for kernel matrices based on the PLSSVM library using SYCL.
University of Stuttgart, Faculty of Computer Science, Electrical Engineering, and Information Technology, Master Thesis No. 10 (2025).
75 pages, english.
Abstract

PLSSVM is a library that enables the efficient training and execution of Support Vector Machines, which can be used to classify data. It does so by utilizing various high performance computing frameworks to construct and solve a system of linear equations. The conjugate gradient algorithm is used to iteratively solve this linear system. Large datasets with many features, resulting in ill-conditioned kernel matrices have a negative impact on the convergence of the CG method.

To remedy this problem, the goal of this thesis is to analyze different preconditioners in the context of the preconditioned conjugate gradient algorithm, in order to reduce the condition number of the linear system, leading to better convergence and higher stability in regards to different hyperparameter sets.

To achieve this goal three different preconditioners were implemented with SYCL and tested, showing that the usage of a preconditioners can indeed help to improve the mentioned aspects, resulting in fewer iterations (up to 78\%) to converge and enabling the usage of hyperparameter combinations that were not possible before.

Full text and
other links
Volltext
Department(s)University of Stuttgart, Institute of Parallel and Distributed Systems, Scientific Computing
Superviser(s)Pflüger, Prof. Dirk; Breyer, Marcel
Entry dateMay 19, 2025
New Report   New Article   New Monograph   Computer Science