Bachelor Thesis BCLR-2022-98

BibliographyAbu El Komboz, Tareq: Parameter-dependent self-learning optimization.
University of Stuttgart, Faculty of Computer Science, Electrical Engineering, and Information Technology, Bachelor Thesis No. 98 (2022).
63 pages, english.

Manually developing optimization algorithms is a time-consuming task requiring expert knowledge. Therefore, it makes a lot of sense to automate the design process of such algorithms. Additionally, learned optimization algorithms reduce the number of a priori assumptions made about the characteristics of the underlying objective function. Numerous works discuss possibilities for learning optimization algorithms. This field of study is called learn-to-optimize. In this bachelor’s thesis, we concentrate on the reinforcement learning perspective. Consequently, optimization algorithms are represented as policies. The comparison of learned algorithms to current state-of-the-art algorithms for particular applications reveals that learned algorithms manage to perform better concerning convergence speed and final objective function value. However, most existing approaches only consider fixed sets of parameters to be optimized. Because of this, it is challenging to adapt the learned optimization algorithm to other objective functions. More importantly, it is impossible to optimize when explicit constraints on so-called “free” optimization parameters are given. We investigated the learn-to-optimize approach under various optimization parameter sets and conditions on “free” parameters to solve this problem. Furthermore, we studied the performance of learned optimizers in high-dimensional setups.

Full text and
other links
Department(s)University of Stuttgart, Institute of Parallel and Distributed Systems, Scientific Computing
Superviser(s)Pflger, Prof. Dirk; Domanski, Peter
Entry dateApril 18, 2023
   Publ. Computer Science