Bachelor Thesis BCLR-2015-03

BibliographyWu, Li Yang: Monte Carlo Tree Search for concurrent actions.
University of Stuttgart, Faculty of Computer Science, Electrical Engineering, and Information Technology, Bachelor Thesis (2015).
19 pages, english.
CR-SchemaF.2.0 (Analysis of Algorithms and Problem Complexity General)
I.2.8 (Problem Solving, Control Methods, and Search)
Abstract

Many decision problems within robotics concern the control of potentially concurrent actions in continuous time, each with stochastic durations. There exist various formalizations of such decision processes. This thesis aims to investigate in a reduction that is suitable for Monte-Carlo Tree Search. In particular, the approach should be compared to existing reductions as Semi-Markov Decision Processes w.r.t. the generality of the formalisms as well as the notions of optimality guaranteed. Do the optimality proofs of Upper Confidence Bounds applied to Trees directly transfer to the concurrent action case? The handling of general stochasticity, also of the action durations, should be investigated in detail. Further, it is of interest to theoretically investigate and compare existing implementations w.r.t. the consistency and performance.

Full text and
other links
PDF (460122 Bytes)
Department(s)University of Stuttgart, Institute of Parallel and Distributed Systems, Machine Learning und Robotics
Superviser(s)Toussaint, Prof. Marc; Ngo, Ph.D. Vien
Entry dateSeptember 25, 2018
   Publ. Computer Science