Theses Doctoral

Modern Dynamic Programming Approaches to Sequential Decision Making

Min, Seungki

Dynamic programming (DP) has long been an essential framework for solving sequential decision-making problems. However, when the state space is intractably large or the objective contains a risk term, the conventional DP framework often fails to work. In this dissertation, we investigate such issues, particularly those arising in the context of multi-armed bandit problems and risk-sensitive optimal execution problems, and discuss the use of modern DP techniques to overcome these challenges such as information relaxation, policy gradient, and state augmentation. We develop frameworks formalize and improve existing heuristic algorithms (e.g., Thompson sampling, aggressive-in-the-money trading), while shedding new light on the adopted DP techniques.


  • thumnail for Min_columbia_0054D_16567.pdf Min_columbia_0054D_16567.pdf application/pdf 3.2 MB Download File

More About This Work

Academic Units
Thesis Advisors
Moallemi, Ciamac Cyrus
Maglaras, Constantinos
Ph.D., Columbia University
Published Here
June 15, 2021