"A Simulation-based Approach to Stochastic Dynamic Programming"
©
Applied Stochastic Models in Business and Industry,
2011
Volume: 27
|
Issue: 2
|
Pages: 151-163
Publication type: Journal article
Research Archive Topic: Business Economics and Public Policy, Corporate Finance
Abstract
In this paper we develop a simulation-based approach to stochastic dynamic programming. To solve the Bellman equation we construct Monte Carlo estimates of Q-values. Our method is scalable to high dimensions and works in both continuous and discrete state and decision spaces whilst avoiding discretization errors that plague traditional methods. We provide a geometric convergence rate. We illustrate our methodology with a dynamic stochastic investment problem.
Each author name for a Columbia Business School faculty member is linked to a faculty research page, which lists additional publications by that faculty member.
Each topic is linked to an index of publications on that topic.