Convergence of The Relative Value Iteration for the Ergodic Control Problem of Nondegenerate Diffusions under Near-Monotone Costs

Autor: Vivek S. Borkar, K. Suresh Kumar, Aristotle Arapostathis
Rok vydání: 2013
Předmět:
DOI: 10.48550/arxiv.1303.0618
Popis: We study the relative value iteration for the ergodic control problem under a near-monotone running cost structure for a nondegenerate diffusion controlled through its drift. This algorithm takes the form of a quasi-linear parabolic Cauchy initial value problem in $\mathbb{R}^{d}$. We show that this Cauchy problem stabilizes or, in other words, that the solution of the quasi-linear parabolic equation converges for every bounded initial condition in $\mathcal{C}^{2}(\mathbb{R}^{d})$ to the solution of the Hamilton--Jacobi--Bellman equation associated with the ergodic control problem.
Databáze: OpenAIRE