SENSITIVITY ANALYSIS IN MARKOV DECISION PROCESSES WITH UNCERTAIN REWARD PARAMETERS.

Autor:	Chin Hon Tan, Hartman, Joseph C.
Předmět:	SENSITIVITY analysis MARKOV processes DECISION making UNCERTAINTY (Information theory) MATHEMATICAL models PROBLEM solving STOCHASTIC processes DYNAMIC programming PARAMETER estimation
Zdroj:	Journal of Applied Probability; Dec2011, Vol. 48 Issue 4, p954-967, 14p
Abstrakt:	Sequential decision problems can often be modeled as Markov decision processes. Classical solution approaches assume that the parameters of the model are known. However, model parameters are usually estimated and uncertain in practice. As a result, managers are often interested in how estimation errors affect the optimal solution. In this paper we illustrate how sensitivity analysis can be performed directly for a Markov decision process with uncertain reward parameters using the Bellman equations. In particular, we consider problems involving (i) a single stationary parameter, (ii) multiple stationary parameters, and (iii) multiple nonstationary parameters. We illustrate the applicability of this work through a capacitated stochastic lot-sizing problem. [ABSTRACT FROM AUTHOR]
Databáze:	Complementary Index
Externí odkaz:	Zobrazit plný text záznamu