Approximate dynamic programming for stochastic resource allocation problems
| Autor: | Raffaele Iervolino, J. Neilson, Ali Forootani, Massimo Tipaldi |
|---|---|
| Přispěvatelé: | Forootani, A., Iervolino, R., Tipaldi, M., Neilson, J. |
| Rok vydání: | 2020 |
| Předmět: |
0209 industrial biotechnology
Mathematical optimization 021103 operations research Computer science dynamic programming (DP) 0211 other engineering and technologies Approximate dynamic programming (ADP) resource allocation problem 02 engineering and technology Markov decision processes (MDPs) Stochastic programming Dynamic programming 020901 industrial engineering & automation Artificial Intelligence Control and Systems Engineering Bellman equation Dynamic pricing Scalability Resource allocation Markov decision process Information Systems Curse of dimensionality |
| Zdroj: | IEEE/CAA Journal of Automatica Sinica. 7:975-990 |
| ISSN: | 2329-9274 2329-9266 |
| DOI: | 10.1109/jas.2020.1003231 |
| Popis: | A stochastic resource allocation model, based on the principles of Markov decision processes ( MDPs ) , is proposed in this paper. In particular, a general-purpose framework is developed, which takes into account resource requests for both instant and future needs. The considered framework can handle two types of reservations ( i.e., specified and unspecified time interval reservation requests ) , and implement an overbooking business strategy to further increase business revenues. The resulting dynamic pricing problems can be regarded as sequential decision-making problems under uncertainty, which is solved by means of stochastic dynamic programming ( DP ) based algorithms. In this regard, Bellman’s backward principle of optimality is exploited in order to provide all the implementation mechanisms for the proposed reservation pricing algorithm. The curse of dimensionality, as the inevitable issue of the DP both for instant resource requests and future resource reservations, occurs. In particular, an approximate dynamic programming ( ADP ) technique based on linear function approximations is applied to solve such scalability issues. Several examples are provided to show the effectiveness of the proposed approach. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|