Λεπτομέρειες βιβλιογραφικής εγγραφής
| Τίτλος: |
Relaxed Equilibria for Time-Inconsistent Markov Decision Processes. |
| Συγγραφείς: |
Bayraktar, Erhan1 (AUTHOR) erhan@umich.edu, Huang, Yu-Jui2 (AUTHOR) yujui.huang@colorado.edu, Wang, Zhenhua3 (AUTHOR) zhenhuaw@sdu.edu.cn, Zhou, Zhou4 (AUTHOR) zhou.zhou@sydney.edu.au |
| Πηγή: |
Mathematics of Operations Research (INFORMS). Nov2025, Vol. 50 Issue 4, p2666-2687. 22p. |
| Θεματικοί όροι: |
*Markov processes, *Delay discounting (Psychology), *Game theory, Equilibrium, Time-varying systems, Mathematical regularization |
| Περίληψη: |
This paper considers an infinite-horizon Markov decision process (MDP) that allows for general nonexponential discount functions in both discrete and continuous time. Because of the inherent time inconsistency, we look for a randomized equilibrium policy (i.e., relaxed equilibrium) in an intrapersonal game between an agent's current and future selves. When we modify the MDP by entropy regularization, a relaxed equilibrium is shown to exist by a nontrivial entropy estimate. As the degree of regularization diminishes, the entropy-regularized MDPs approximate the original MDP, which gives the general existence of a relaxed equilibrium in the limit by weak convergence arguments. As opposed to prior studies that consider only deterministic policies, our existence of an equilibrium does not require any convexity (or concavity) of the controlled transition probabilities and reward function. Interestingly, this benefit of considering randomized policies is unique to the time-inconsistent case. [ABSTRACT FROM AUTHOR] |
|
Copyright of Mathematics of Operations Research (INFORMS) is the property of INFORMS: Institute for Operations Research & the Management Sciences and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) |
| Βάση Δεδομένων: |
Business Source Index |
