Λεπτομέρειες βιβλιογραφικής εγγραφής
| Τίτλος: |
Square-Root Regret Bounds for Continuous-Time Episodic Markov Decision Processes. |
| Συγγραφείς: |
Gao, Xuefeng1 (AUTHOR) xfgao@se.cuhk.edu.hk, Zhou, Xunyu2 (AUTHOR) xz2574@columbia.edu |
| Πηγή: |
Mathematics of Operations Research (INFORMS). Feb2026, Vol. 51 Issue 1, p333-357. 25p. |
| Θεματικοί όροι: |
*Markov processes, *Dynamic programming, *Simulation methods & models, Reinforcement learning, Confidence intervals |
| Περίληψη: |
We study reinforcement learning for continuous-time Markov decision processes (MDPs) in the finite-horizon episodic setting. In contrast to discrete-time MDPs, the intertransition times of a continuous-time MDP are exponentially distributed with rate parameters depending on the state–action pair at each transition. We present a learning algorithm based on the methods of value iteration and upper confidence bound. We derive an upper bound on the worst case expected regret for the proposed algorithm and establish a worst case lower bound with both bounds of the order of square root on the number of episodes. Finally, we conduct simulation experiments to illustrate the performance of our algorithm. Funding: X. Gao is supported by the Hong Kong Research Grant Council [Grants 14201421, 14212522, 14200123]. X. Zhou gratefully acknowledges financial support through the Nie Center for Intelligent Asset Management at Columbia. [ABSTRACT FROM AUTHOR] |
|
Copyright of Mathematics of Operations Research (INFORMS) is the property of INFORMS: Institute for Operations Research & the Management Sciences and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) |
| Βάση Δεδομένων: |
Business Source Index |
