Dispatching and Pricing in Two-Sided Spatial Queues.

Συγγραφείς: Xu, Ang¹ (AUTHOR) angxu@berkeley.edu, Yan, Chiwei¹ (AUTHOR) chiwei@berkeley.edu

Πηγή: Transportation Science (INFORMS). Sep/Oct2026, Vol. 60 Issue 5, p828-847. 20p.

Θεματικοί όροι: *Markov processes, *Queuing theory, *Prices, *Dynamic programming, *Ridesharing services, Matching theory

Voting by Mail: A Markov Chain Model for Managing the Security Risks of Absentee Voting.

Συγγραφείς: Haseltine, Carmen A.¹ (AUTHOR) carmen.haseltine@morgan.edu, Albert, Laura A.² (AUTHOR) laura@engr.wisc.edu

Πηγή: Decision Analysis (INFORMS). Sep2026, Vol. 23 Issue 3, p221-247. 27p.

Θεματικοί όροι: *Markov processes, *Risk assessment, Absentee voting, Postal voting, Election security measures

Γεωγραφικοί όροι: Milwaukee County (Wis.), United States

Stochastic Gradient Descent with Adaptive Data.

Συγγραφείς: Che, Ethan¹ (AUTHOR) eche25@gsb.columbia.edu, Dong, Jing¹ (AUTHOR) jing.dong@gsb.columbia.edu, Tong, Xin T.² (AUTHOR) xin.t.tong@nus.edu.sg

Πηγή: Operations Research. Jul/Aug2026, Vol. 74 Issue 4, p2113-2145. 33p.

Θεματικοί όροι: *Markov processes, *Operations research, Stochastic approximation, Stability theory, Machine learning, Reinforcement learning

Beyond Discounted Returns: Robust Markov Decision Processes with Average and Blackwell Optimality.

Συγγραφείς: Grand-Clément, Julien¹ (AUTHOR) grand-clement@hec.fr, Petrik, Marek² (AUTHOR) mpetrik@cs.unh.edu, Vieille, Nicolas³ (AUTHOR) vieille@hec.fr

Πηγή: Operations Research. Jul/Aug2026, Vol. 74 Issue 4, p2088-2112. 25p.

Θεματικοί όροι: *Markov processes, Stochastic control theory

On the Convergence of Modified Policy Iteration in Risk-Sensitive Exponential Cost Markov Decision Processes.

Συγγραφείς: Murthy, Yashaswini¹ (AUTHOR) ymurthy@caltech.edu, Moharrami, Mehrdad² (AUTHOR) moharami@uiowa.edu, Srikant, Rayadurgam³ (AUTHOR) rsrikant@illinois.edu

Πηγή: Operations Research. May/Jun2026, Vol. 74 Issue 3, p1425-1436. 12p.

Θεματικοί όροι: *Markov processes, *Dynamic programming, Robust control, Mathematical proofs, Cost functions, Reinforcement learning

A New Finite Approximation Method for Evaluating Steady-State Performance of a Continuous-State Markov Chain with an Application to Queues with Customer Abandonment.

Συγγραφείς: Li, Shukai¹ (AUTHOR) shukaili2024@u.northwestern.edu, Mehrotra, Sanjay¹ (AUTHOR) mehrotra@iems.northwestern.edu

Πηγή: Mathematics of Operations Research (INFORMS). May2026, Vol. 51 Issue 2, p1626-1658. 33p.

Θεματικοί όροι: *Markov processes, *Queuing theory, *Approximation theory, Stochastic systems, Ergodic theory, Approximation error

Asymptotic Nash Equilibria of Finite-State Ergodic Markovian Mean Field Games.

Συγγραφείς: Cohen, Asaf¹ (AUTHOR) asafc@umich.edu, Zell, Ethan¹ (AUTHOR) ezell@umich.edu

Πηγή: Mathematics of Operations Research (INFORMS). May2026, Vol. 51 Issue 2, p1139-1173. 35p.

Θεματικοί όροι: *Nash equilibrium, *Markov processes, *Game theory, Finite state machines, Hamilton-Jacobi-Bellman equation, Large deviation theory, Galerkin methods, Cost functions

People: Nash, John F., 1928-2015

Online Regret Bounds for Satisficing in Markov Decision Processes.

Συγγραφείς: Hajiabolhassan, Hossein¹ (AUTHOR) hossein.hajiabolhassan@medunigraz.at, Ortner, Ronald² (AUTHOR) rortner@unileoben.ac.at

Πηγή: Mathematics of Operations Research (INFORMS). May2026, Vol. 51 Issue 2, p1097-1119. 23p.

Θεματικοί όροι: *Markov processes, *Decision making, Reinforcement learning

Lecture notes on classical and quantum non-Markovianity.

Συγγραφείς: Pleasance, Graeme^1,2 (AUTHOR) gpleasance1@gmail.com

Πηγή: Canadian Journal of Physics. 8/4/2026, Vol. 104, p1-20. 20p.

Θεματικοί όροι: *Markov processes, *Stochastic matrices, *Quantum information theory, *Equations, *Quantum correlations

Linear Mean-Field Games with Discounted Cost.

Συγγραφείς: Saldi, Naci¹ (AUTHOR) naci.saldi@bilkent.edu.tr

Πηγή: Mathematics of Operations Research (INFORMS). Feb2026, Vol. 51 Issue 1, p358-397. 40p.

Θεματικοί όροι: *Nash equilibrium, *Markov processes, *Distribution (Probability theory), *Cost

People: Nash, John F., 1928-2015

Square-Root Regret Bounds for Continuous-Time Episodic Markov Decision Processes.

Συγγραφείς: Gao, Xuefeng¹ (AUTHOR) xfgao@se.cuhk.edu.hk, Zhou, Xunyu² (AUTHOR) xz2574@columbia.edu

Πηγή: Mathematics of Operations Research (INFORMS). Feb2026, Vol. 51 Issue 1, p333-357. 25p.

Θεματικοί όροι: *Markov processes, *Dynamic programming, *Simulation methods & models, Reinforcement learning, Confidence intervals

Digging Deep: Finding and Maximizing the Throughput Capacity of Multideep Storage Systems.

Συγγραφείς: Lehmann, Timo¹ (AUTHOR) timo.lehmann@kit.edu, de Koster, René² (AUTHOR) rkoster@rsm.nl

Πηγή: Transportation Science (INFORMS). Mar/Apr2026, Vol. 60 Issue 2, p343-365. 23p.

Θεματικοί όροι: *Automated storage retrieval systems, *Markov processes, Storage

Exponential Concentration in Stochastic Approximation.

Συγγραφείς: Law, Kody J. H.¹ (AUTHOR) kody.law@manchester.ac.uk, Walton, Neil² (AUTHOR) neil.walton@durham.ac.uk, Yang, Shangda¹ (AUTHOR) shangda.yang@manchester.ac.uk

Πηγή: Operations Research. Jan/Feb2026, Vol. 74 Issue 1, p446-463. 18p.

Θεματικοί όροι: *Markov processes, Stochastic approximation, Ergodic theory, Asymptotic analysis

On Average Optimality for Non-Stationary Markov Decision Processes in Borel Spaces.

Συγγραφείς: Guo, Xin¹ (AUTHOR) guox87@mail.sysu.edu.cn, Huang, Yonghui² (AUTHOR) hyongh5@mail.sysu.edu.cn, Zhang, Yi³ (AUTHOR) y.zhang.29@bham.ac.uk

Πηγή: Mathematics of Operations Research (INFORMS). Nov2025, Vol. 50 Issue 4, p2552-2576. 25p.

Θεματικοί όροι: *Markov processes, *Decision making, *Algorithms, Borel sets, Time-varying systems, Existence theorems

Relaxed Equilibria for Time-Inconsistent Markov Decision Processes.

Συγγραφείς: Bayraktar, Erhan¹ (AUTHOR) erhan@umich.edu, Huang, Yu-Jui² (AUTHOR) yujui.huang@colorado.edu, Wang, Zhenhua³ (AUTHOR) zhenhuaw@sdu.edu.cn, Zhou, Zhou⁴ (AUTHOR) zhou.zhou@sydney.edu.au

Πηγή: Mathematics of Operations Research (INFORMS). Nov2025, Vol. 50 Issue 4, p2666-2687. 22p.

Θεματικοί όροι: *Markov processes, *Delay discounting (Psychology), *Game theory, Equilibrium, Time-varying systems, Mathematical regularization

Stochastic First-Order Methods for Average-Reward Markov Decision Processes.

Συγγραφείς: Li, Tianjiao¹ (AUTHOR) tli432@gatech.edu, Wu, Feiyang² (AUTHOR) fwu91@gatech.edu, Lan, Guanghui¹ (AUTHOR) george.lan@isye.gatech.edu

Πηγή: Mathematics of Operations Research (INFORMS). Nov2025, Vol. 50 Issue 4, p3125-3160. 36p.

Θεματικοί όροι: *Markov processes, *Stochastic analysis, Reinforcement learning, University research

The diffusion of bank reserves in the U.S.

Συγγραφείς: Ennis, Huberto M.¹ huberto.ennis@rich.frb.org, Wolman, Alexander L.¹ alexander.wolman@rich.frb.org

Πηγή: Working Papers Series (Federal Reserve Bank of Richmond). Sep2026, Vol. 26 Issue 12, p1-85. 85p.

Θεματικοί όροι: *Bank reserves, *Markov processes, *Distribution (Probability theory), *Banking industry, *Federal Reserve banks, *Monetary policy

Γεωγραφικοί όροι: United States

Εταιρία/Οντότητα: Board of Governors of the Federal Reserve System (U.S.)

Markov Intent-Driven Shared Control for Teleoperated Needle Puncture

Συγγραφείς: Chen, Pu, Wen, Hao, Jing, Haibo, Tian, Jiexi, Duan, Xingguang, Li, Changsheng

Πηγή: 2026 IEEE International Conference on Cybernetics and Intelligent Systems (CIS) and IEEE International Conference on Robotics, Automation and Mechatronics (RAM) Cybernetics and Intelligent Systems (CIS) and IEEE International Conference on Robotics, Automation and Mechatronics (RAM), 2026 IEEE International Conference on. :424-429 Aug, 2026

Relation: 2026 IEEE International Conference on Cybernetics and Intelligent Systems (CIS) and IEEE International Conference on Robotics, Automation and Mechatronics (RAM)

Benchmarking adaptive pricing policies for Mississippi River container-on-barge service.

Συγγραφείς: Carroll, Alex¹ (AUTHOR) alex629@mit.edu

Πηγή: Annals of Operations Research. Oct2026, p1-33. 33p.

Θεματικοί όροι: *Markov processes, *Container ships, *Economic demand, *Time-based pricing, Reinforcement learning, Inland navigation

Γεωγραφικοί όροι: Mississippi River

Timeslot allocation for waiting list control.

Συγγραφείς: Vromans, R. F. M.^1,2 (AUTHOR), van Essen, J. T.³ (AUTHOR) j.t.vanessen@tudelft.nl, van der Vlugt, Y. M.³ (AUTHOR), Carlier, M.² (AUTHOR)

Πηγή: OR Spectrum. Sep2026, Vol. 48 Issue 3, p787-825. 39p.

Θεματικοί όροι: *Markov processes, *Resource allocation, *Scheduling, Time, Outpatient services in hospitals, Reinforcement learning

Γεωγραφικοί όροι: Netherlands