We consider discounted Markov decision processes (MDPs) with countably-infinite state spaces, finite action spaces, and unbounded rewards. Typical examples of such MDPs are inventory management and ...

This is a preview. Log in through your library . Abstract Nonstationary infinite-horizon Markov decision processes (MDPs) generalize the most well-studied class of sequential decision models in ...

YOU MIGHT not have heard of the algorithm that runs the world. Few people have, though it can determine much that goes on in our day-to-day lives: the food we have to eat, our schedule at work, ...