Stochastic Modeling and Optimization

The first part is a col­ lection of several basic methodologies: singularly perturbed Markov chains (Chapter 1), and related applications in stochastic optimal control (Chapter 2);