Please note: In order to keep Hive up to date and provide users with the best features, we are no longer able to fully support Internet Explorer. The site is still available to you, however some sections of the site may appear broken. We would encourage you to move to a more modern browser like Firefox, Edge or Chrome in order to experience the site fully.

Markov Chains, Paperback / softback Book

Paperback / softback

Description

Markov chains are central to the understanding of random processes.

This is not only because they pervade the applications of random processes, but also because one can calculate explicitly many quantities of interest.

This textbook, aimed at advanced undergraduate or MSc students with some background in basic probability theory, focuses on Markov chains and quickly develops a coherent and rigorous theory whilst showing also how actually to apply it.

Both discrete-time and continuous-time chains are studied.

A distinguishing feature is an introduction to more advanced topics such as martingales and potentials in the established context of Markov chains.

There are applications to simulation, economics, optimal control, genetics, queues and many other topics, and exercises and examples drawn both from theory and practice.

It will therefore be an ideal text either for elementary courses on random processes or those that are more oriented towards applications.

Information

£37.99

 
Free Home Delivery

on all orders

 
Pick up orders

from local bookshops

Information

Also in the Cambridge Series in Statistical and Probabilistic Mathematics series  |  View all