Please note: In order to keep Hive up to date and provide users with the best features, we are no longer able to fully support Internet Explorer. The site is still available to you, however some sections of the site may appear broken. We would encourage you to move to a more modern browser like Firefox, Edge or Chrome in order to experience the site fully.

Foundations of Average-Cost Nonhomogeneous Controlled Markov Chains, Paperback / softback Book

Foundations of Average-Cost Nonhomogeneous Controlled Markov Chains Paperback / softback

Part of the SpringerBriefs in Control, Automation and Robotics series

Paperback / softback

Description

This Springer brief addresses the challenges encountered in the study of  the optimization of time-nonhomogeneous Markov chains.

It develops new insights and new methodologies for systems in which concepts such as stationarity, ergodicity, periodicity and connectivity do not apply. This brief introduces the novel concept of confluencity and applies a relative optimization approach.

It develops a comprehensive theory for optimization of the long-run average of time-nonhomogeneous Markov chains.

The book shows that confluencity is the most fundamental concept in optimization, and that relative optimization is more suitable for treating the systems under consideration than standard ideas of dynamic programming.

Using confluencity and relative optimization, the author classifies states as confluent or branching and shows how the under-selectivity issue of the long-run average can be easily addressed, multi-class optimization implemented, and Nth biases and Blackwell optimality conditions derived.

These results are presented in a book for the first time and so may enhance the understanding of optimization and motivate new research ideas in the area.

Information

Save 17%

£44.99

£37.09

 
Free Home Delivery

on all orders

 
Pick up orders

from local bookshops

Information