Please note: In order to keep Hive up to date and provide users with the best features, we are no longer able to fully support Internet Explorer. The site is still available to you, however some sections of the site may appear broken. We would encourage you to move to a more modern browser like Firefox, Edge or Chrome in order to experience the site fully.

Supporting your high street Find out how »
A Tutorial on Linear Function Approximators for Dynamic Programming and Reinforcement Learning, Paperback / softback Book

A Tutorial on Linear Function Approximators for Dynamic Programming and Reinforcement Learning Paperback / softback

Part of the Foundations and Trends (R) in Machine Learning series

Paperback / softback

Item not Available

Description

A Markov Decision Process (MDP) is a natural framework for formulating sequential decision-making problems under uncertainty.

In recent years, researchers have greatly advanced algorithms for learning and acting in MDPs. This book reviews such algorithms, beginning with well-known dynamic programming methods for solving MDPs such as policy iteration and value iteration, then describes approximate dynamic programming methods such as trajectory based value iteration, and finally moves to reinforcement learning methods such as Q-Learning, SARSA, and least-squares policy iteration.

It describes algorithms in a unified framework, giving pseudocode together with memory and iteration complexity analysis for each.

Empirical evaluations of these techniques, with four representations across four domains, provide insight into how these algorithms perform with various feature sets in terms of running time and performance. This tutorial provides practical guidance for researchers seeking to extend DP and RL techniques to larger domains through linear value function approximation.

The practical algorithms and empirical successes outlined also form a guide for practitioners trying to weigh computational costs, accuracy requirements, and representational concerns.

Decision making in large domains will always be challenging, but with the tools presented here this challenge is not insurmountable.

Information

Save 16%

£58.50

£48.85

Item not Available
Item not Available
Sign in to add to wishlist
 
Free Home Delivery

on all orders

 
Pick up orders

from local bookshops

Information