Improved successive approximation methods for discounted Markov decision processes

J.A.E.E. van Nunen

Research output: Book/ReportReportAcademic

43 Downloads (Pure)


Successive Approximation (S.A.) methods, for solving discounted Markov decision problems, have been developed to avoid the extensive computations that are connected with linear programming and policy iteration techniques for solving large scaled problems. Several authors give such an S.A. algorithm. In this paper we introduce some new algorithms while furthermore it will be shown how the several S.A. algorithms may be combined. For each algorithm converging sequences of upper and lower bounds for the optimal value will be given.
Original languageEnglish
Place of PublicationEindhoven
PublisherTechnische Hogeschool Eindhoven
Number of pages15
Publication statusPublished - 1974

Publication series

NameMemorandum COSOR
ISSN (Print)0926-4493


Dive into the research topics of 'Improved successive approximation methods for discounted Markov decision processes'. Together they form a unique fingerprint.

Cite this