Markov decision processes and strongly excessive functions

K.M. Hee, van, J. Wessels

Onderzoeksoutput: Boek/rapportRapportAcademic

49 Downloads (Pure)


This paper is a revised and extended version of Memorandum COSOR 75-22 Strongly excessive functions play an important role in the theory of Markov decision processes and Markov games. In this paper the following question is investigated: What are the probabilistic properties of Markov decision processes which posses a strongly excessive function? A characterization is presented 1n the form of a random drift through a partitioned state space. For strongly excessive functions which have a positive lower bound a characterization is given in terms of the lifetime distribution of the process. Finally we give a characterization in terms of the spectral radius. Key words: Markov decision process, excessive function, transient behaviour, exponentially bounded stopping time, spectral radius.
Originele taal-2Engels
Plaats van productieEindhoven
UitgeverijTechnische Hogeschool Eindhoven
Aantal pagina's22
StatusGepubliceerd - 1977

Publicatie series

NaamMemorandum COSOR
ISSN van geprinte versie0926-4493

Vingerafdruk Duik in de onderzoeksthema's van 'Markov decision processes and strongly excessive functions'. Samen vormen ze een unieke vingerafdruk.

Citeer dit