On stopping a Markov decision process

L.P.J. Groenewegen

Research output: Book/ReportReportAcademic

53 Downloads (Pure)


In this report the same situation will be considered as in Hordijk, Dynamic programrrdng and Markov potential theory [3], viz. a countable state space Markov decision process which can be stopped. Costs have the so-called charge structure and the optimality criterion is the total expected gain. It will be shown, that an optimal strategy, consisting of a memoryless decision rule and a possibly nonmemoryless stopping rule, can be replaced by a strategy consisting of the same decision rule and a stopping rule which is an entry time.
Original languageEnglish
Place of PublicationEindhoven
PublisherTechnische Hogeschool Eindhoven
Number of pages12
Publication statusPublished - 1975

Publication series

NameMemorandum COSOR
ISSN (Print)0926-4493


Dive into the research topics of 'On stopping a Markov decision process'. Together they form a unique fingerprint.

Cite this