A note on dynamic programming with unbounded rewards

J.A.E.E. van Nunen, J. Wessels

Research output: Contribution to journalArticleAcademicpeer-review

Abstract

In a recent paper, Lippman presents sufficient conditions for Denardo's N-stage contraction in discounted semi-Markov decision processes with unbounded rewards. In this note it is demonstrated that Lippman's conditions may be replaced by weaker conditions which even imply 1-stage contraction. The verification of the conditions of this note is somewhat easier.
Original languageEnglish
Pages (from-to)576-580
Number of pages6
JournalManagement Science
Volume24
Issue number5
DOIs
Publication statusPublished - 1978

Fingerprint

Contraction
Reward
Dynamic programming
Markov decision process

Cite this

van Nunen, J.A.E.E. ; Wessels, J. / A note on dynamic programming with unbounded rewards. In: Management Science. 1978 ; Vol. 24, No. 5. pp. 576-580.
@article{e5d9a67d5dd140abb7c898fbc7adb7be,
title = "A note on dynamic programming with unbounded rewards",
abstract = "In a recent paper, Lippman presents sufficient conditions for Denardo's N-stage contraction in discounted semi-Markov decision processes with unbounded rewards. In this note it is demonstrated that Lippman's conditions may be replaced by weaker conditions which even imply 1-stage contraction. The verification of the conditions of this note is somewhat easier.",
author = "{van Nunen}, J.A.E.E. and J. Wessels",
year = "1978",
doi = "10.1287/mnsc.24.5.576",
language = "English",
volume = "24",
pages = "576--580",
journal = "Management Science",
issn = "0025-1909",
publisher = "INFORMS Institute for Operations Research and the Management Sciences",
number = "5",

}

A note on dynamic programming with unbounded rewards. / van Nunen, J.A.E.E.; Wessels, J.

In: Management Science, Vol. 24, No. 5, 1978, p. 576-580.

Research output: Contribution to journalArticleAcademicpeer-review

TY - JOUR

T1 - A note on dynamic programming with unbounded rewards

AU - van Nunen, J.A.E.E.

AU - Wessels, J.

PY - 1978

Y1 - 1978

N2 - In a recent paper, Lippman presents sufficient conditions for Denardo's N-stage contraction in discounted semi-Markov decision processes with unbounded rewards. In this note it is demonstrated that Lippman's conditions may be replaced by weaker conditions which even imply 1-stage contraction. The verification of the conditions of this note is somewhat easier.

AB - In a recent paper, Lippman presents sufficient conditions for Denardo's N-stage contraction in discounted semi-Markov decision processes with unbounded rewards. In this note it is demonstrated that Lippman's conditions may be replaced by weaker conditions which even imply 1-stage contraction. The verification of the conditions of this note is somewhat easier.

U2 - 10.1287/mnsc.24.5.576

DO - 10.1287/mnsc.24.5.576

M3 - Article

VL - 24

SP - 576

EP - 580

JO - Management Science

JF - Management Science

SN - 0025-1909

IS - 5

ER -