A note on dynamic programming with unbounded rewards

J.A.E.E. van Nunen; J. Wessels

doi:10.1287/mnsc.24.5.576

A note on dynamic programming with unbounded rewards

J.A.E.E. van Nunen, J. Wessels

Stochastic Operations Research

Research output: Contribution to journal › Article › Academic › peer-review

Abstract

In a recent paper, Lippman presents sufficient conditions for Denardo's N-stage contraction in discounted semi-Markov decision processes with unbounded rewards. In this note it is demonstrated that Lippman's conditions may be replaced by weaker conditions which even imply 1-stage contraction. The verification of the conditions of this note is somewhat easier.

Original language	English
Pages (from-to)	576-580
Number of pages	6
Journal	Management Science
Volume	24
Issue number	5
DOIs	https://doi.org/10.1287/mnsc.24.5.576
Publication status	Published - 1978

Access to Document

10.1287/mnsc.24.5.576

Cite this

@article{e5d9a67d5dd140abb7c898fbc7adb7be,

title = "A note on dynamic programming with unbounded rewards",

abstract = "In a recent paper, Lippman presents sufficient conditions for Denardo's N-stage contraction in discounted semi-Markov decision processes with unbounded rewards. In this note it is demonstrated that Lippman's conditions may be replaced by weaker conditions which even imply 1-stage contraction. The verification of the conditions of this note is somewhat easier.",

author = "{van Nunen}, J.A.E.E. and J. Wessels",

year = "1978",

doi = "10.1287/mnsc.24.5.576",

language = "English",

volume = "24",

pages = "576--580",

journal = "Management Science",

issn = "0025-1909",

publisher = "INFORMS Institute for Operations Research and the Management Sciences",

number = "5",

}

TY - JOUR

T1 - A note on dynamic programming with unbounded rewards

AU - van Nunen, J.A.E.E.

AU - Wessels, J.

PY - 1978

Y1 - 1978

N2 - In a recent paper, Lippman presents sufficient conditions for Denardo's N-stage contraction in discounted semi-Markov decision processes with unbounded rewards. In this note it is demonstrated that Lippman's conditions may be replaced by weaker conditions which even imply 1-stage contraction. The verification of the conditions of this note is somewhat easier.

AB - In a recent paper, Lippman presents sufficient conditions for Denardo's N-stage contraction in discounted semi-Markov decision processes with unbounded rewards. In this note it is demonstrated that Lippman's conditions may be replaced by weaker conditions which even imply 1-stage contraction. The verification of the conditions of this note is somewhat easier.

U2 - 10.1287/mnsc.24.5.576

DO - 10.1287/mnsc.24.5.576

M3 - Article

SN - 0025-1909

VL - 24

SP - 576

EP - 580

JO - Management Science

JF - Management Science

IS - 5

ER -

A note on dynamic programming with unbounded rewards

Abstract

Access to Document

Fingerprint

Cite this