Markov programming by successive approximations with respect to weighted supremum norms

J. Wessels

Research output: Contribution to journal › Article › Academic › peer-review

47 Citations (Scopus)

Abstract

Markovian decision processes are considered in the situation of discrete time, countable state space, and general decision space. By introducing a Banach space with a weighted supremum norm, conditions are derived, which guarantee convergence of successive approximations to the value function. These conditions are weaker then those required by the usual supnorm approach. Several properties of the successive approximations are derived.
Original languageEnglish
Pages (from-to)326-335
Number of pages10
JournalJournal of Mathematical Analysis and Applications
Volume58
Issue number2
DOIs
Publication statusPublished - 1977

Fingerprint

Successive Approximation
Banach spaces
Supremum
Programming
Norm
Value Function
Countable
State Space
Discrete-time
Banach space

Cite this

Wessels, J. / Markov programming by successive approximations with respect to weighted supremum norms. In: Journal of Mathematical Analysis and Applications. 1977 ; Vol. 58, No. 2. pp. 326-335.
@article{b75d5a8ee1434b12841a9d79b864b116,
title = "Markov programming by successive approximations with respect to weighted supremum norms",
abstract = "Markovian decision processes are considered in the situation of discrete time, countable state space, and general decision space. By introducing a Banach space with a weighted supremum norm, conditions are derived, which guarantee convergence of successive approximations to the value function. These conditions are weaker then those required by the usual supnorm approach. Several properties of the successive approximations are derived.",
author = "J. Wessels",
year = "1977",
doi = "10.1016/0022-247X(77)90210-4",
language = "English",
volume = "58",
pages = "326--335",
journal = "Journal of Mathematical Analysis and Applications",
issn = "0022-247X",
publisher = "Agon Elsevier",
number = "2",

}

Wessels, J 1977, 'Markov programming by successive approximations with respect to weighted supremum norms', Journal of Mathematical Analysis and Applications, vol. 58, no. 2, pp. 326-335. https://doi.org/10.1016/0022-247X(77)90210-4

Markov programming by successive approximations with respect to weighted supremum norms. / Wessels, J.

In: Journal of Mathematical Analysis and Applications, Vol. 58, No. 2, 1977, p. 326-335.

Research output: Contribution to journal › Article › Academic › peer-review

TY - JOUR

T1 - Markov programming by successive approximations with respect to weighted supremum norms

AU - Wessels, J.

PY - 1977

Y1 - 1977

N2 - Markovian decision processes are considered in the situation of discrete time, countable state space, and general decision space. By introducing a Banach space with a weighted supremum norm, conditions are derived, which guarantee convergence of successive approximations to the value function. These conditions are weaker then those required by the usual supnorm approach. Several properties of the successive approximations are derived.

AB - Markovian decision processes are considered in the situation of discrete time, countable state space, and general decision space. By introducing a Banach space with a weighted supremum norm, conditions are derived, which guarantee convergence of successive approximations to the value function. These conditions are weaker then those required by the usual supnorm approach. Several properties of the successive approximations are derived.

U2 - 10.1016/0022-247X(77)90210-4

DO - 10.1016/0022-247X(77)90210-4

M3 - Article

VL - 58

SP - 326

EP - 335

JO - Journal of Mathematical Analysis and Applications

JF - Journal of Mathematical Analysis and Applications

SN - 0022-247X

IS - 2

ER -

Wessels J. Markov programming by successive approximations with respect to weighted supremum norms. Journal of Mathematical Analysis and Applications. 1977;58(2):326-335. https://doi.org/10.1016/0022-247X(77)90210-4

Access to Document