Numerical methods for solving Markov chains are in general ine??cient if the state space of
the chain is very large (or infinite) and lacking a simple repeating structure. One alternative to solving such chains is to construct models that are simple to analyze and that provide bounds for a reward function of interest. We present a new bounding method for Markov chains inspired by Markov reward theory; our method constructs bounds by redirecting selected sets of transitions, acilitating an intuitive interpretation of the modifications on the original system. We show that our method is compatible with strong aggregation of Markov chains; thus we can obtain bounds for the initial chain by analyzing a much smaller chain. We illustrate our method on a problem of order all rates for an inventory system of service tools.

Original language | English |
---|

Place of Publication | Eindhoven |
---|

Publisher | Eurandom |
---|

Number of pages | 44 |
---|

ISBN (Print) | 978-90-386-1904-0 |
---|

Publication status | Published - 2009 |
---|

Name | BETA publicatie : working papers |
---|

Volume | 274 |
---|

ISSN (Print) | 1386-9213 |
---|