Computing Expected Hitting Times for Imprecise Markov Chains

Thomas Krak (Corresponding author)

Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

Abstract

We present a novel algorithm to solve a non-linear system of equations, whose solution can be interpreted as a tight lower bound on the vector of expected hitting times of a Markov chain whose transition probabilities are only partially specified. We also briefly sketch how this method can be modified to solve a conjugate system of equations that gives rise to the corresponding upper bound. We prove the correctness of our method and show that it converges to the correct solution in a finite number of steps under mild conditions on the system. We compare the runtime complexity of our method to a previously published method from the literature and identify conditions under which our novel method is more efficient.
Original languageEnglish
Title of host publicationAdvances in Uncertainty Quantification and Optimization Under Uncertainty with Aerospace Applications
Subtitle of host publicationProceedings of the 2020 UQOP International Conference
EditorsMassimiliano Vasile, Domenico Quagliarella
PublisherSpringer
Pages185-205
Number of pages21
ISBN (Electronic)978-3-030-80542-5
ISBN (Print)978-3-030-80541-8
DOIs
Publication statusPublished - 16 Jul 2021

Publication series

NameSpace Technology Proceedings
Volume8

Fingerprint

Dive into the research topics of 'Computing Expected Hitting Times for Imprecise Markov Chains'. Together they form a unique fingerprint.

Cite this