Temporal logic control of POMDPs via label-based stochastic simulation relations

S. Haesaert, P. Nilsson, C. I. Vasile, R. Thakker, A. Agha-mohammadi, A. D. Ames, R. M. Murray

Research output: Contribution to journalConference articlepeer-review

25 Citations (Scopus)
3 Downloads (Pure)

Abstract

The synthesis of controllers guaranteeing linear temporal logic specifications on partially observable Markov decision processes (POMDP) via their belief models causes computational issues due to the continuous spaces. In this work, we construct a finite-state abstraction on which a control policy is synthesized and refined back to the original belief model. We introduce a new notion of label-based approximate stochastic simulation to quantify the deviation between belief models. We develop a robust synthesis methodology that yields a lower bound on the satisfaction probability, by compensating for deviations a priori, and that utilizes a less conservative control refinement.

Original languageEnglish
Pages (from-to)271-276
Number of pages6
JournalIFAC-PapersOnLine
Volume51
Issue number16
DOIs
Publication statusPublished - 1 Jan 2018
Event6th IFAC Conference on Analysis and Design of Hybrid Systems ADHS 2018 - Oxford, United Kingdom
Duration: 11 Jul 201813 Jul 2018

Keywords

  • control synthesis
  • Markov decision processes
  • partially observable
  • Temporal properties

Fingerprint

Dive into the research topics of 'Temporal logic control of POMDPs via label-based stochastic simulation relations'. Together they form a unique fingerprint.

Cite this