Towards supervisory control of interactive Markov chains: controllability

J. Markovski

    Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

    12 Citations (Scopus)


    We propose a model-based systems engineering framework for supervisory control of stochastic discrete-event systems with unrestricted nondeterminism. We intend to develop the proposed framework in four phases outlined in this paper. Here, we study in detail the first step which comprises investigation of the underlying model and development of a corresponding notion of controllability. The model of choice is termed Interactive Markov Chains, which is a natural semantic model for stochastic variants of process calculi and Petri nets, and it requires a process-theoretic treatment of supervisory control theory. To this end, we define a new behavioral preorder, termed Markovian partial bisimulation, that captures the notion of controllability while preserving correct stochastic behavior. We provide a sound and ground-complete axiomatic characterization of the preorder and, based on it, we define two notions of controllability. The first notion conforms to the traditional way of reasoning about supervision and control requirements, whereas in the second proposal we abstract from the stochastic behavior of the system. For the latter, we intend to separate the concerns regarding synthesis of an optimal supervisor. The control requirements cater only for controllability, whereas we ensure that the stochastic behavior of the supervised plant meets the performance specification by extracting directive optimal supervisors.
    Original languageEnglish
    Title of host publicationProceedings of the Eleventh International Conference on Application of Concurrency to System Design (ACSD 2011), 20-24 June, Newcastle Upon Tyne, UK
    EditorsB. Caillaud, J. Carmona, K. Hiraishi
    Place of PublicationPiscataway NJ
    PublisherInstitute of Electrical and Electronics Engineers
    Publication statusPublished - 2011


    Dive into the research topics of 'Towards supervisory control of interactive Markov chains: controllability'. Together they form a unique fingerprint.

    Cite this