Adaptive control of specially structured Markov chains

K.M. Hee, van

    Onderzoeksoutput: Boek/rapportRapportAcademic

    60 Downloads (Pure)


    We consider Markov decision processes where the state at time n+1 is a function of the state at time n, the action at time n and the outcome of a random variable Y_{n+1}. The random variables Y_1, Y_2, Y_3, ... are independent and identically distributed with an incompletely known distribution. The class of problems considered includes the linear system with quadratic cost and a simple inventory control model. The minimal Bayesian expected total cost is determined or approximated. The strategy that takes, at each time, the action that is optimal if the estimated distribution is the true distribution, is studied.
    Originele taal-2Engels
    Plaats van productieEindhoven
    UitgeverijTechnische Hogeschool Eindhoven
    Aantal pagina's18
    StatusGepubliceerd - 1976

    Publicatie series

    NaamMemorandum COSOR
    ISSN van geprinte versie0926-4493


    Duik in de onderzoeksthema's van 'Adaptive control of specially structured Markov chains'. Samen vormen ze een unieke vingerafdruk.

    Citeer dit