Two-dimensional Markov chains with geometric jumps

I.J.B.F. Adan, J.W.C.H. Visschers, J. Wessels

    Onderzoeksoutput: Boek/rapportRapportAcademic

    42 Downloads (Pure)


    Several queueing problems lead to Markov chains with jumps of unbounded length, particularly with geometric behaviour in one or more directions. In the present paper the equilibrium behaviour is analysed for two-dimensional nearest neighbour random walks, which may make geometric jumps in one direction. The first step in the analysis consists of searching for product forms satisfying the equilibrium equations for inner states. This is made possible by simplifying the equations by taking differences of equations for neighbouring states in a well-chosen direction. Such a difference is called \Delta-equation. It appears that the \Delta-equation is state-independent. Therefore one obtains two equations, the starting equation and the \Delta-equation; these equations have a large set of product form solutions S. It appears that, in the case of no transitions from inner states to the North, North-East and East, plus some restrictions on the horizontal boundary, there is a linear combination of countably many product forms from S which satisfies the boundary equations. This linear ombination may be constructed with a compensation procedure. In other cases there is a finite linear combination from S satisfying the boundary equations, if the boundary equations satisfy some rather severe extra conditions.
    Originele taal-2Engels
    Plaats van productieEindhoven
    UitgeverijTechnische Universiteit Eindhoven
    Aantal pagina's28
    StatusGepubliceerd - 1999

    Publicatie series

    NaamMemorandum COSOR
    ISSN van geprinte versie0926-4493

    Vingerafdruk Duik in de onderzoeksthema's van 'Two-dimensional Markov chains with geometric jumps'. Samen vormen ze een unieke vingerafdruk.

    Citeer dit