Switching dynamics of multi-agent learning

P. Vrancx, K.P. Tuyls, R. Westra

    Onderzoeksoutput: Hoofdstuk in Boek/Rapport/CongresprocedureConferentiebijdrageAcademicpeer review

    21 Citaten (Scopus)

    Samenvatting

    This paper presents the dynamics of multi-agent reinforcement learning in multiple state problems. We extend previous work that formally modelled the relation between reinforcement learning agents and replicator dynamics in stateless multi-agent games. More precisely, in this work we use a combination of replicator dynamics and switching dynamics to model multi-agent learning automata in multi-state games. This is the first time that the dynamics of problems with more than one state is considered with replicator equations. Previously, it was unclear how the replicator dynamics of stateless games had to be extended to account for multiple states. We use our model to visualize the basin of attraction of the learning agents and the boundaries of switching dynamics at which an agent possibly arrives in a new dynamical system. Our model allows to analyze and predict the behavior of the different learning agents in a wide variety of multi-state problems. In our experiments we illustrate this powerful method in two games with two agents and two states.
    Originele taal-2Engels
    TitelProceedings of the Seventh International Conference on Autonomous Agents and Multi-Agent Systems, AAMAS'08, Estoril, Portugal.
    Plaats van productieNew York
    UitgeverijAssociation for Computing Machinery, Inc
    Pagina's307-314
    Volume1
    ISBN van geprinte versie978-0-9817381-0-9
    StatusGepubliceerd - 2008
    Evenement7th International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2008), May 12-16, 2008, Estoril, Portugal - Estoril, Portugal
    Duur: 12 mei 200816 mei 2008

    Congres

    Congres7th International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2008), May 12-16, 2008, Estoril, Portugal
    Verkorte titelAAMAS 2008
    LandPortugal
    StadEstoril
    Periode12/05/0816/05/08
    AnderInternational Conference on Autonomous Agents : AAMAS'08, 12-16 May 2008, Estoril, Portugal.

    Vingerafdruk Duik in de onderzoeksthema's van 'Switching dynamics of multi-agent learning'. Samen vormen ze een unieke vingerafdruk.

    Citeer dit