State-coupled replicator dynamics

D. Hennes, K.P. Tuyls, G.W.M. Rauterberg

    Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

    14 Citations (Scopus)
    1 Downloads (Pure)

    Abstract

    This paper introduces a new model, i.e. state-coupled replicator dynamics, expanding the link between evolutionary game theory and multiagent reinforcement learning to multistate games. More precisely, it extends and improves previous work on piecewise replicator dynamics, a combination of replicators and piecewise models. The contributions of the paper are twofold. One, we identify and explain the major shortcomings of piecewise replicators, i.e. discontinuities and occurrences of qualitative anomalies. Two, this analysis leads to the proposal of the new model for learning dynamics in stochastic games, named state-coupled replicator dynamics. The preceding formalization of piecewise replicators - general in the number of agents and states - is factored into the new approach. Finally, we deliver a comparative study of finite action-set learning automata to piecewise and state-coupled replicator dynamics. Results show that statecoupled replicators model learning dynamics in stochastic games more accurately than their predecessor, the piecewise approach.
    Original languageEnglish
    Title of host publication8th International Conference on Autonomous Agents and Multiagent Systems - AAMAS 2009
    Place of PublicationNew York
    PublisherAssociation for Computing Machinery, Inc
    Pages789-796
    Volume2
    ISBN (Print)978-0-9817381-7-8
    Publication statusPublished - 2009
    Event8th International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2009), May 10-15, 2009, Budapest, Hungary - Europa Congress Center, Budapest, Hungary
    Duration: 10 May 200915 May 2009
    http://www.conferences.hu/AAMAS2009/

    Conference

    Conference8th International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2009), May 10-15, 2009, Budapest, Hungary
    Abbreviated titleAAMAS 2009
    CountryHungary
    CityBudapest
    Period10/05/0915/05/09
    Internet address

    Fingerprint

    Dive into the research topics of 'State-coupled replicator dynamics'. Together they form a unique fingerprint.

    Cite this