Strongly reinforced Pólya urns with graph-based competition

R.W. Hofstad, van der, M.P. Holmes, A. Kuznetsov, W.M. Ruszel

Onderzoeksoutput: Boek/rapportRapportAcademic

65 Downloads (Pure)


We introduce a class of reinforcement models where, at each time step t, one ¿rst chooses a random subset A_t of colours (independent of the past) from n colours of balls, and then chooses a colour i from this subset with probability proportional to the number of balls of colour i in the urn raised to the power a > 1. We consider stability of equilibria for such models and establish the existence of phase transitions in a number of examples, including when the colours are the edges of a graph, a context which is a toy model for the formation and reinforcement of neural connections. Keywords: reinforcement model, Pólya urn, stochastic approximation algorithm, stable equilibria
Originele taal-2Engels
Plaats van productieEindhoven
Aantal pagina's32
StatusGepubliceerd - 2014

Publicatie series

NaamReport Eurandom
ISSN van geprinte versie1389-2355


Citeer dit

Hofstad, van der, R. W., Holmes, M. P., Kuznetsov, A., & Ruszel, W. M. (2014). Strongly reinforced Pólya urns with graph-based competition. (Report Eurandom; Vol. 2014015). Eindhoven: Eurandom.