Nonparametric Bayesian model selection and averaging

S. Ghosal, J. Lember, A.W. Vaart, van der

Research output: Book/ReportReportAcademic


We consider nonparametric Bayesian estimation of a probability density p based on a random sample of size n from this density using a hierarchical prior. The prior consists, for instance, of prior weights on the regularity of the unknown density combined with priors that are appropriate given that the density has this regularity. More generally, the hierarchy consists of prior weights on an abstract model index and a prior on a density model for each model index. We present a general theorem on the rate of contraction of the resulting posterior distribution as n¿8, which gives conditions under which the rate of contraction is the one attached to the model that best approximates the true density of the obser- vations. This shows that, for instance, the posterior distribution can adapt to the smoothness of the underlying density. We also study the posterior distribution of the model index, and find that under the same conditions the posterior distribution gives negligible weight to models that are bigger than the optimal one, and thus selects the optimal model or smaller models that also approximate the true density well. We apply these result to log spline density models, where we show that the prior weights on the regularity index interact with the priors on the models, making the exact rates depend in a complicated way on the priors, but also that the rate is fairly robust to specification of the prior weights.
Original languageEnglish
Place of PublicationEindhoven
Number of pages27
Publication statusPublished - 2008

Publication series

NameReport Eurandom
ISSN (Print)1389-2355


Dive into the research topics of 'Nonparametric Bayesian model selection and averaging'. Together they form a unique fingerprint.

Cite this