Using predictive differences to design experiments for model selection

J. Vanlier, C.A. Tiemann, J. Timmer, P.A.J. Hilbers, N.A.W. Riel, van

Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademic

Abstract

Mathematical models are often used to formalize hypotheses on how a biochemical network operates. By selecting between competing models, different hypotheses can be compared. It is possible to estimate the evidence that data provides in support of one model over another. In a Bayesian framework, this is typically done by computing Bayes factors. When data is insufficiently informative to make a clear distinction, more data is required. Although the Bayesian model selection apparatus is suitable for selecting models, predicting distributions of Bayes factors is highly infeasible due to the computational complexity this involves. In this work, we propose searching for the experiment which optimally enables model selection by looking at predictive differences. We do so by simulating the posterior predictive distribution over new potential experiments. In many cases, distributions for single predictions typically show a large degree of overlap. The relations between the different prediction uncertainties depend on both the data and the model. Differences in these inter-prediction relations between competing models can be probed and used. In this work, we quantify differences in predictive distributions by means of the Jensen-Shannon divergence between predictive distributions belonging to competing models. The proposed method is evaluated by comparing its outcome to a predicted change in Bayes Factor upon simulating the experiment. Our simulations suggest that the Jensen-Shannon divergence between predictive densities is monotonically related to the increase in Bayes factor pointing toward the correct model. Therefore, it can be used to predict which experiments can effectively discriminate between models.
Original languageEnglish
Title of host publication5th Conference on Systems Biology of Mammalian Cells (SBMC2014), 12-14 May 2014, Berlin, Germany
Pages50-51
Publication statusPublished - 2014
Event5th Conference on Systems Biology of Mammalian Cells (SBMC 2014), May 12-14, 2014, Berlin, Germany - Berlin, Germany
Duration: 12 May 201414 May 2014

Conference

Conference5th Conference on Systems Biology of Mammalian Cells (SBMC 2014), May 12-14, 2014, Berlin, Germany
Abbreviated titleSBMC 2014
CountryGermany
CityBerlin
Period12/05/1414/05/14

Fingerprint Dive into the research topics of 'Using predictive differences to design experiments for model selection'. Together they form a unique fingerprint.

Cite this