DREAMTools: a Python package for scoring collaborative challenges

T. Cokelaer, M. Bansal, C. Bare, E. Bilal, B.M. Bot, E. Chaibub Neto, F. Eduati, A. de la Fuente, M. Gönen, S.M. Hill, B. Hoff, J.R. Karr, R. Küffner, M.P. Menden, P. Meyer, R. Norel, A. Pratap, R.J. Prill, M.T. Weirauch, J.C. CostelloG. Stolovitzky, J. Saez-Rodriguez

Onderzoeksoutput: Bijdrage aan tijdschriftTijdschriftartikelAcademicpeer review

9 Citaten (Scopus)
299 Downloads (Pure)


DREAM challenges are community competitions designed to advance computational methods and address fundamental questions in system biology and translational medicine. Each challenge asks participants to develop and apply computational methods to either predict unobserved outcomes or to identify unknown model parameters given a set of training data. Computational methods are evaluated using an automated scoring metric, scores are posted to a public leaderboard, and methods are published to facilitate community discussions on how to build improved methods. By engaging participants from a wide range of science and engineering backgrounds, DREAM challenges can comparatively evaluate a wide range of statistical, machine learning, and biophysical methods. Here, we describe DREAMTools, a Python package for evaluating DREAM challenge scoring metrics. DREAMTools provides a command line interface that enables researchers to test new methods on past challenges, as well as a framework for scoring new challenges. As of March 2016, DREAMTools includes more than 80% of completed DREAM challenges. DREAMTools complements the data, metadata, and software tools available at the DREAM website http://dreamchallenges.org and on the Synapse platform at https://www.synapse.org. Availability: DREAMTools is a Python package. Releases and documentation are available at http://pypi.python.org/pypi/dreamtools. The source code is available at http://github.com/dreamtools/dreamtools.

Originele taal-2Engels
Aantal pagina's28
StatusGepubliceerd - 2015
Extern gepubliceerdJa


Duik in de onderzoeksthema's van 'DREAMTools: a Python package for scoring collaborative challenges'. Samen vormen ze een unieke vingerafdruk.

Citeer dit