The goal of science is to accumulate knowledge that answers questions such as "How do things work?" and "Why do they work that way?" Scientists use a variety of methodologies to describe, predict, and explain natural phenomena. These methods are so diverse that it is difficult to define a unique scientific method, although all scientific methodologies share the assumption of repeatability (Hempel & Oppenheim, 1948; Kuhn, 1962; Popper, 1934; Salmon, 1989). In this chapter, we first briefly review why replications are highly valued but rarely published. Then we describe a collaborative effort — the Reproducibility Project — to estimate the rate and predictors of reproducibility in psychological science. Finally, we detail how we are conducting this project as a large-scale, distributed, open collaboration. A description of the procedures and challenges may assist and inspire other teams to conduct similar projects in other areas of science.
|Title of host publication||Implementing reproducible research|
|Editors||V. Stodden, F. Leisch, R.D. Peng|
|Place of Publication||Osa Roca|
|Publisher||Taylor and Francis Ltd.|
|Number of pages||448|
|Publication status||Published - 2014|
|Name||Chapman & Hall/CRC The R Series|