Multiple perspectives on inference for two simple statistical scenarios

Noah N.N. van Dongen (Corresponding author), Johnny B. van Doorn, Quentin F. Gronau, Don van Ravenzwaaij, Rink Hoekstra, Matthias N. Haucke, Daniel Lakens, Christian Hennig, Richard D. Morey, Saskia Homer, Andrew Gelman, Jan Sprenger, Eric Jan Wagenmakers (Corresponding author)

Research output: Contribution to journalArticleAcademicpeer-review

1 Citation (Scopus)

Abstract

When data analysts operate within different statistical frameworks (e.g., frequentist versus Bayesian, emphasis on estimation versus emphasis on testing), how does this impact the qualitative conclusions that are drawn for real data? To study this question empirically we selected from the literature two simple scenarios—involving a comparison of two proportions and a Pearson correlation—and asked four teams of statisticians to provide a concise analysis and a qualitative interpretation of the outcome. The results showed considerable overall agreement; nevertheless, this agreement did not appear to diminish the intensity of the subsequent debate over which statistical framework is more appropriate to address the questions at hand.

LanguageEnglish
Pages328-339
Number of pages12
JournalAmerican Statistician
Volume73
Issue numbersup1
DOIs
StatePublished - 29 Mar 2019

Fingerprint

Scenarios
Pearson Correlation
Proportion
Testing
Framework
Multiple perspectives
Inference
Interpretation
Analysts

Keywords

  • Frequentist or Bayesian
  • Multilab analysis
  • Statistical paradigms
  • Testing or estimation

Cite this

van Dongen, N. N. N., van Doorn, J. B., Gronau, Q. F., van Ravenzwaaij, D., Hoekstra, R., Haucke, M. N., ... Wagenmakers, E. J. (2019). Multiple perspectives on inference for two simple statistical scenarios. American Statistician, 73(sup1), 328-339. DOI: 10.1080/00031305.2019.1565553
van Dongen, Noah N.N. ; van Doorn, Johnny B. ; Gronau, Quentin F. ; van Ravenzwaaij, Don ; Hoekstra, Rink ; Haucke, Matthias N. ; Lakens, Daniel ; Hennig, Christian ; Morey, Richard D. ; Homer, Saskia ; Gelman, Andrew ; Sprenger, Jan ; Wagenmakers, Eric Jan. / Multiple perspectives on inference for two simple statistical scenarios. In: American Statistician. 2019 ; Vol. 73, No. sup1. pp. 328-339
@article{4b579a68dc6e41e787f8939d614363a6,
title = "Multiple perspectives on inference for two simple statistical scenarios",
abstract = "When data analysts operate within different statistical frameworks (e.g., frequentist versus Bayesian, emphasis on estimation versus emphasis on testing), how does this impact the qualitative conclusions that are drawn for real data? To study this question empirically we selected from the literature two simple scenarios—involving a comparison of two proportions and a Pearson correlation—and asked four teams of statisticians to provide a concise analysis and a qualitative interpretation of the outcome. The results showed considerable overall agreement; nevertheless, this agreement did not appear to diminish the intensity of the subsequent debate over which statistical framework is more appropriate to address the questions at hand.",
keywords = "Frequentist or Bayesian, Multilab analysis, Statistical paradigms, Testing or estimation",
author = "{van Dongen}, {Noah N.N.} and {van Doorn}, {Johnny B.} and Gronau, {Quentin F.} and {van Ravenzwaaij}, Don and Rink Hoekstra and Haucke, {Matthias N.} and Daniel Lakens and Christian Hennig and Morey, {Richard D.} and Saskia Homer and Andrew Gelman and Jan Sprenger and Wagenmakers, {Eric Jan}",
year = "2019",
month = "3",
day = "29",
doi = "10.1080/00031305.2019.1565553",
language = "English",
volume = "73",
pages = "328--339",
journal = "American Statistician",
issn = "0003-1305",
publisher = "American Statistical Association",
number = "sup1",

}

van Dongen, NNN, van Doorn, JB, Gronau, QF, van Ravenzwaaij, D, Hoekstra, R, Haucke, MN, Lakens, D, Hennig, C, Morey, RD, Homer, S, Gelman, A, Sprenger, J & Wagenmakers, EJ 2019, 'Multiple perspectives on inference for two simple statistical scenarios' American Statistician, vol. 73, no. sup1, pp. 328-339. DOI: 10.1080/00031305.2019.1565553

Multiple perspectives on inference for two simple statistical scenarios. / van Dongen, Noah N.N. (Corresponding author); van Doorn, Johnny B.; Gronau, Quentin F.; van Ravenzwaaij, Don; Hoekstra, Rink; Haucke, Matthias N.; Lakens, Daniel; Hennig, Christian; Morey, Richard D.; Homer, Saskia; Gelman, Andrew; Sprenger, Jan; Wagenmakers, Eric Jan (Corresponding author).

In: American Statistician, Vol. 73, No. sup1, 29.03.2019, p. 328-339.

Research output: Contribution to journalArticleAcademicpeer-review

TY - JOUR

T1 - Multiple perspectives on inference for two simple statistical scenarios

AU - van Dongen,Noah N.N.

AU - van Doorn,Johnny B.

AU - Gronau,Quentin F.

AU - van Ravenzwaaij,Don

AU - Hoekstra,Rink

AU - Haucke,Matthias N.

AU - Lakens,Daniel

AU - Hennig,Christian

AU - Morey,Richard D.

AU - Homer,Saskia

AU - Gelman,Andrew

AU - Sprenger,Jan

AU - Wagenmakers,Eric Jan

PY - 2019/3/29

Y1 - 2019/3/29

N2 - When data analysts operate within different statistical frameworks (e.g., frequentist versus Bayesian, emphasis on estimation versus emphasis on testing), how does this impact the qualitative conclusions that are drawn for real data? To study this question empirically we selected from the literature two simple scenarios—involving a comparison of two proportions and a Pearson correlation—and asked four teams of statisticians to provide a concise analysis and a qualitative interpretation of the outcome. The results showed considerable overall agreement; nevertheless, this agreement did not appear to diminish the intensity of the subsequent debate over which statistical framework is more appropriate to address the questions at hand.

AB - When data analysts operate within different statistical frameworks (e.g., frequentist versus Bayesian, emphasis on estimation versus emphasis on testing), how does this impact the qualitative conclusions that are drawn for real data? To study this question empirically we selected from the literature two simple scenarios—involving a comparison of two proportions and a Pearson correlation—and asked four teams of statisticians to provide a concise analysis and a qualitative interpretation of the outcome. The results showed considerable overall agreement; nevertheless, this agreement did not appear to diminish the intensity of the subsequent debate over which statistical framework is more appropriate to address the questions at hand.

KW - Frequentist or Bayesian

KW - Multilab analysis

KW - Statistical paradigms

KW - Testing or estimation

UR - http://www.scopus.com/inward/record.url?scp=85063200218&partnerID=8YFLogxK

U2 - 10.1080/00031305.2019.1565553

DO - 10.1080/00031305.2019.1565553

M3 - Article

VL - 73

SP - 328

EP - 339

JO - American Statistician

T2 - American Statistician

JF - American Statistician

SN - 0003-1305

IS - sup1

ER -

van Dongen NNN, van Doorn JB, Gronau QF, van Ravenzwaaij D, Hoekstra R, Haucke MN et al. Multiple perspectives on inference for two simple statistical scenarios. American Statistician. 2019 Mar 29;73(sup1):328-339. Available from, DOI: 10.1080/00031305.2019.1565553