Tests for publication bias are unreliable in case of heteroscedasticity

Osama Almalik, Zhuozhao Zhan, Edwin R. van den Heuvel (Corresponding author)

Research output: Contribution to journalArticleAcademicpeer-review

9 Citations (Scopus)
67 Downloads (Pure)

Abstract

Regression based methods for the detection of publication bias in meta-analysis have been extensively evaluated in literature. When dealing with continuous outcomes, specific hidden factors (e.g., heteroscedasticity) may interfere with the test statistics. In this paper we investigate the influence of residual heteroscedasticity on the performance of four tests for publication bias: the Egger test, the Begg-Mazumdar test and two tests based on weighted regression. In the presence of heteroscedasticity, the Egger test and the weighted regression tests highly inflate the Type I error rate, while the Begg-Mazumdar test deflates the Type I error rate. Although all three tests already have low statistical power, heteroscedasticity typically reduces it further. Our results in combination with earlier discussions on publication bias tests lead us to conclude that application of these tests on continuous treatment effects is not warranted.

Original languageEnglish
Article number100781
Number of pages6
JournalContemporary Clinical Trials Communications
Volume22
DOIs
Publication statusPublished - Jun 2021

Bibliographical note

Funding Information:
This research was funded by grant number 023.005.087 from the Netherlands Organization for Scientific Research .

Funding

This research was funded by grant number 023.005.087 from the Netherlands Organization for Scientific Research .

Keywords

  • Aggregated data meta-analysis
  • Heteroscedastic mixed effects model
  • Mean difference treatment effect sizes

Fingerprint

Dive into the research topics of 'Tests for publication bias are unreliable in case of heteroscedasticity'. Together they form a unique fingerprint.

Cite this