Skip to main navigation Skip to search Skip to main content

A variable clustering approach for overdispersed high-dimensional count data using a copula-based mixture model

Research output: Contribution to journalArticleAcademicpeer-review

156 Downloads (Pure)

Abstract

In this paper, we propose a latent variable model for the analysis and clustering of high-dimensional correlated and overdispersed count data. We use a set of random effects to capture within-group correlations and a copula to address between-group correlations. Since maximum likelihood (ML) estimation is computationally intensive for high-dimensional data, we propose a fast moment-based estimation procedure. Additionally, we implement the proposed estimation procedure into a clustering algorithm, borrowing ideas from the K-means algorithm. Based on a simulation study, we demonstrate that the estimation procedure shows good stability and precision. Furthermore, it is computationally fast, unlike the ML approach which shows serious convergence issues. In addition, the clustering algorithm with our moment-based estimation procedure can identify the simulated grouped data structure. The approach is further illustrated with a high-dimensional RNA-Seq dataset of commercial potatoes.

Original languageEnglish
Pages (from-to)2564-2584
Number of pages21
JournalCommunications in Statistics: Simulation and Computation
Volume54
Issue number7
DOIs
Publication statusPublished - 2025

Funding

This work was funded by NWO-PTA-COAST3 through the Outfitting the Factory of the Future with Online analysis (OFF/On) consortium, grant number 053.021.114. The authors would like to thank the reviewer for the insightful comments and suggestions for the improvement of the paper.

Keywords

  • Clustering variables
  • Copula modeling
  • Count data
  • High-dimensional data
  • Mixture modeling
  • Overdispersion

Fingerprint

Dive into the research topics of 'A variable clustering approach for overdispersed high-dimensional count data using a copula-based mixture model'. Together they form a unique fingerprint.

Cite this