Clustering big data streams: recent challenges and contributions

M. Hassani, T. Seidl

    Research output: Contribution to journalArticleAcademicpeer-review

    152 Downloads (Pure)

    Abstract

    Traditional clustering algorithms merely considered static data. Today's various applications and research issues in big data mining have however to deal with continuous, possibly infinite streams of data, arriving at high velocity. Web traffic data, surveillance data, sensor measurements and stock trading are only some examples of these daily-increasing applications.

    Since the growth of data volumes is accompanied by a similar raise in their dimensionalities, clusters cannot be expected to completely appear when considering all attributes together. Subspace clustering is a general approach that solved that issue by automatically finding the hidden clusters within different subsets of the attributes rather than considering all attributes together.

    In this article, novel methods for an efficient subspace clustering of high-dimensional big data streams are presented. Approaches that efficiently combine the anytime clustering concept with the stream subspace clustering paradigm are discussed. Additionally, efficient and adaptive density-based clustering algorithms are presented for high-dimensional data streams. Novel open-source assessment framework and evaluation measures are additionally presented for subspace stream clustering.
    Original languageEnglish
    Pages (from-to)206-213
    JournalIT - Information Technology
    Volume58
    Issue number4
    DOIs
    Publication statusPublished - Aug 2016

    Keywords

    • Subspace clustering
    • Big Data
    • data streams

    Cite this