Sequential genetic search for ensemble feature selection

A. Tsymbal, M. Pechenizkiy, P. Cunningham

    Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

    18 Citations (Scopus)

    Abstract

    Ensemble learning constitutes one of the main di-rections in machine learning and data mining. Ensembles allow us to achieve higher accuracy, which is often not achievable with single models. One technique, which proved to be effective for constructing an ensemble of diverse classifiers, is the use of feature subsets. Among different approaches to ensemble feature selection, genetic search was shown to perform best in many domains. In this paper, a new strategy GAS-SEFS, Genetic Algo-rithm-based Sequential Search for Ensemble Feature Selection, is introduced. Instead of one genetic process, it employs a series of processes, the goal of each of which is to build one base classifier. Ex-periments on 21 data sets are conducted, comparing the new strategy with a previously considered genetic strategy for different ensemble sizes and for five different ensemble integration methods. The experiments show that GAS-SEFS, although being more time-consuming, often builds better ensembles, especially on data sets with larger numbers of features.
    Original languageEnglish
    Title of host publicationIJCAI-05 (Proceedings 19th International Joint Conference on Artificial Intelligence, Edinburgh, UK, July 30-August 5, 2005)
    EditorsL.P. Kaelbling, A. Saffiotti
    PublisherProfessional Book Center
    Pages877-882
    ISBN (Print)0-93807593-4
    Publication statusPublished - 2005

    Fingerprint Dive into the research topics of 'Sequential genetic search for ensemble feature selection'. Together they form a unique fingerprint.

  • Cite this

    Tsymbal, A., Pechenizkiy, M., & Cunningham, P. (2005). Sequential genetic search for ensemble feature selection. In L. P. Kaelbling, & A. Saffiotti (Eds.), IJCAI-05 (Proceedings 19th International Joint Conference on Artificial Intelligence, Edinburgh, UK, July 30-August 5, 2005) (pp. 877-882). Professional Book Center.