Limited evaluation cooperative co-evolutionary differential evolution for large-scale neuroevolution

Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

5 Citations (Scopus)

Abstract

Many real-world control and classification tasks involve a large number of features. When artificial neural networks (ANNs) are used for modeling these tasks, the network architectures tend to be large. Neuroevolution is an effective approach for optimizing ANNs; however, there are two bottlenecks that make their application challenging in case of high-dimensional networks using direct encoding. First, classic evolutionary algorithms tend not to scale well for searching large parameter spaces; second, the network evaluation over a large number of training instances is in general time-consuming. In this work, we propose an approach called the Limited Evaluation Cooperative Co-evolutionary Differential Evolution algorithm (LECCDE) to optimize high-dimensional ANNs. The proposed method aims to optimize the pre-synaptic weights of each post-synaptic neuron in different subpopulations using a Cooperative Co-evolutionary Differential Evolution algorithm, and employs a limited evaluation scheme where fitness evaluation is performed on a relatively small number of training instances based on fitness inheritance. We test LECCDE on three datasets with various sizes, and our results show that cooperative co-evolution significantly improves the test error comparing to standard Differential Evolution, while the limited evaluation scheme facilitates a significant reduction in computing time.

LanguageEnglish
Title of host publicationGECCO 2018 - Proceedings of the 2018 Genetic and Evolutionary Computation Conference
PublisherAssociation for Computing Machinery, Inc
Pages569-576
Number of pages8
ISBN (Electronic)9781450356183
DOIs
StatePublished - 2 Jul 2018
Event2018 Genetic and Evolutionary Computation Conference, GECCO 2018 - Kyoto, Japan
Duration: 15 Jul 201819 Jul 2018

Conference

Conference2018 Genetic and Evolutionary Computation Conference, GECCO 2018
CountryJapan
CityKyoto
Period15/07/1819/07/18

Fingerprint

Neural networks
Network architecture
Evolutionary algorithms
Neurons

Keywords

  • Cooperative Co-evolution
  • Differential evolution
  • Direct encoding
  • Neuroevolution

Cite this

Yaman, A., Mocanu, D. C., Iacca, G., Fletcher, G., & Pechenizkiy, M. (2018). Limited evaluation cooperative co-evolutionary differential evolution for large-scale neuroevolution. In GECCO 2018 - Proceedings of the 2018 Genetic and Evolutionary Computation Conference (pp. 569-576). Association for Computing Machinery, Inc. DOI: 10.1145/3205455.3205555
Yaman, Anil ; Mocanu, Decebal Constantin ; Iacca, Giovanni ; Fletcher, George ; Pechenizkiy, Mykola. / Limited evaluation cooperative co-evolutionary differential evolution for large-scale neuroevolution. GECCO 2018 - Proceedings of the 2018 Genetic and Evolutionary Computation Conference. Association for Computing Machinery, Inc, 2018. pp. 569-576
@inproceedings{25ce5e7a7dcd4327883237e6cf13c12a,
title = "Limited evaluation cooperative co-evolutionary differential evolution for large-scale neuroevolution",
abstract = "Many real-world control and classification tasks involve a large number of features. When artificial neural networks (ANNs) are used for modeling these tasks, the network architectures tend to be large. Neuroevolution is an effective approach for optimizing ANNs; however, there are two bottlenecks that make their application challenging in case of high-dimensional networks using direct encoding. First, classic evolutionary algorithms tend not to scale well for searching large parameter spaces; second, the network evaluation over a large number of training instances is in general time-consuming. In this work, we propose an approach called the Limited Evaluation Cooperative Co-evolutionary Differential Evolution algorithm (LECCDE) to optimize high-dimensional ANNs. The proposed method aims to optimize the pre-synaptic weights of each post-synaptic neuron in different subpopulations using a Cooperative Co-evolutionary Differential Evolution algorithm, and employs a limited evaluation scheme where fitness evaluation is performed on a relatively small number of training instances based on fitness inheritance. We test LECCDE on three datasets with various sizes, and our results show that cooperative co-evolution significantly improves the test error comparing to standard Differential Evolution, while the limited evaluation scheme facilitates a significant reduction in computing time.",
keywords = "Cooperative Co-evolution, Differential evolution, Direct encoding, Neuroevolution",
author = "Anil Yaman and Mocanu, {Decebal Constantin} and Giovanni Iacca and George Fletcher and Mykola Pechenizkiy",
year = "2018",
month = "7",
day = "2",
doi = "10.1145/3205455.3205555",
language = "English",
pages = "569--576",
booktitle = "GECCO 2018 - Proceedings of the 2018 Genetic and Evolutionary Computation Conference",
publisher = "Association for Computing Machinery, Inc",
address = "United States",

}

Yaman, A, Mocanu, DC, Iacca, G, Fletcher, G & Pechenizkiy, M 2018, Limited evaluation cooperative co-evolutionary differential evolution for large-scale neuroevolution. in GECCO 2018 - Proceedings of the 2018 Genetic and Evolutionary Computation Conference. Association for Computing Machinery, Inc, pp. 569-576, 2018 Genetic and Evolutionary Computation Conference, GECCO 2018, Kyoto, Japan, 15/07/18. DOI: 10.1145/3205455.3205555

Limited evaluation cooperative co-evolutionary differential evolution for large-scale neuroevolution. / Yaman, Anil; Mocanu, Decebal Constantin; Iacca, Giovanni; Fletcher, George; Pechenizkiy, Mykola.

GECCO 2018 - Proceedings of the 2018 Genetic and Evolutionary Computation Conference. Association for Computing Machinery, Inc, 2018. p. 569-576.

Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

TY - GEN

T1 - Limited evaluation cooperative co-evolutionary differential evolution for large-scale neuroevolution

AU - Yaman,Anil

AU - Mocanu,Decebal Constantin

AU - Iacca,Giovanni

AU - Fletcher,George

AU - Pechenizkiy,Mykola

PY - 2018/7/2

Y1 - 2018/7/2

N2 - Many real-world control and classification tasks involve a large number of features. When artificial neural networks (ANNs) are used for modeling these tasks, the network architectures tend to be large. Neuroevolution is an effective approach for optimizing ANNs; however, there are two bottlenecks that make their application challenging in case of high-dimensional networks using direct encoding. First, classic evolutionary algorithms tend not to scale well for searching large parameter spaces; second, the network evaluation over a large number of training instances is in general time-consuming. In this work, we propose an approach called the Limited Evaluation Cooperative Co-evolutionary Differential Evolution algorithm (LECCDE) to optimize high-dimensional ANNs. The proposed method aims to optimize the pre-synaptic weights of each post-synaptic neuron in different subpopulations using a Cooperative Co-evolutionary Differential Evolution algorithm, and employs a limited evaluation scheme where fitness evaluation is performed on a relatively small number of training instances based on fitness inheritance. We test LECCDE on three datasets with various sizes, and our results show that cooperative co-evolution significantly improves the test error comparing to standard Differential Evolution, while the limited evaluation scheme facilitates a significant reduction in computing time.

AB - Many real-world control and classification tasks involve a large number of features. When artificial neural networks (ANNs) are used for modeling these tasks, the network architectures tend to be large. Neuroevolution is an effective approach for optimizing ANNs; however, there are two bottlenecks that make their application challenging in case of high-dimensional networks using direct encoding. First, classic evolutionary algorithms tend not to scale well for searching large parameter spaces; second, the network evaluation over a large number of training instances is in general time-consuming. In this work, we propose an approach called the Limited Evaluation Cooperative Co-evolutionary Differential Evolution algorithm (LECCDE) to optimize high-dimensional ANNs. The proposed method aims to optimize the pre-synaptic weights of each post-synaptic neuron in different subpopulations using a Cooperative Co-evolutionary Differential Evolution algorithm, and employs a limited evaluation scheme where fitness evaluation is performed on a relatively small number of training instances based on fitness inheritance. We test LECCDE on three datasets with various sizes, and our results show that cooperative co-evolution significantly improves the test error comparing to standard Differential Evolution, while the limited evaluation scheme facilitates a significant reduction in computing time.

KW - Cooperative Co-evolution

KW - Differential evolution

KW - Direct encoding

KW - Neuroevolution

UR - http://www.scopus.com/inward/record.url?scp=85050642203&partnerID=8YFLogxK

U2 - 10.1145/3205455.3205555

DO - 10.1145/3205455.3205555

M3 - Conference contribution

SP - 569

EP - 576

BT - GECCO 2018 - Proceedings of the 2018 Genetic and Evolutionary Computation Conference

PB - Association for Computing Machinery, Inc

ER -

Yaman A, Mocanu DC, Iacca G, Fletcher G, Pechenizkiy M. Limited evaluation cooperative co-evolutionary differential evolution for large-scale neuroevolution. In GECCO 2018 - Proceedings of the 2018 Genetic and Evolutionary Computation Conference. Association for Computing Machinery, Inc. 2018. p. 569-576. Available from, DOI: 10.1145/3205455.3205555