Hyper-parameter tuning of a decision tree induction algorithm

R.G. Mantovani, T. Horváth, R. Cerri, J. Vanschoren, A.C.P.L.F. de Carvalho

Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

10 Citations (Scopus)
3 Downloads (Pure)

Abstract

Supervised classification is the most studied task in Machine Learning. Among the many algorithms used in such task, Decision Tree algorithms are a popular choice, since they are robust and efficient to construct. Moreover, they have the advantage of producing comprehensible models and satisfactory accuracy levels in several application domains. Like most of the Machine Leaning methods, these algorithms have some hyper-parameters whose values directly affect the performance of the induced models. Due to the high number of possibilities for these hyper-parameter values, several studies use optimization techniques to find a good set of solutions in order to produce classifiers with good predictive performance. This study investigates how sensitive decision trees are to a hyper-parameter optimization process. Four different tuning techniques were explored to adjust J48 Decision Tree algorithm hyper-parameters. In total, experiments using 102 heterogeneous datasets analyzed the tuning effect on the induced models. The experimental results show that even presenting a low average improvement over all datasets, in most of the cases the improvement is statistically significant.
Original languageEnglish
Title of host publication5th Brazilian Conference on Intelligent Systems, BRACIS 2016; Recife, Pernambuco; Brazil; 9 October 2016 through 12 October 2016
Place of PublicationPiscataway
PublisherInstitute of Electrical and Electronics Engineers
Pages37-42
Number of pages6
ISBN (Electronic)9781509035663
DOIs
Publication statusPublished - 1 Feb 2017
Event5th Brazilian Conference on Intelligent System - BRACIS 2016, At Recife, Pernambuco, Brazil - Recife , Brazil
Duration: 9 Oct 201612 Oct 2016

Conference

Conference5th Brazilian Conference on Intelligent System - BRACIS 2016, At Recife, Pernambuco, Brazil
Abbreviated titleBRACIS 2016
CountryBrazil
CityRecife
Period9/10/1612/10/16

Fingerprint Dive into the research topics of 'Hyper-parameter tuning of a decision tree induction algorithm'. Together they form a unique fingerprint.

  • Cite this

    Mantovani, R. G., Horváth, T., Cerri, R., Vanschoren, J., & de Carvalho, A. C. P. L. F. (2017). Hyper-parameter tuning of a decision tree induction algorithm. In 5th Brazilian Conference on Intelligent Systems, BRACIS 2016; Recife, Pernambuco; Brazil; 9 October 2016 through 12 October 2016 (pp. 37-42). [7839559] Piscataway: Institute of Electrical and Electronics Engineers. https://doi.org/10.1109/BRACIS.2016.018