Abstract
The basic principles behind ensembles (e.g.
Random Forest, AdaBoost) are simple. But we’re still
in trouble when attempting to explain the logic taken.
Where does the problem lie? The reason that ensembles
are effective is that the base estimators "work
together" and compensate each for the others’
shortcomings.
The Nutcracker Framework Given a trained ensemble
and the relevant training / test dataset, construct prediction
matrix, M, cases (rows) against predictions (columns).
Bicluster M to a given number of R x C biclusters.
Now, investigate performance per bicluster (R x C).
Identify feature importance per base estimators group (C).
Describe each of the R cases subgroups in terms of
features and values. We use Exceptional Model Mining for that task.
Performance of the ensemble against the dataset
compared to performance of base estimator groups
against subgroups of cases, adds transparency.
Random Forest, AdaBoost) are simple. But we’re still
in trouble when attempting to explain the logic taken.
Where does the problem lie? The reason that ensembles
are effective is that the base estimators "work
together" and compensate each for the others’
shortcomings.
The Nutcracker Framework Given a trained ensemble
and the relevant training / test dataset, construct prediction
matrix, M, cases (rows) against predictions (columns).
Bicluster M to a given number of R x C biclusters.
Now, investigate performance per bicluster (R x C).
Identify feature importance per base estimators group (C).
Describe each of the R cases subgroups in terms of
features and values. We use Exceptional Model Mining for that task.
Performance of the ensemble against the dataset
compared to performance of base estimator groups
against subgroups of cases, adds transparency.
| Original language | English |
|---|---|
| Publication status | Published - Oct 2017 |
| Event | 16th International Symposium on Intelligent Data Analysis (IDA 2017), October 26-28, 2017, London, UK - London, United Kingdom Duration: 26 Oct 2017 → 28 Oct 2017 http://www.dcs.bbk.ac.uk/ida2017/ |
Conference
| Conference | 16th International Symposium on Intelligent Data Analysis (IDA 2017), October 26-28, 2017, London, UK |
|---|---|
| Abbreviated title | IDA 2017 |
| Country/Territory | United Kingdom |
| City | London |
| Period | 26/10/17 → 28/10/17 |
| Internet address |