ICIE 1.0: a novel tool for interactive contextual interaction explanations

Simon B. van der Zon, Wouter Duivesteijn, Werner van Ipenburg, Jan Veldsink, Mykola Pechenizkiy

Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

2 Citations (Scopus)
2 Downloads (Pure)


With the rise of new laws around privacy and awareness, explanation of automated decision making becomes increasingly important. Nowadays, machine learning models are used to aid experts in domains such as banking and insurance to find suspicious transactions, approve loans and credit card applications. Companies using such systems have to be able to provide the rationale behind their decisions; blindly relying on the trained model is not sufficient. There are currently a number of methods that provide insights in models and their decisions, but often they are either good at showing global or local behavior. Global behavior is often too complex to visualize or comprehend, so approximations are shown, and visualizing local behavior is often misleading as it is difficult to define what local exactly means (i.e. our methods don’t “know” how easily a feature-value can be changed; which ones are flexible, and which ones are static). We introduce the ICIE framework (Interactive Contextual Interaction Explanations) which enables users to view explanations of individual instances under different contexts. We will see that various contexts for the same case lead to different explanations, revealing different feature interactions.

Original languageEnglish
Title of host publicationECML PKDD 2018 Workshops - MIDAS 2018 and PAP 2018, Proceedings
EditorsAnna Monreale, Carlos Alzate
Place of PublicationCham
Number of pages14
ISBN (Electronic)978-3-030-13463-1
ISBN (Print)978-3-030-13462-4
Publication statusPublished - 1 Jan 2019
Event2018 European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases (ECML PKDD 2018) - Dublin, Ireland
Duration: 10 Sep 201814 Sep 2018
Conference number: 18

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume11054 LNAI
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349


Conference2018 European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases (ECML PKDD 2018)
Abbreviated titleECML PKDD 2018
Other3rd Workshop on Mining Data for Financial Applications, MIDAS 2018 and 2nd International Workshop on Personal Analytics and Privacy, PAP 2018 held at 18th European Conference on Machine Learning and Knowledge Discovery in Databases, ECML PKDD 2018


  • Awareness
  • Explanations
  • Feature contributions
  • Feature interactions
  • Model transparency
  • Responsible analytics
  • Trust


Dive into the research topics of 'ICIE 1.0: a novel tool for interactive contextual interaction explanations'. Together they form a unique fingerprint.

Cite this