Skip to search boxSkip to navigationSkip to main content

Reliable Multi-class Classification based on Pairwise Epistemic and Aleatoric Uncertainty

  • Vu-Linh Nguyen
    ,
  • Sébastien Destercke
    ,
  • Marie-Hélène Masson
    ,
  • Eyke Hüllermeier
  • Sorbonne Université
Output:
Chapter in Book/Report/Conference proceeding
Conference contribution
Academic
Peer-review

Information

Output type

Output:
Chapter in Book/Report/Conference proceeding
Conference contribution
Academic
Peer-review

Original language

English

Pages from-to (Number of pages)

Pages 5089-5095 (7 pages)

Publication milestones

  • Published - 2018

Publication status

Published - 2018

Publisher

International Joint Conferences on Artificial Intelligence (IJCAI)

Host publication title

Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence

Abstract

We propose a method for reliable prediction in multi-class classification, where reliability refers to the possibility of partial abstention in cases of uncertainty. More specifically, we allow for predictions in the form of preorder relations on the set of classes, thereby generalizing the idea of set-valued predictions. Our approach relies on combining learning by pairwise comparison with a recent proposal for modeling uncertainty in classification, in which a distinction is made between reducible (a.k.a. epistemic) uncertainty caused by a lack of information and irreducible (a.k.a. aleatoric) uncertainty due to intrinsic randomness. The problem of combining uncertain pairwise predictions into a most plausible preorder is then formalized as an integer programming problem. Experimentally, we show that our method is able to appropriately balance reliability and precision of predictions.

Metrics

Metrics

SciVal
citations
29
Scopus
citations
29
SciVal
FWCI
1.78
SciVal
Author count
4
SciVal
Paper percentile
85

PlumX, opens in new tab

Captures
24
Citation count
29