Hierarchical clustering for discrimination discovery: a top-down approach

Neda Nasiriani, Anna Squicciarini, Zara Saldanha, Sanchit Goel, Nicola Zannone

Onderzoeksoutput: Hoofdstuk in Boek/Rapport/CongresprocedureConferentiebijdrageAcademicpeer review

5 Citaten (Scopus)

Samenvatting

Today, data is an essential part of many decision-making processes in businesses and social life through the use of various machine learning techniques. These methods can easily perpetuate human bias in the data and result in discrimination. Despite a growing interest in data discrimination discovery and removal, to date there is a lack of a general and robust framework to distinguish discriminatory decision-making processes from non-discriminatory ones. In this work, we present a generic framework that helps detect possible discrimination by analyzing historical data and associated decisions using a top-down unsupervised approach, which we refer to as hierarchical clustering. Our approach is highly adaptive as it gradually 'learns' users' inherent groups, and clusters their records using cohesiveness and density of points in the dataset. Moreover, we propose a progressive attribute-selection method to choose statistically relevant attributes, thus reducing the effect of noise. Finally, we adopt a recursive notion of cluster profile that is homogeneous w.r.t. decision labels. This allows for deeper insights on the data and on the decision-making underlying the final user classification. Our framework is able to identify both positive and negative bias resulting in discrimination. We also highlight patterns of discrimination revealed by the homogeneous cluster centroids, which otherwise could not be captured.

Originele taal-2Engels
TitelProceedings - IEEE 2nd International Conference on Artificial Intelligence and Knowledge Engineering, AIKE 2019
Plaats van productiePiscataway
UitgeverijInstitute of Electrical and Electronics Engineers
Pagina's187-194
Aantal pagina's8
ISBN van elektronische versie978-1-7281-1488-0
DOI's
StatusGepubliceerd - 1 jun. 2019
Evenement2nd IEEE International Conference on Artificial Intelligence and Knowledge Engineering, AIKE 2019 - Cagliari, Sardinia, Italië
Duur: 3 jun. 20195 jun. 2019

Congres

Congres2nd IEEE International Conference on Artificial Intelligence and Knowledge Engineering, AIKE 2019
Land/RegioItalië
StadCagliari, Sardinia
Periode3/06/195/06/19

Vingerafdruk

Duik in de onderzoeksthema's van 'Hierarchical clustering for discrimination discovery: a top-down approach'. Samen vormen ze een unieke vingerafdruk.

Citeer dit