Document detail
ID

oai:arXiv.org:2408.09570

Topic
Computer Science - Machine Learnin... Computer Science - Artificial Inte... Computer Science - Computers and S...
Author
Ciranni, Massimiliano Molinaro, Luca Barbano, Carlo Alberto Fiandrotti, Attilio Murino, Vittorio Pastore, Vito Paolo Tartaglione, Enzo
Category

Computer Science

Year

2024

listing date

8/21/2024

Keywords
bias deep model biases
Metrics

Abstract

In the last few years, due to the broad applicability of deep learning to downstream tasks and end-to-end training capabilities, increasingly more concerns about potential biases to specific, non-representative patterns have been raised.

Many works focusing on unsupervised debiasing usually leverage the tendency of deep models to learn ``easier'' samples, for example by clustering the latent space to obtain bias pseudo-labels.

However, the interpretation of such pseudo-labels is not trivial, especially for a non-expert end user, as it does not provide semantic information about the bias features.

To address this issue, we introduce ``Say My Name'' (SaMyNa), the first tool to identify biases within deep models semantically.

Unlike existing methods, our approach focuses on biases learned by the model.

Our text-based pipeline enhances explainability and supports debiasing efforts: applicable during either training or post-hoc validation, our method can disentangle task-related information and proposes itself as a tool to analyze biases.

Evaluation on traditional benchmarks demonstrates its effectiveness in detecting biases and even disclaiming them, showcasing its broad applicability for model diagnosis.

Ciranni, Massimiliano,Molinaro, Luca,Barbano, Carlo Alberto,Fiandrotti, Attilio,Murino, Vittorio,Pastore, Vito Paolo,Tartaglione, Enzo, 2024, Say My Name: a Model's Bias Discovery Framework

Document

Open

Share

Source

Articles recommended by ES/IODE AI

Comparison between Dual-Energy CT and Quantitative Susceptibility Mapping in Assessing Brain Iron Deposition in Parkinson Disease
nigra substantia healthy depositions p < 05 nucleus brain susceptibility ct bilateral dual-energy iron quantitative mapping values magnetic globus pallidus
Integration of human papillomavirus associated anal cancer screening into HIV care and treatment program in Pakistan: perceptions of policymakers, managers, and care providers
hpv hiv msm transgender women anal cancer screening integration pakistan system managers pakistan informants anal screening cancer lack healthcare hiv