-
Notifications
You must be signed in to change notification settings - Fork 4
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
- Loading branch information
1 parent
87d24b8
commit c543b26
Showing
3 changed files
with
30 additions
and
0 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,7 @@ | ||
--- | ||
title: "BEARS preprint" | ||
collection: news | ||
permalink: /news/bears-preprint | ||
date: 2024-02-19 | ||
--- | ||
New preprint on <a href="https://arxiv.org/abs/2402.12240">making NeSy models reasoning-shortcut aware by uncertainty quantification</a>. |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,23 @@ | ||
--- | ||
collection: publications | ||
ref: "marconato2024bears" | ||
permalink: "publications/marconato2024bears" | ||
title: "BEARS Make Neuro-Symbolic Models Aware of their Reasoning Shortcuts" | ||
date: 2024-02-19 00:00 | ||
tags: nesy shortcuts reasoning uncertainty-quantification | ||
image: "/images/papers/marconato2024bears/bears.png" | ||
authors: "Emanuele Marconato, Samuele Bortolotti, Emile van Krieken, Antonio Vergari, Andrea Passerini, Stefano Teso" | ||
paperurl: "https://arxiv.org/abs/2402.12240" | ||
pdf: "https://arxiv.org/pdf/2402.12240.pdf" | ||
venue: "arXiv 2024" | ||
code: "https://github.com/samuelebortolotti/bears" | ||
excerpt: "NeSy model can suffer from reasoning shortcuts, and to make them shortcut-aware, we sprinkle a pinch of Bayes to quantify the uncertainty over the extracted concepts, showing it is correlated to the presence of reasoning shortcuts." | ||
abstract: "Neuro-Symbolic (NeSy) predictors that conform to symbolic knowledge - encoding, e.g., safety constraints - can be affected by Reasoning Shortcuts (RSs): They learn concepts consistent with the symbolic knowledge by exploiting unintended semantics. RSs compromise reliability and generalization and, as we show in this paper, they are linked to NeSy models being overconfident about the predicted concepts. Unfortunately, the only trustworthy mitigation strategy requires collecting costly dense supervision over the concepts. Rather than attempting to avoid RSs altogether, we propose to ensure NeSy models are aware of the semantic ambiguity of the concepts they learn, thus enabling their users to identify and distrust low-quality concepts. Starting from three simple desiderata, we derive bears (BE Aware of Reasoning Shortcuts), an ensembling technique that calibrates the model's concept-level confidence without compromising prediction accuracy, thus encouraging NeSy architectures to be uncertain about concepts affected by RSs. We show empirically that bears improves RS-awareness of several state-of-the-art NeSy models, and also facilitates acquiring informative dense annotations for mitigation purposes." | ||
supplemental: | ||
bibtex: "@article{marconato2024bears,<br/> | ||
title={BEARS Make Neuro-Symbolic Models Aware of their Reasoning Shortcuts},<br/> | ||
author={Emanuele Marconato, Samuele Bortolotti, Emile van Krieken, Antonio Vergari, Andrea Passerini, Stefano Teso,<br/> | ||
journal={arXiv preprint arXiv:2402.12240},<br/> | ||
year={2024} | ||
}" | ||
--- |
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.