Skip to content

Commit

Permalink
Fixing R2FM paper title
Browse files Browse the repository at this point in the history
  • Loading branch information
arranger1044 committed Apr 22, 2024
1 parent 13f6c4b commit bb06831
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions _publications/calanzone2024locolm.md
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@
collection: publications
ref: "calanzone2024locolm"
permalink: "publications/calanzone2024locolm"
title: "Galerkin meets Laplace: Fast uncertainty estimation in neural PDEs"
title: "Towards Logically Consistent Language Models via Probabilistic Reasoning"
date: 2024-03-05 10:00
tags: nesy probml llm
image: "/images/papers/calanzone2024locolm/locolm.png"
Expand All @@ -13,7 +13,7 @@ venue: "R2FM Workshop @ ICLR 2024"
excerpt: "We introduce a training objective based on principled probabilistic reasoning that teaches a LLM to be logically consistent with a set of external facts and rules, allowing to extrapolate to unseen but semantically similar factual knowledge."
abstract: "Large language models (LLMs) are a promising venue for natural language understanding and generation tasks. However, current LLMs are far from reliable: they are prone to generate non-factual information and, more crucially, to contradict themselves when prompted to reason about beliefs of the world. These problems are currently addressed with large scale fine-tuning or by delegating consistent reasoning to external tools. In this work, we strive for a middle ground and introduce a training objective based on principled probabilistic reasoning that teaches a LLM to be consistent with external knowledge in the form of a set of facts and rules. Fine-tuning with our loss on a limited set of facts enables our LLMs to be more logically consistent than previous baselines and allows them to extrapolate to unseen but semantically similar factual knowledge more systematically."
bibtex: "@inproceedings{calanzone2024locolm,
title={Galerkin meets Laplace: Fast uncertainty estimation in neural PDEs},
title={Towards Logically Consistent Language Models via Probabilistic Reasoning},
author={Diego Calanzone, Antonio Vergari, Stefano Teso},
booktitle={ICLR 2024 Workshop on Reliable and Responsible Foundation Models},
year={2024}
Expand Down

0 comments on commit bb06831

Please sign in to comment.