-
Notifications
You must be signed in to change notification settings - Fork 4
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
- Loading branch information
1 parent
f3ade71
commit eb47ffe
Showing
3 changed files
with
29 additions
and
0 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,7 @@ | ||
--- | ||
title: "Scaling Probabilistic Integral Circuits" | ||
collection: news | ||
permalink: /news/tenpic | ||
date: 2024-07-01 | ||
--- | ||
New preprint on <a href="https://arxiv.org/abs/2406.06494">scaling probabilistic integral circuits</a> and at the same time getting the simplest and most principled way to scale PCs. |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,22 @@ | ||
--- | ||
collection: publications | ||
ref: "gala2024tenpics" | ||
permalink: "publications/gala2024tenpics" | ||
title: "Scaling Continuous Latent Variable Models as Probabilistic Integral Circuits" | ||
date: 2024-07-01 00:00 | ||
tags: circuits probml | ||
image: "/images/papers/gala2024tenpics/tenpics.png" | ||
authors: "Gennaro Gala, Cassio de Campos, Antonio Vergari, Erik Quaeghebeur" | ||
paperurl: "https://arxiv.org/abs/2406.06494" | ||
pdf: "https://arxiv.org/pdf/2406.06494" | ||
venue: "arXiv 2024" | ||
excerpt: "We continuous latent variable mixtures and adapt them to have intricate dependencies, obtaining state-of-the-art likelihoods for tractable models" | ||
abstract: "Probabilistic integral circuits (PICs) have been recently introduced as probabilistic models enjoying the key ingredient behind expressive generative models: continuous latent variables (LVs). PICs are symbolic computational graphs defining continuous LV models as hierarchies of functions that are summed and multiplied together, or integrated over some LVs. They are tractable if LVs can be analytically integrated out, otherwise they can be approximated by tractable probabilistic circuits (PC) encoding a hierarchical numerical quadrature process, called QPCs. So far, only tree-shaped PICs have been explored, and training them via numerical quadrature requires memory-intensive processing at scale. In this paper, we address these issues, and present: (i) a pipeline for building DAG-shaped PICs out of arbitrary variable decompositions, (ii) a procedure for training PICs using tensorized circuit architectures, and (iii) neural functional sharing techniques to allow scalable training. In extensive experiments, we showcase the effectiveness of functional sharing and the superiority of QPCs over traditional PCs." | ||
supplemental: | ||
bibtex: "@article{gala2024scaling, | ||
title={Scaling Continuous Latent Variable Models as Probabilistic Integral Circuits}, | ||
author={Gala, Gennaro and de Campos, Cassio and Vergari, Antonio and Quaeghebeur, Erik}, | ||
journal={arXiv preprint arXiv:2406.06494}, | ||
year={2024} | ||
}" | ||
--- |
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.