Skip to content

Commit

Permalink
Scalin' pics
Browse files Browse the repository at this point in the history
  • Loading branch information
arranger1044 committed Jul 20, 2024
1 parent f3ade71 commit eb47ffe
Show file tree
Hide file tree
Showing 3 changed files with 29 additions and 0 deletions.
7 changes: 7 additions & 0 deletions _news/gala2024tenpics-preprint.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,7 @@
---
title: "Scaling Probabilistic Integral Circuits"
collection: news
permalink: /news/tenpic
date: 2024-07-01
---
New preprint on <a href="https://arxiv.org/abs/2406.06494">scaling probabilistic integral circuits</a> and at the same time getting the simplest and most principled way to scale PCs.
22 changes: 22 additions & 0 deletions _publications/gala2024-tenpic.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,22 @@
---
collection: publications
ref: "gala2024tenpics"
permalink: "publications/gala2024tenpics"
title: "Scaling Continuous Latent Variable Models as Probabilistic Integral Circuits"
date: 2024-07-01 00:00
tags: circuits probml
image: "/images/papers/gala2024tenpics/tenpics.png"
authors: "Gennaro Gala, Cassio de Campos, Antonio Vergari, Erik Quaeghebeur"
paperurl: "https://arxiv.org/abs/2406.06494"
pdf: "https://arxiv.org/pdf/2406.06494"
venue: "arXiv 2024"
excerpt: "We continuous latent variable mixtures and adapt them to have intricate dependencies, obtaining state-of-the-art likelihoods for tractable models"
abstract: "Probabilistic integral circuits (PICs) have been recently introduced as probabilistic models enjoying the key ingredient behind expressive generative models: continuous latent variables (LVs). PICs are symbolic computational graphs defining continuous LV models as hierarchies of functions that are summed and multiplied together, or integrated over some LVs. They are tractable if LVs can be analytically integrated out, otherwise they can be approximated by tractable probabilistic circuits (PC) encoding a hierarchical numerical quadrature process, called QPCs. So far, only tree-shaped PICs have been explored, and training them via numerical quadrature requires memory-intensive processing at scale. In this paper, we address these issues, and present: (i) a pipeline for building DAG-shaped PICs out of arbitrary variable decompositions, (ii) a procedure for training PICs using tensorized circuit architectures, and (iii) neural functional sharing techniques to allow scalable training. In extensive experiments, we showcase the effectiveness of functional sharing and the superiority of QPCs over traditional PCs."
supplemental:
bibtex: "@article{gala2024scaling,
title={Scaling Continuous Latent Variable Models as Probabilistic Integral Circuits},
author={Gala, Gennaro and de Campos, Cassio and Vergari, Antonio and Quaeghebeur, Erik},
journal={arXiv preprint arXiv:2406.06494},
year={2024}
}"
---
Binary file added images/papers/gala2024tenpics/tenpics.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.

0 comments on commit eb47ffe

Please sign in to comment.