Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

parrallelize posterior particle loading #315

Open
arik-shurygin opened this issue Jan 7, 2025 · 0 comments
Open

parrallelize posterior particle loading #315

arik-shurygin opened this issue Jan 7, 2025 · 0 comments

Comments

@arik-shurygin
Copy link
Collaborator

arik-shurygin commented Jan 7, 2025

as requested in #311 figure out a way to parallelize the load_posterior_particle() function which calls run_simulation. Either with Pool() or with jax.pmap().

The main issues faced when trying this earlier (and why it is not included in #316 ) is that Pool() requires pickle serializibility and pmap only works with jax operations, which our code breaks both of in its current architecture. Maybe I am missing something here.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant