How to Persist Scheduled Jobs at Runtime in Taskiq for FastAPI with NATS?

[Atanusaha143]

Hi everyone,

I'm currently working on a FastAPI project where I need to schedule jobs dynamically at runtime with NATS. For my use case, it's crucial to persist these scheduled jobs so that they survive restarts or crashes.

I'm exploring Taskiq for this, and I was wondering—does Taskiq offer any built-in support for persisting scheduled jobs with the help of NATS on FastAPI? Or would I need to implement my own persistence mechanism?

Any insights or recommended approaches would be greatly appreciated!

Thanks in advance!

[s3rius]

Yes, of course there is a mechanism.

First of all, you can pick for example ListRedisScheduleSource from taskiq-redis. Or alternatively you can implement your own schedule source.

To schedule tasks dynamically, check out this section of docs.

[Atanusaha143]

@s3rius Sorry for the inconvenience. What is the process for NATS? An example or resource would be helpful.

[s3rius]

I didn't get the question. Can you please elaborate a bit?

[Atanusaha143]

@s3rius Let's break down:

App: FastAPI
Broker: NATS
Scheduler: Taskiq

If I want to create a job dynamically via Taskiq, wants NATS JetStream persistency and run the project as FastAPI, how should the setup look like?