DB connection gives Quepool limit exceeded when run with TaskIQ #369
Unanswered
SifatHasnain
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
-
I am using ListQueueBroker from taskiq-redis. The task I am running handles database queries with Python SqlAlchemy (Postgresql).
The same task when running in the background for even 1000 times, the system does not break. But with TaskIQ I am getting this timeout error saying QueuePool limit is exceeded. The configuration I am using for the DB connection is
engine = create_async_engine(
DB_URI,
poolclass=AsyncAdaptedQueuePool,
pool_size=int(os.environ.get("DB_POOL_SIZE", 10)),
max_overflow=int(os.environ.get("DB_MAX_OVERFLOW", 10)),
pool_pre_ping=True,
pool_recycle=3600,
pool_timeout=20,
)
I have tried increasing the values but even with 30 tasks the system breaks.
Beta Was this translation helpful? Give feedback.
All reactions