Releases: janbjorge/pgqueuer
Releases · janbjorge/pgqueuer
v0.5.1
Full Changelog: v0.5.0...v0.5.1
v0.5.0
Release Notes
Breaking
- Simplified Database Connection: The system no longer requires a connection pool. Instead, a single database connection is now used.
Major
- Database Abstraction Layer: Introduction of
db.py
to provide database driver abstractions, supporting both AsyncPG and Psycopg drivers for PostgreSQL. - Performance Boost: Introducing the
JobBuffer
class has significantly increased job processing performance, now handling up to 18,000 jobs per second, up from 5,000 jobs per second. - Buffer Management: The
JobBuffer
class to handle job accumulation and flushing based on capacity or timeout, improving job processing efficiency.
Minor
- Dependency Management: Adjustments in
pyproject.toml
to include and better manage dependencies such asasyncpg
andpsycopg
. - Queue Manager Updates: Significant enhancements in
QueueManager
to integrate the newJobBuffer
, optimizing job handling and logging. - CLI Improvements: Enhancements to
cli.py
to support the new driver implementations and streamline command execution. - Benchmarking: Updates to benchmarking scripts for better performance tracking and configuration options.
These changes aim to enhance performance, improve code maintainability.
Full Changelog: 0.4.1...v0.5.0
0.4.1
0.4.0
Notice of Breaking Change
The latest update introduces a breaking change due to the addition of a new updated
column to the queue table with a NOT NULL
constraint. Users will need to run the upgrade
command to update their database schema accordingly. Please ensure you execute the following command after upgrading to avoid any disruptions.
python -m PgQueuer upgrade
This will trigger the below addition a column and creation of an index.
ALTER TABLE pgqueuer ADD COLUMN updated TIMESTAMP WITH TIME ZONE NOT NULL DEFAULT NOW();
CREATE INDEX pgqueuer_updated_id_id1_idx ON pgqueuer (updated ASC, id DESC) INCLUDE (id) WHERE status = 'picked';
What's Changed
- Add not null constrant to created and updated by @janbjorge in #27
- Move listner get to outer loop by @janbjorge in #28
- Retry Timer for Job Dequeue by @janbjorge in #26
- Add readthedocs by @janbjorge in #29
Full Changelog: v0.3.6...0.4.0
v0.3.6
What's Changed
- Add cli lister by @janbjorge in #21
- Batched dequeue by @janbjorge in #22
- Only pick local entrypoints by @janbjorge in #23
- Benchmarking tool rewrite by @janbjorge in #24
Full Changelog: v0.3.5...v0.3.6
v0.3.5
What's Changed
- Update prog name by @janbjorge in #20
- Drop pgcachewatch dependency by @janbjorge in #19
Full Changelog: v0.3.4...v0.3.5
v0.3.4
What's Changed
- Add dashboard output ex. to readme by @janbjorge in #12
- Add Contribute.md by @janbjorge in #14
- Add future annotations to all files by @janbjorge in #15
Full Changelog: v0.3.3...v0.3.4
v0.3.3
What's Changed
- Always print install/uninstall query, prefix uniq constrant by @janbjorge in #11
Full Changelog: v0.3.2...v0.3.3
v0.3.2
Full Changelog: v0.3.1...v0.3.2
v0.3.1
What's Changed
- Add query builder class by @janbjorge in #9
- Add dry-run option to cli by @janbjorge in #10
Full Changelog: v0.3.0...v0.3.1