REMOTE JOB EXECUTION

Redis-backed job queue system with retry mechanisms, timeouts, and dead letter queues.

SETUP

1. Make sure you have git, docker, redis installed.
2. Clone.

STEPS

1. Open a Terminal, and run

docker compose build --no-cache

2. Start

docker compose up -d

3. Go to localhost:8000
4. To see the logs, run

docker compose logs

5. To stop, run

docker compose down

SCREENSHOTS & SCREEN-RECORDINGS

remote-job-exec-docker.mp4

TODO

• Job Cancellation. [DONE]
• Better / Well formatted Logs. [DONE]
• Using S3 for Logs and Process data.
• Multiple Queues for Multiple Tasks.
• Priority Level Queues.
• Multiple Workers. [DONE]
• Test cases.