Graceful Shutdown and Backpressure

[charlieroth]

Why

Prevent data loss and keep service stable under load.

Definition of Done

• Server drains in‑flight requests on shutdown.
• Background workers stop polling and finish running jobs.
• Queue length and worker concurrency are bounded and configurable.
• Load test shows stable latency under sustained pressure.

Tasks

• Wire shutdown signals to server and workers.
• Add bounded channels for job dispatch.
• Expose configuration for concurrency and queue sizes.
• Create a simple load script and record results.