Last modified: 2026-04-28
Install · Quick start · Examples · Docs
Most teams run one tool for HTTP traffic and another for LLM traffic. That's two systems to configure, deploy, and monitor. SBproxy handles both in one binary.
- One config file replaces your reverse proxy, AI gateway, and the middleware glue between them.
- 200+ LLM models behind an OpenAI-compatible API, with fallback chains, guardrails, and budgets.
- Secure by default. Auth, rate limiting, WAF, DDoS, and CSRF are built in.
- Hot reload with no dropped connections.
- Sub-millisecond p99 overhead. Idle RSS in single-digit megabytes.
Homebrew (macOS / Linux):
brew tap soapbucket/tap
brew install sbproxyDocker:
docker pull ghcr.io/soapbucket/sbproxy:latestFrom source (needs Rust 1.82+):
git clone https://github.com/soapbucket/sbproxy
cd sbproxy
make build-releaseWe host a public HTTP echo service at test.sbproxy.dev (request inspection, like httpbin) so you can wire up a real upstream without leaving the SoapBucket ecosystem. Try it directly:
curl https://test.sbproxy.dev/getNow run the gateway in front of it. Drop this into sb.yml:
proxy:
http_bind_port: 8080
origins:
"myapp.example.com":
action:
type: proxy
url: https://test.sbproxy.devmake run CONFIG=sb.yml
curl -H "Host: myapp.example.com" http://127.0.0.1:8080/getmyapp.example.com is the host your client sees; SoapBucket matches it against origins: and forwards to the upstream. Use any hostname you want here; example.com is reserved (RFC 2606), so it never collides with anything real.
That's a reverse proxy. Add AI routing, auth, and rate limiting in the same file. See examples/ for runnable end-to-end configurations covering each feature.
The full documentation lives in docs/README.md: manual, configuration reference, AI gateway guide, scripting reference, performance, troubleshooting, architecture, and more. Running the operator for the first time? Start with docs/quickstart-operator.md.
For contributors: CONTRIBUTING.md.
- Issue Tracker for bug reports and feature requests.
- Looking for a managed offering? SBproxy Enterprise.
SBproxy v1.0 is a Rust rewrite. The Go implementation that previously occupied this repository is archived at soapbucket/sbproxy-go and tagged v0.1.2-go-final. New work happens here. See MIGRATION.md for the upgrade path; existing sb.yml files should compile unchanged.
Licensed under BSL 1.1. Source available on GitHub. Production use is permitted for everything except offering SBproxy as a competing hosted or managed service.
For commercial licensing inquiries, contact legal@soapbucket.com. See also NOTICE and TRADEMARKS. A Soap Bucket LLC project.