Releases: NullRabbitLabs/llm-gateway
Releases · NullRabbitLabs/llm-gateway
v0.1.0 — Initial Public Release
First public release of LLM Gateway from NullRabbit Labs.
Features
- Multi-provider routing across DeepSeek, Gemini, OpenAI, and Anthropic
- Automatic fallback — tries cheaper providers first, cascades on failure
- Per-request cost tracking in microcents
- OpenAI-compatible
/v1/chat/completionsendpoint with transparent tool call translation - Dedicated
/classify,/plan, and/embedendpoints - Docker support
Quick start
pip install -r requirements.txt
export LLM_PROVIDER=auto
export DEEPSEEK_API_KEY=your-key
python main.pySee README for full documentation.