Skip to content

Releases: NullRabbitLabs/llm-gateway

v0.1.0 — Initial Public Release

22 Feb 22:22

Choose a tag to compare

First public release of LLM Gateway from NullRabbit Labs.

Features

  • Multi-provider routing across DeepSeek, Gemini, OpenAI, and Anthropic
  • Automatic fallback — tries cheaper providers first, cascades on failure
  • Per-request cost tracking in microcents
  • OpenAI-compatible /v1/chat/completions endpoint with transparent tool call translation
  • Dedicated /classify, /plan, and /embed endpoints
  • Docker support

Quick start

pip install -r requirements.txt
export LLM_PROVIDER=auto
export DEEPSEEK_API_KEY=your-key
python main.py

See README for full documentation.