Skip to content

[Doc] Add Multi-tenant Deployment Guide - #3378

Merged
ykwd merged 1 commit into
kvcache-ai:mainfrom
yokinoshitayoki:multi-tenant-doc
Aug 11, 2026
Merged

[Doc] Add Multi-tenant Deployment Guide#3378
ykwd merged 1 commit into
kvcache-ai:mainfrom
yokinoshitayoki:multi-tenant-doc

Conversation

@yokinoshitayoki

@yokinoshitayoki yokinoshitayoki commented Aug 11, 2026

Copy link
Copy Markdown
Collaborator

Description

This PR consolidates the previously scattered multi-tenant deployment documentation into a dedicated Multi-Tenant Deployment guide. It also adds instructions when integrating Mooncake with SGLang and vLLM.

Module

  • Transfer Engine (mooncake-transfer-engine)
  • Mooncake Store (mooncake-store)
  • Mooncake EP (mooncake-ep)
  • Mooncake PG (mooncake-pg)
  • Integration (mooncake-integration)
  • P2P Store (mooncake-p2p-store)
  • Python Wheel (mooncake-wheel)
  • Common (mooncake-common)
  • Mooncake RL (mooncake-rl)
  • CI/CD
  • Docs
  • Other

Type of Change

  • Bug fix
  • New feature
  • Refactor
  • Breaking change
  • Documentation update
  • Performance improvement
  • Other

Checklist

  • I have performed a self-review of my own code
  • I have formatted my code using ./scripts/code_format.sh
  • I have run pre-commit run --all-files and all hooks pass
  • I have updated the documentation (if applicable)
  • I have added tests to prove my changes are effective
  • For changes >500 LOC: I have filed an RFC issue

AI Assistance Disclosure

  • No AI tools were used
  • AI tools were used (specify below)

Codex helped me to polish the wording.

@github-actions github-actions Bot added documentation Improvements or additions to documentation run-ci labels Aug 11, 2026
@ykwd
ykwd merged commit 5c0724d into kvcache-ai:main Aug 11, 2026
16 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

documentation Improvements or additions to documentation run-ci

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants