feat(server): Anchored Prefix Caching for multi-turn agent workloads#492

Open

davidmroth wants to merge 20 commits into

Luce-Org:mainfrom

davidmroth:feat/tool-split-agent-cache

Commits on May 11, 2026

Merge branch 'feature/dual-gpu-dflash-safe-p2p-port' into feature/dual-gpu-dflash-safe-p2p-tool-use
davidmroth
committed

Commits on Jul 3, 2026

fix(dflash): multi-turn tool-split cache restore and usage timings
davidmroth
committed
fix(dflash): tool-split VRAM budget and ship tool_split package
davidmroth
committed
fix(dflash): reject stale prefix-cache lookups after in-place slot refresh
davidmroth
committed
Merge branch 'feature/dual-gpu-dflash-safe-p2p-tool-use' into main
davidmroth
committed
feat(server): tool-split KV cache for multi-turn agent tool use
davidmroth
committed
fix(tool-split): address Copilot review on slot LRU and snap failure
davidmroth
committed
Merge main into feat/tool-split-agent-cache
davidmroth
committed
docs: reframe tool-split goal around PFlash-friendly tool isolation
davidmroth
committed

Commits on Jul 4, 2026

Commits on Jul 7, 2026

fix(tool-split): address PR review — cache eviction, abort wiring, and hardening
davidmroth
committed