perf(chat): KV reuse, flash-attn, modern samplers, history window, token coalescing#73

Merged

cryptopoly merged 6 commits into

feature/chatt-llm-improvements

Jun 4, 2026

Commits on Jun 4, 2026

perf(chat): coalesce streamed token frames (fewer json.dumps + SSE writes)
cryptopoly
committed
perf(chat): coalesce agent/tool stream path + drop the 4-char answer dribble
cryptopoly
committed