perf(runtime): llama prewarm-on-focus, mid-prefill abort, and KV-reuse visibility#681

FuJacob merged 2 commits into

mainFuJacob/cotabby:mainfrom

perf/llama-prewarm-abortFuJacob/cotabby:perf/llama-prewarm-abortCopy head branch name to clipboard