perf(metrics): batch tokenization with defer-to-flush drain#350

Open

viraatc wants to merge 20 commits into

mainfrom

perf/tok-batch-clean

Commits on Jun 16, 2026

perf(metrics): batch tokenization with defer-to-flush drain

viraatc
and
claude
committed
fix(metrics): never skip finalize on tokenizer drain failure; cleanup

viraatc
and
claude
committed
fix(metrics): tokenizer stage uses the whole machine; restore --tokenizer-workers

viraatc
and
claude
committed
chore(metrics): use pass bodies in TokenCounter protocol stubs

viraatc
and
claude
committed
docs(metrics): add metrics-aggregator design doc; refresh services overview

viraatc
and
claude
committed
fix(metrics): publish live snapshots through tokenizer failures; bound shard warmup

viraatc
and
claude
committed
feat(metrics): no silent tokenizer fallbacks — shard or exit cleanly

viraatc
and
claude
committed
fix(metrics): shard unpinned on platforms without CPU affinity (macOS)

viraatc
and
claude
committed
refactor(metrics): queue-owned live flush lane; drop the pre_publish hook

viraatc
and
claude
committed
fix(metrics): bound live flushes; align defaults; audit-driven hardening

viraatc
and
claude
committed
fix(metrics): call-shaped awaits for cancelled tasks; pin aggregator-args seam

viraatc
and
claude
committed
fix(metrics): requeue messages on live-cancel; shrink the tokenizer API

viraatc
and
claude
committed
chore(metrics): public read-only wiring surface on the aggregator

viraatc
and
claude
committed
chore(metrics): drain-timeout default back to 60s (review feedback)

viraatc
and
claude
committed
chore(metrics): drop dead local in the live-cancel handler

viraatc
and
claude
committed
refactor(metrics): single-source service defaults in schema; tighten docs

viraatc
and
claude
committed
chore(metrics): restore original comments; keep only default-related edits

viraatc
and
claude
committed
fix(metrics): raise metrics drain-timeout default to 300s

viraatc
and
claude
committed
test(metrics): pass now-required aggregator args in signal-handling test

viraatc
and
claude
committed
chore(deps): bump aiohttp 3.14.0 -> 3.14.1 (fixes 8 CVEs)

viraatc
and
claude
committed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

perf(metrics): batch tokenization with defer-to-flush drain#350

perf(metrics): batch tokenization with defer-to-flush drain#350
viraatc wants to merge 20 commits into
mainfrom
perf/tok-batch-clean

Commits on Jun 16, 2026

perf(metrics): batch tokenization with defer-to-flush drain

fix(metrics): never skip finalize on tokenizer drain failure; cleanup

fix(metrics): tokenizer stage uses the whole machine; restore --tokenizer-workers

chore(metrics): use pass bodies in TokenCounter protocol stubs

docs(metrics): add metrics-aggregator design doc; refresh services overview

fix(metrics): publish live snapshots through tokenizer failures; bound shard warmup

feat(metrics): no silent tokenizer fallbacks — shard or exit cleanly

fix(metrics): shard unpinned on platforms without CPU affinity (macOS)

refactor(metrics): queue-owned live flush lane; drop the pre_publish hook

fix(metrics): bound live flushes; align defaults; audit-driven hardening

fix(metrics): call-shaped awaits for cancelled tasks; pin aggregator-args seam

fix(metrics): requeue messages on live-cancel; shrink the tokenizer API

chore(metrics): public read-only wiring surface on the aggregator

chore(metrics): drain-timeout default back to 60s (review feedback)

chore(metrics): drop dead local in the live-cancel handler

refactor(metrics): single-source service defaults in schema; tighten docs

chore(metrics): restore original comments; keep only default-related edits

fix(metrics): raise metrics drain-timeout default to 300s

test(metrics): pass now-required aggregator args in signal-handling test

chore(deps): bump aiohttp 3.14.0 -> 3.14.1 (fixes 8 CVEs)