docs: document e2a metrics CLI command, fix stale MCP tool counts - #905
Merged
Conversation
- cli/README.md, README.md: e2a metrics ships in CLI 2.4.0 (see cli/CHANGELOG.md) but had no README section or command-table row. - mcp/README.md, docs/runbooks/mcp-server.md, mcp/examples/README.md, mcp/examples/codex/README.md: these said 76 tools (20 runtime + 56 admin), disagreeing with the plugin manifests and plugins/e2a/skills/e2a/SKILL.md, which already say 78 (21 runtime + 57 admin). Counted mcp/src/tools/tiers.ts directly: 21 RUNTIME_TOOLS + 57 ADMIN_TOOLS = 78, confirming the manifests were right and these four docs were stale.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Repo-wide documentation audit found two confirmed, verified issues (see notes below on what was deliberately excluded).
Changes by file
cli/README.md,README.md—e2a metricsshipped in CLI2.4.0(seecli/CHANGELOG.md,cli/src/commands/metrics.ts, wired intocli/src/bin/e2a.ts) but had noREADME.mdcommand-table row and nocli/README.mdsection. Added both, matching the flags actually implemented (--start/--end,--by-agent,--by-day,--json).mcp/README.md,docs/runbooks/mcp-server.md,mcp/examples/README.md,mcp/examples/codex/README.md— these said the MCP surface is 76 tools (20 runtime + 56 admin), which disagreed with the plugin manifests (.claude-plugin/plugin.json, marketplace listings) andplugins/e2a/skills/e2a/SKILL.md, which already say 78 (21 runtime + 57 admin). CountedRUNTIME_TOOLS/ADMIN_TOOLSdirectly inmcp/src/tools/tiers.ts: 21 + 57 = 78, confirming the manifests were right and these four docs were stale. Fixed all four to 78/21/57.Notes on scope
Before starting, I checked for prior unmerged doc-audit work: no currently open PR touches documentation (the one open PR, #627, is an unrelated feature). Five earlier documentation-audit branches/PRs (#716, #812, #666, #763, #731) exist but were all closed without merging — each one proposed a "MCP tool count" bump that had already drifted again by review time. To avoid repeating that failure mode, this PR keeps the tool-count fix narrow (verified against the actual
tiers.tsregistry, not against another doc) and leads with a more substantive, durable finding (the missingmetricscommand docs) rather than centering on tool-count churn. A broader audit pass (README/AGENTS.md/docs/*, package READMEs, plugin docs,web/public/*.md, changelogs) turned up no other high-confidence issues — see PR description for what was checked and found clean.Test plan
e2a metricsflags/behavior by readingcli/src/commands/metrics.tsand its wiring incli/src/bin/e2a.tsRUNTIME_TOOLS/ADMIN_TOOLSinmcp/src/tools/tiers.tsdirectly (not by trusting another doc)76 tool/20 runtime/56 adminmentions — none found outsidedocs/design//docs/superpowers/(historical, out of scope)Generated by Claude Code